2023-10-08T06:44:41.444 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T06:44:41.445 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi --verbose --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} --archive /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408 -- /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/orig.config.yaml 2023-10-08T06:44:41.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T06:44:41.558 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} email: yweinste@redhat.com first_in_suite: false job_id: '7417408' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 9064 sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 sleep_before_teardown: 0 subset: 111/12000 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_14:08:36 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T06:44:41.558 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa; will attempt to use it 2023-10-08T06:44:41.559 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks 2023-10-08T06:44:41.559 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T06:44:41.561 INFO:teuthology.task.internal:Checking packages... 2023-10-08T06:44:41.583 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '9725b08fd801c82987c737f7e6d354878f036ee8' 2023-10-08T06:44:41.583 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T06:44:41.584 INFO:teuthology.packaging:ref: None 2023-10-08T06:44:41.584 INFO:teuthology.packaging:tag: None 2023-10-08T06:44:41.584 INFO:teuthology.packaging:branch: main 2023-10-08T06:44:41.584 INFO:teuthology.packaging:sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:44:41.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-10-08T06:44:41.934 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6613.gb05d167b 2023-10-08T06:44:41.934 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T06:44:41.940 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T06:44:41.940 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T06:44:41.947 INFO:teuthology.task.internal:Saving configuration 2023-10-08T06:44:41.959 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T06:44:41.965 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T06:44:41.988 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.307315', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:44:42.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.309057', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:44:42.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.310780', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:44:42.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.305336', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:44:42.058 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T06:44:42.064 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2023-10-08T06:44:42.064 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['osd.0'] 2023-10-08T06:44:42.064 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['osd.1'] 2023-10-08T06:44:42.064 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['osd.2'] 2023-10-08T06:44:42.064 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T06:44:42.188 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f73aaf37af0>, signals=[15]) 2023-10-08T06:44:42.188 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T06:44:42.194 INFO:teuthology.task.internal:Opening connections... 2023-10-08T06:44:42.195 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-10-08T06:44:42.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:44:42.266 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2023-10-08T06:44:42.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:44:42.333 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2023-10-08T06:44:42.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:44:42.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T06:44:42.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:44:42.470 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T06:44:42.477 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-10-08T06:44:42.498 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-10-08T06:44:42.499 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-10-08T06:44:42.560 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:44:42.560 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:44:42.560 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.6" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:44:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:44:42.562 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:44:42.562 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:44:42.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:44:42.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:44:42.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:44:42.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:44:42.563 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-10-08T06:44:42.586 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-10-08T06:44:42.607 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-10-08T06:44:42.607 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-10-08T06:44:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:44:42.665 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:44:42.665 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-08T06:44:42.685 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-10-08T06:44:42.706 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-10-08T06:44:42.706 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-08T06:44:42.765 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:44:42.765 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:44:42.766 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:44:42.767 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:44:42.767 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:44:42.767 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:44:42.767 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:44:42.767 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-08T06:44:42.785 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-08T06:44:42.806 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-08T06:44:42.807 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-08T06:44:42.866 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:44:42.866 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:44:42.866 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-10-08T06:44:42.866 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-10-08T06:44:42.866 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2023-10-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:44:42.868 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-08T06:44:42.884 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T06:44:42.895 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T06:44:42.901 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T06:44:42.902 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:44:42.904 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:44:42.906 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:44:42.909 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:44:42.927 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T06:44:42.934 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T06:44:42.935 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:44:42.965 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:44:42.968 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:44:42.971 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:44:43.013 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T06:44:43.112 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T06:44:43.126 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-08T06:44:43.126 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-08T06:44:43.127 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:44:43.127 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:44:43.128 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:44:43.128 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:44:43.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:43.147 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-10-08T06:44:43.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:43.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:43.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:43.151 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-10-08T06:44:43.152 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2023-10-08T06:44:43.152 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2023-10-08T06:44:43.205 INFO:teuthology.orchestra.run.smithi183.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.206 INFO:teuthology.task.kernel:Running kernel on smithi183: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.206 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2023-10-08T06:44:43.209 INFO:teuthology.orchestra.run.smithi163.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.209 INFO:teuthology.task.kernel:Running kernel on smithi163: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.209 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2023-10-08T06:44:43.210 INFO:teuthology.orchestra.run.smithi169.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.210 INFO:teuthology.task.kernel:Running kernel on smithi169: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.211 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum install -y kernel 2023-10-08T06:44:43.211 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.212 INFO:teuthology.task.kernel:Running kernel on smithi037: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:43.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2023-10-08T06:44:44.333 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:44.333 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2023-10-08T06:44:44.394 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:44.394 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-10-08T06:44:44.412 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:44.412 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-08T06:44:44.464 INFO:teuthology.orchestra.run.smithi169.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:44.464 INFO:teuthology.orchestra.run.smithi169.stdout:Unable to read consumer identity 2023-10-08T06:44:45.759 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-08T06:44:45.908 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-10-08T06:44:45.912 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-08T06:44:45.926 INFO:teuthology.orchestra.run.smithi169.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-08T06:44:46.502 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-08T06:44:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-08T06:44:47.621 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2023-10-08T06:44:49.652 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 16 MB 00:03 2023-10-08T06:44:50.068 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 367 kB/s | 24 kB 00:00 2023-10-08T06:44:50.650 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 593 kB/s | 24 kB 00:00 2023-10-08T06:44:50.746 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:44:50.795 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-08T06:44:50.796 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-08T06:44:50.796 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-08T06:44:50.908 DEBUG:teuthology.orchestra.run.smithi183:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:44:51.229 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 371 kB/s | 24 kB 00:00 2023-10-08T06:44:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2023-10-08T06:44:51.311 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:44:51.502 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 06:44:50 AM UTC. 2023-10-08T06:44:51.510 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-10-08T06:44:51.512 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-10-08T06:44:51.512 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-10-08T06:44:51.545 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:51.577 INFO:teuthology.orchestra.run.smithi183.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:51.624 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum reinstall -y kernel || true 2023-10-08T06:44:51.633 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:44:51.915 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:44:51.953 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:51.953 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2023-10-08T06:44:51.970 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-10-08T06:44:51.972 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2023-10-08T06:44:51.972 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-10-08T06:44:52.021 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:52.022 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-08T06:44:52.087 DEBUG:teuthology.orchestra.run.smithi163:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:44:52.209 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:44:50 AM UTC. 2023-10-08T06:44:52.250 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:52.280 INFO:teuthology.orchestra.run.smithi183.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:52.302 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:44:50 AM UTC. 2023-10-08T06:44:52.326 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:44:52.359 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:52.405 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:52.406 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:52.406 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:44:52.406 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2023-10-08T06:44:52.406 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:44:52.420 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:52.420 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-10-08T06:44:52.434 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2023-10-08T06:44:52.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2023-10-08T06:44:52.449 DEBUG:teuthology.parallel:result is None 2023-10-08T06:44:52.686 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 06:44:51 AM UTC. 2023-10-08T06:44:52.727 INFO:teuthology.orchestra.run.smithi163.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:52.775 INFO:teuthology.orchestra.run.smithi163.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:52.791 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:52.792 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-08T06:44:52.821 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum reinstall -y kernel || true 2023-10-08T06:44:53.061 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 06:44:50 AM UTC. 2023-10-08T06:44:53.105 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:53.136 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:53.151 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:53.151 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-10-08T06:44:53.162 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 452 kB/s | 24 kB 00:00 2023-10-08T06:44:53.184 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:44:53.267 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:53.267 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:53.267 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:44:53.267 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-08T06:44:53.268 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:44:53.304 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2023-10-08T06:44:53.316 DEBUG:teuthology.parallel:result is None 2023-10-08T06:44:53.407 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:44:51 AM UTC. 2023-10-08T06:44:53.447 INFO:teuthology.orchestra.run.smithi163.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:53.486 INFO:teuthology.orchestra.run.smithi163.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:53.537 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:44:53.618 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:53.618 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:53.618 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:44:53.618 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2023-10-08T06:44:53.619 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:44:53.650 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2023-10-08T06:44:53.663 DEBUG:teuthology.parallel:result is None 2023-10-08T06:44:53.821 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:44:53.875 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2023-10-08T06:44:53.876 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2023-10-08T06:44:53.877 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2023-10-08T06:44:53.990 DEBUG:teuthology.orchestra.run.smithi169:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:44:54.322 INFO:teuthology.orchestra.run.smithi169.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:54.323 INFO:teuthology.orchestra.run.smithi169.stdout:Unable to read consumer identity 2023-10-08T06:44:54.584 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 06:44:53 AM UTC. 2023-10-08T06:44:54.625 INFO:teuthology.orchestra.run.smithi169.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:54.663 INFO:teuthology.orchestra.run.smithi169.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:54.711 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum reinstall -y kernel || true 2023-10-08T06:44:55.040 INFO:teuthology.orchestra.run.smithi169.stdout:Updating Subscription Management repositories. 2023-10-08T06:44:55.041 INFO:teuthology.orchestra.run.smithi169.stdout:Unable to read consumer identity 2023-10-08T06:44:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:44:53 AM UTC. 2023-10-08T06:44:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:44:55.367 INFO:teuthology.orchestra.run.smithi169.stderr:Error: No packages marked for reinstall. 2023-10-08T06:44:55.413 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:44:55.493 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:55.493 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:44:55.494 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:44:55.494 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2023-10-08T06:44:55.494 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:44:55.519 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2023-10-08T06:44:55.530 DEBUG:teuthology.parallel:result is None 2023-10-08T06:44:55.531 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T06:44:55.537 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T06:44:55.538 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:44:55.540 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:44:55.542 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:44:55.572 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:44:55.593 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T06:44:55.601 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T06:44:55.609 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T06:44:55.609 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:44:55.612 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:44:55.614 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:44:55.630 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:44:55.811 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T06:44:55.819 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T06:44:55.819 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:44:55.822 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:44:55.825 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:44:55.829 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:44:55.860 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.863 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.868 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.873 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.880 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.886 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.898 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:44:55.899 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T06:44:55.906 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T06:44:55.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:44:55.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:44:55.919 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:44:55.921 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:44:55.951 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T06:44:55.959 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T06:44:55.959 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:44:55.988 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:44:55.991 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:44:55.993 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:44:56.010 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:56.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:56.146 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:56.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:56.276 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:44:56.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:44:56.363 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:56.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:56.476 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:56.520 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:56.564 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:44:56.564 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:44:56.634 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:56.754 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:56.819 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:56.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:56.950 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:44:56.951 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:44:57.020 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:57.069 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:44:57.120 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:57.206 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:44:57.252 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:44:57.252 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:44:57.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-10-08T06:44:57.324 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2023-10-08T06:44:57.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2023-10-08T06:44:57.329 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-10-08T06:44:57.384 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:44:57.390 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:44:57.419 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:44:57.431 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:44:57.872 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T06:44:57.883 INFO:teuthology.task.internal:Starting timer... 2023-10-08T06:44:57.883 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T06:44:57.903 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T06:44:57.912 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T06:44:57.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-10-08T06:44:57.981 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-10-08T06:44:57.983 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2023-10-08T06:44:58.046 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2023-10-08T06:44:58.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2023-10-08T06:44:58.120 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2023-10-08T06:44:58.122 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2023-10-08T06:44:58.191 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2023-10-08T06:44:58.193 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T06:44:58.193 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-10-08T06:44:58.224 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-10-08T06:44:58.224 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2023-10-08T06:44:58.258 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2023-10-08T06:44:58.259 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2023-10-08T06:44:58.286 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2023-10-08T06:44:58.287 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2023-10-08T06:44:58.311 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2023-10-08T06:44:58.312 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2023-10-08T06:44:58.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:44:58.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:58.342 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:44:58.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:58.371 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:44:58.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:58.399 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:44:58.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:44:58.428 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T06:44:58.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:44:58.457 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:44:58.483 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:44:58.522 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:44:58.549 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T06:44:58.560 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T06:44:58.560 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T06:44:58.577 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T06:44:58.578 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi163.front.sepia.ceph.com,smithi169.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T06:54:19.602 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2023-10-08T06:54:19.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-08T06:54:19.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:54:19.701 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-08T06:54:19.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-08T06:54:19.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-08T06:54:19.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:54:19.842 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-10-08T06:54:19.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-08T06:54:19.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-08T06:54:19.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:54:19.938 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-10-08T06:54:20.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-08T06:54:20.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T06:54:20.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:54:20.080 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-08T06:54:20.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T06:54:20.151 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T06:54:20.162 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T06:54:20.162 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T06:54:20.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T06:54:20.165 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T06:54:20.165 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T06:54:20.167 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T06:54:20.167 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T06:54:20.170 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T06:54:20.170 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T06:54:20.200 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T06:54:20.201 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T06:54:20.205 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T06:54:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T06:54:20.217 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T06:54:20.222 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T06:54:20.225 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T06:54:20.240 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T06:54:20.293 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-10-08T06:54:20.295 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2023-10-08T06:54:20.295 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2023-10-08T06:54:20.306 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-10-08T06:54:20.307 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2023-10-08T06:54:20.308 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2023-10-08T06:54:20.314 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2023-10-08T06:54:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T06:54:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T06:54:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T06:54:20.327 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2023-10-08T06:54:20.337 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T06:54:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T06:54:20.338 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T06:54:20.341 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T06:54:20.356 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T06:54:20.413 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-10-08T06:54:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:bash: ntpq: command not found 2023-10-08T06:54:20.416 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T06:54:20.416 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-10-08T06:54:20.416 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.417 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.417 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.417 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.418 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T06:54:20.418 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2023-10-08T06:54:20.419 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.419 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.419 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.419 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.425 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-10-08T06:54:20.429 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T06:54:20.429 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-10-08T06:54:20.429 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.429 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.429 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.429 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.432 INFO:teuthology.orchestra.run.smithi183.stderr:bash: ntpq: command not found 2023-10-08T06:54:20.435 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T06:54:20.435 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-10-08T06:54:20.436 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.436 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.436 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.436 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T06:54:20.437 INFO:teuthology.run_tasks:Running task install... 2023-10-08T06:54:20.578 DEBUG:teuthology.task.install:project ceph 2023-10-08T06:54:20.578 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}} 2023-10-08T06:54:20.578 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'} 2023-10-08T06:54:20.578 INFO:teuthology.task.install:Using flavor: default 2023-10-08T06:54:20.584 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T06:54:20.584 INFO:teuthology.task.install:extra packages: [] 2023-10-08T06:54:20.584 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T06:54:20.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:54:20.587 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T06:54:20.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:54:20.588 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T06:54:20.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:54:20.589 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T06:54:20.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:54:20.823 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T06:54:20.823 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T06:54:20.829 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T06:54:20.829 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T06:54:20.836 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T06:54:20.836 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T06:54:20.838 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T06:54:20.838 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T06:54:20.943 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T06:54:20.943 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:54:20.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T06:54:20.957 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T06:54:20.957 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:54:20.958 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T06:54:20.962 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T06:54:20.962 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:54:20.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T06:54:20.977 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T06:54:20.977 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T06:54:20.991 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T06:54:20.991 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T06:54:20.992 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T06:54:20.993 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T06:54:20.997 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T06:54:20.997 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:54:20.997 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T06:54:21.030 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T06:54:21.031 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T06:54:21.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T06:54:21.060 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T06:54:21.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T06:54:21.102 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T06:54:21.136 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T06:54:21.138 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T06:54:21.139 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T06:54:21.166 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-10-08T06:54:21.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-10-08T06:54:21.182 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T06:54:21.207 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2023-10-08T06:54:21.207 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2023-10-08T06:54:21.207 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2023-10-08T06:54:21.208 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2023-10-08T06:54:21.250 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2023-10-08T06:54:21.252 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2023-10-08T06:54:21.565 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:21.579 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:21.579 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:21.626 INFO:teuthology.orchestra.run.smithi169.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:21.854 INFO:teuthology.orchestra.run.smithi163.stdout:44 files removed 2023-10-08T06:54:21.862 INFO:teuthology.orchestra.run.smithi183.stdout:44 files removed 2023-10-08T06:54:21.865 INFO:teuthology.orchestra.run.smithi037.stdout:44 files removed 2023-10-08T06:54:21.870 INFO:teuthology.orchestra.run.smithi169.stdout:44 files removed 2023-10-08T06:54:21.901 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T06:54:21.909 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T06:54:21.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T06:54:21.918 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T06:54:22.235 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:22.238 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:22.249 INFO:teuthology.orchestra.run.smithi169.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-08T06:54:22.900 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 311 kB/s | 81 kB 00:00 2023-10-08T06:54:23.052 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 235 kB/s | 81 kB 00:00 2023-10-08T06:54:23.057 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 190 kB/s | 81 kB 00:00 2023-10-08T06:54:23.081 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 201 kB/s | 81 kB 00:00 2023-10-08T06:54:23.259 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-08T06:54:23.324 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-10-08T06:54:23.340 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-10-08T06:54:23.345 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-10-08T06:54:23.576 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-10-08T06:54:23.662 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2023-10-08T06:54:23.667 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-10-08T06:54:23.716 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-10-08T06:54:23.744 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-08T06:54:23.797 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-10-08T06:54:23.801 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-10-08T06:54:23.880 INFO:teuthology.orchestra.run.smithi169.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-08T06:54:24.364 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2023-10-08T06:54:24.828 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-08T06:54:26.150 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 16 MB 00:02 2023-10-08T06:54:26.922 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 16 MB 00:02 2023-10-08T06:54:27.870 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 422 kB/s | 24 kB 00:00 2023-10-08T06:54:28.284 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 431 kB/s | 24 kB 00:00 2023-10-08T06:54:28.764 INFO:teuthology.orchestra.run.smithi183.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-10-08T06:54:29.252 INFO:teuthology.orchestra.run.smithi169.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-10-08T06:54:29.889 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 421 kB/s | 24 kB 00:00 2023-10-08T06:54:30.185 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 144 kB/s | 24 kB 00:00 2023-10-08T06:54:30.858 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-10-08T06:54:31.087 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-10-08T06:54:36.622 INFO:teuthology.orchestra.run.smithi183.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-10-08T06:54:37.378 INFO:teuthology.orchestra.run.smithi169.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-10-08T06:54:38.937 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-10-08T06:54:39.567 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-10-08T06:54:47.762 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:47.763 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:47.902 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-08T06:54:47.913 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================================================= 2023-10-08T06:54:47.913 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-08T06:54:47.913 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================================================= 2023-10-08T06:54:47.913 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T06:54:47.914 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T06:54:47.915 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:47.916 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T06:54:47.917 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T06:54:47.918 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T06:54:47.919 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T06:54:47.920 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:47.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T06:54:47.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T06:54:47.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T06:54:47.924 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T06:54:47.925 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T06:54:47.925 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:54:47.925 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-08T06:54:47.925 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================================================= 2023-10-08T06:54:47.925 INFO:teuthology.orchestra.run.smithi183.stdout:Install 120 Packages 2023-10-08T06:54:47.925 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 2 Packages 2023-10-08T06:54:47.925 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:54:47.926 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 200 M 2023-10-08T06:54:47.926 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-08T06:54:48.248 INFO:teuthology.orchestra.run.smithi183.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-10-08T06:54:48.270 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:48.271 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:48.409 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================================================= 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================================================= 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T06:54:48.421 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T06:54:48.422 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T06:54:48.423 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T06:54:48.424 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T06:54:48.425 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T06:54:48.426 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T06:54:48.427 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T06:54:48.428 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T06:54:48.429 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T06:54:48.430 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T06:54:48.430 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T06:54:48.430 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T06:54:48.430 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T06:54:48.430 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T06:54:48.430 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T06:54:48.431 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T06:54:48.432 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T06:54:48.433 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T06:54:48.434 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================================================= 2023-10-08T06:54:48.435 INFO:teuthology.orchestra.run.smithi169.stdout:Install 120 Packages 2023-10-08T06:54:48.436 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 2 Packages 2023-10-08T06:54:48.436 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:54:48.436 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 200 M 2023-10-08T06:54:48.436 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2023-10-08T06:54:48.448 INFO:teuthology.orchestra.run.smithi183.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 4.5 MB/s | 918 kB 00:00 2023-10-08T06:54:48.515 INFO:teuthology.orchestra.run.smithi183.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 2.5 MB/s | 167 kB 00:00 2023-10-08T06:54:48.695 INFO:teuthology.orchestra.run.smithi169.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-10-08T06:54:48.832 INFO:teuthology.orchestra.run.smithi183.stdout:(4/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 7.3 MB/s | 2.3 MB 00:00 2023-10-08T06:54:49.140 INFO:teuthology.orchestra.run.smithi183.stdout:(5/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 5.3 MB/s | 1.6 MB 00:00 2023-10-08T06:54:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:(6/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 4.3 MB/s | 5.4 MB 00:01 2023-10-08T06:54:49.501 INFO:teuthology.orchestra.run.smithi169.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 1.1 MB/s | 918 kB 00:00 2023-10-08T06:54:49.645 INFO:teuthology.orchestra.run.smithi169.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 1.1 MB/s | 167 kB 00:00 2023-10-08T06:54:49.865 INFO:teuthology.orchestra.run.smithi183.stdout:(7/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-10-08T06:54:50.083 INFO:teuthology.orchestra.run.smithi183.stdout:(8/122): ceph-common-18.0.0-6609.g9725b08f.el8. 11 MB/s | 23 MB 00:02 2023-10-08T06:54:50.121 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:50.122 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:50.158 INFO:teuthology.orchestra.run.smithi183.stdout:(9/122): ceph-selinux-18.0.0-6609.g9725b08f.el8 326 kB/s | 24 kB 00:00 2023-10-08T06:54:50.238 INFO:teuthology.orchestra.run.smithi169.stdout:(4/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 3.9 MB/s | 2.3 MB 00:00 2023-10-08T06:54:50.260 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-10-08T06:54:50.271 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================================================= 2023-10-08T06:54:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2023-10-08T06:54:50.271 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================================================= 2023-10-08T06:54:50.271 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2023-10-08T06:54:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T06:54:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T06:54:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2023-10-08T06:54:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T06:54:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T06:54:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T06:54:50.277 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T06:54:50.278 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T06:54:50.279 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T06:54:50.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T06:54:50.281 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:50.282 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T06:54:50.283 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================================================= 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout:Install 120 Packages 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 2 Packages 2023-10-08T06:54:50.284 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:54:50.285 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 200 M 2023-10-08T06:54:50.285 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2023-10-08T06:54:50.762 INFO:teuthology.orchestra.run.smithi163.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-08T06:54:50.921 INFO:teuthology.orchestra.run.smithi169.stdout:(5/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 2.4 MB/s | 1.6 MB 00:00 2023-10-08T06:54:51.324 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:51.325 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T06:54:51.479 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-10-08T06:54:51.492 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================================= 2023-10-08T06:54:51.492 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-10-08T06:54:51.492 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================================= 2023-10-08T06:54:51.492 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-10-08T06:54:51.492 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T06:54:51.493 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T06:54:51.493 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T06:54:51.493 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T06:54:51.493 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T06:54:51.493 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T06:54:51.494 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T06:54:51.494 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T06:54:51.494 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T06:54:51.494 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T06:54:51.494 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T06:54:51.495 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T06:54:51.495 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T06:54:51.495 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T06:54:51.495 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T06:54:51.495 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T06:54:51.496 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T06:54:51.496 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T06:54:51.496 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T06:54:51.496 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T06:54:51.496 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T06:54:51.496 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T06:54:51.497 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T06:54:51.497 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T06:54:51.497 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T06:54:51.497 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T06:54:51.497 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T06:54:51.498 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T06:54:51.498 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T06:54:51.498 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T06:54:51.498 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T06:54:51.498 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-10-08T06:54:51.499 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:51.499 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T06:54:51.499 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-10-08T06:54:51.499 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T06:54:51.499 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T06:54:51.499 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T06:54:51.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T06:54:51.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T06:54:51.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T06:54:51.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T06:54:51.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T06:54:51.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T06:54:51.501 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T06:54:51.501 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T06:54:51.501 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T06:54:51.501 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T06:54:51.501 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T06:54:51.502 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T06:54:51.503 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T06:54:51.503 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T06:54:51.503 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T06:54:51.503 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T06:54:51.503 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T06:54:51.503 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T06:54:51.503 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T06:54:51.504 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T06:54:51.504 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T06:54:51.504 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T06:54:51.504 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T06:54:51.504 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T06:54:51.504 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T06:54:51.504 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T06:54:51.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T06:54:51.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T06:54:51.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T06:54:51.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T06:54:51.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T06:54:51.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T06:54:51.506 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T06:54:51.506 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T06:54:51.506 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T06:54:51.506 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T06:54:51.506 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T06:54:51.506 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T06:54:51.506 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T06:54:51.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T06:54:51.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T06:54:51.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T06:54:51.510 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T06:54:51.511 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T06:54:51.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:54:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-10-08T06:54:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================================= 2023-10-08T06:54:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:Install 120 Packages 2023-10-08T06:54:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2023-10-08T06:54:51.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:54:51.512 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 200 M 2023-10-08T06:54:51.512 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-10-08T06:54:51.714 INFO:teuthology.orchestra.run.smithi163.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 965 kB/s | 918 kB 00:00 2023-10-08T06:54:51.904 INFO:teuthology.orchestra.run.smithi163.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 881 kB/s | 167 kB 00:00 2023-10-08T06:54:51.992 INFO:teuthology.orchestra.run.smithi037.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-08T06:54:52.191 INFO:teuthology.orchestra.run.smithi183.stdout:(10/122): ceph-radosgw-18.0.0-6609.g9725b08f.el 6.0 MB/s | 14 MB 00:02 2023-10-08T06:54:52.274 INFO:teuthology.orchestra.run.smithi183.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 373 kB/s | 31 kB 00:00 2023-10-08T06:54:52.550 INFO:teuthology.orchestra.run.smithi183.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 3.0 MB/s | 839 kB 00:00 2023-10-08T06:54:52.571 INFO:teuthology.orchestra.run.smithi163.stdout:(4/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 2.5 MB/s | 5.4 MB 00:02 2023-10-08T06:54:52.625 INFO:teuthology.orchestra.run.smithi183.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 2.4 MB/s | 183 kB 00:00 2023-10-08T06:54:52.709 INFO:teuthology.orchestra.run.smithi183.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 1.6 MB/s | 139 kB 00:00 2023-10-08T06:54:52.876 INFO:teuthology.orchestra.run.smithi183.stdout:(15/122): libradosstriper1-18.0.0-6609.g9725b08 3.0 MB/s | 518 kB 00:00 2023-10-08T06:54:53.018 INFO:teuthology.orchestra.run.smithi037.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 896 kB/s | 918 kB 00:01 2023-10-08T06:54:53.226 INFO:teuthology.orchestra.run.smithi037.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 803 kB/s | 167 kB 00:00 2023-10-08T06:54:53.261 INFO:teuthology.orchestra.run.smithi169.stdout:(6/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x86 2.0 MB/s | 4.6 MB 00:02 2023-10-08T06:54:53.546 INFO:teuthology.orchestra.run.smithi163.stdout:(5/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 1.7 MB/s | 1.6 MB 00:00 2023-10-08T06:54:53.713 INFO:teuthology.orchestra.run.smithi163.stdout:(6/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-10-08T06:54:53.901 INFO:teuthology.orchestra.run.smithi183.stdout:(16/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x8 3.9 MB/s | 18 MB 00:04 2023-10-08T06:54:54.026 INFO:teuthology.orchestra.run.smithi183.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 358 kB/s | 45 kB 00:00 2023-10-08T06:54:54.346 INFO:teuthology.orchestra.run.smithi169.stdout:(7/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 943 kB/s | 5.4 MB 00:05 2023-10-08T06:54:54.660 INFO:teuthology.orchestra.run.smithi183.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 198 kB/s | 125 kB 00:00 2023-10-08T06:54:54.852 INFO:teuthology.orchestra.run.smithi183.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 1.0 MB/s | 197 kB 00:00 2023-10-08T06:54:55.019 INFO:teuthology.orchestra.run.smithi183.stdout:(20/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 3.2 MB/s | 6.9 MB 00:02 2023-10-08T06:54:55.127 INFO:teuthology.orchestra.run.smithi183.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 3.3 MB/s | 364 kB 00:00 2023-10-08T06:54:55.186 INFO:teuthology.orchestra.run.smithi183.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 1.8 MB/s | 107 kB 00:00 2023-10-08T06:54:55.210 INFO:teuthology.orchestra.run.smithi037.stdout:(4/122): ceph-common-18.0.0-6609.g9725b08f.el8. 6.3 MB/s | 23 MB 00:03 2023-10-08T06:54:55.219 INFO:teuthology.orchestra.run.smithi183.stdout:(23/122): python3-rados-18.0.0-6609.g9725b08f.e 1.0 MB/s | 371 kB 00:00 2023-10-08T06:54:55.236 INFO:teuthology.orchestra.run.smithi183.stdout:(24/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-08T06:54:55.294 INFO:teuthology.orchestra.run.smithi037.stdout:(5/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 1.1 MB/s | 2.3 MB 00:02 2023-10-08T06:54:55.312 INFO:teuthology.orchestra.run.smithi183.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 2.3 MB/s | 179 kB 00:00 2023-10-08T06:54:55.403 INFO:teuthology.orchestra.run.smithi183.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 252 kB/s | 23 kB 00:00 2023-10-08T06:54:55.469 INFO:teuthology.orchestra.run.smithi037.stdout:(6/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 6.3 MB/s | 1.6 MB 00:00 2023-10-08T06:54:55.479 INFO:teuthology.orchestra.run.smithi183.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 1.7 MB/s | 132 kB 00:00 2023-10-08T06:54:55.838 INFO:teuthology.orchestra.run.smithi163.stdout:(7/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x86 2.0 MB/s | 4.6 MB 00:02 2023-10-08T06:54:56.104 INFO:teuthology.orchestra.run.smithi183.stdout:(28/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 2.8 MB/s | 1.8 MB 00:00 2023-10-08T06:54:56.611 INFO:teuthology.orchestra.run.smithi037.stdout:(7/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 1.1 MB/s | 5.4 MB 00:04 2023-10-08T06:54:57.461 INFO:teuthology.orchestra.run.smithi037.stdout:(8/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x86 9.0 MB/s | 18 MB 00:01 2023-10-08T06:54:57.545 INFO:teuthology.orchestra.run.smithi037.stdout:(9/122): ceph-selinux-18.0.0-6609.g9725b08f.el8 293 kB/s | 24 kB 00:00 2023-10-08T06:54:58.113 INFO:teuthology.orchestra.run.smithi183.stdout:(29/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 1.2 MB/s | 3.6 MB 00:02 2023-10-08T06:54:58.221 INFO:teuthology.orchestra.run.smithi183.stdout:(30/122): ceph-mgr-diskprediction-local-18.0.0- 3.5 MB/s | 7.4 MB 00:02 2023-10-08T06:54:58.288 INFO:teuthology.orchestra.run.smithi163.stdout:(8/122): ceph-common-18.0.0-6609.g9725b08f.el8. 2.9 MB/s | 23 MB 00:07 2023-10-08T06:54:58.372 INFO:teuthology.orchestra.run.smithi163.stdout:(9/122): ceph-selinux-18.0.0-6609.g9725b08f.el8 294 kB/s | 24 kB 00:00 2023-10-08T06:54:58.532 INFO:teuthology.orchestra.run.smithi183.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 153 kB/s | 47 kB 00:00 2023-10-08T06:54:58.564 INFO:teuthology.orchestra.run.smithi183.stdout:(32/122): ceph-mgr-modules-core-18.0.0-6609.g97 538 kB/s | 242 kB 00:00 2023-10-08T06:54:58.622 INFO:teuthology.orchestra.run.smithi183.stdout:(33/122): ceph-prometheus-alerts-18.0.0-6609.g9 162 kB/s | 15 kB 00:00 2023-10-08T06:54:58.814 INFO:teuthology.orchestra.run.smithi183.stdout:(34/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 991 kB/s | 190 kB 00:00 2023-10-08T06:54:58.848 INFO:teuthology.orchestra.run.smithi183.stdout:(35/122): ceph-volume-18.0.0-6609.g9725b08f.el8 921 kB/s | 261 kB 00:00 2023-10-08T06:54:59.091 INFO:teuthology.orchestra.run.smithi037.stdout:(10/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x8 1.2 MB/s | 4.6 MB 00:03 2023-10-08T06:54:59.195 INFO:teuthology.orchestra.run.smithi037.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 301 kB/s | 31 kB 00:00 2023-10-08T06:54:59.206 INFO:teuthology.orchestra.run.smithi183.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 164 kB/s | 59 kB 00:00 2023-10-08T06:54:59.332 INFO:teuthology.orchestra.run.smithi183.stdout:(37/122): gperftools-libs-2.7-9.el8.x86_64.rpm 592 kB/s | 306 kB 00:00 2023-10-08T06:54:59.399 INFO:teuthology.orchestra.run.smithi183.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2023-10-08T06:54:59.507 INFO:teuthology.orchestra.run.smithi183.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-10-08T06:54:59.532 INFO:teuthology.orchestra.run.smithi183.stdout:(40/122): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-10-08T06:54:59.641 INFO:teuthology.orchestra.run.smithi183.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2023-10-08T06:54:59.691 INFO:teuthology.orchestra.run.smithi183.stdout:(42/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-10-08T06:54:59.750 INFO:teuthology.orchestra.run.smithi183.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-08T06:54:59.801 INFO:teuthology.orchestra.run.smithi183.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-08T06:54:59.859 INFO:teuthology.orchestra.run.smithi183.stdout:(45/122): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-10-08T06:54:59.878 INFO:teuthology.orchestra.run.smithi037.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 1.2 MB/s | 839 kB 00:00 2023-10-08T06:54:59.901 INFO:teuthology.orchestra.run.smithi183.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 813 kB/s | 81 kB 00:00 2023-10-08T06:54:59.968 INFO:teuthology.orchestra.run.smithi183.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-10-08T06:55:00.010 INFO:teuthology.orchestra.run.smithi183.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-10-08T06:55:00.119 INFO:teuthology.orchestra.run.smithi183.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 451 kB/s | 49 kB 00:00 2023-10-08T06:55:00.227 INFO:teuthology.orchestra.run.smithi183.stdout:(50/122): python3-more-itertools-7.2.0-3.el8.no 541 kB/s | 59 kB 00:00 2023-10-08T06:55:00.235 INFO:teuthology.orchestra.run.smithi037.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 514 kB/s | 183 kB 00:00 2023-10-08T06:55:00.261 INFO:teuthology.orchestra.run.smithi183.stdout:(51/122): python3-kubernetes-11.0.0-6.el8.noarc 4.0 MB/s | 1.2 MB 00:00 2023-10-08T06:55:00.327 INFO:teuthology.orchestra.run.smithi183.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 602 kB/s | 60 kB 00:00 2023-10-08T06:55:00.370 INFO:teuthology.orchestra.run.smithi183.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-10-08T06:55:00.428 INFO:teuthology.orchestra.run.smithi183.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-10-08T06:55:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 719 kB/s | 139 kB 00:00 2023-10-08T06:55:00.470 INFO:teuthology.orchestra.run.smithi183.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-10-08T06:55:00.537 INFO:teuthology.orchestra.run.smithi183.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-08T06:55:00.579 INFO:teuthology.orchestra.run.smithi183.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 591 kB/s | 64 kB 00:00 2023-10-08T06:55:00.670 INFO:teuthology.orchestra.run.smithi183.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 141 kB/s | 19 kB 00:00 2023-10-08T06:55:00.688 INFO:teuthology.orchestra.run.smithi183.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2023-10-08T06:55:00.763 INFO:teuthology.orchestra.run.smithi183.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 313 kB/s | 29 kB 00:00 2023-10-08T06:55:00.789 INFO:teuthology.orchestra.run.smithi183.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-08T06:55:00.873 INFO:teuthology.orchestra.run.smithi183.stdout:(62/122): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-10-08T06:55:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:(15/122): libradosstriper1-18.0.0-6609.g9725b08 1.1 MB/s | 518 kB 00:00 2023-10-08T06:55:00.898 INFO:teuthology.orchestra.run.smithi183.stdout:(63/122): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-08T06:55:00.981 INFO:teuthology.orchestra.run.smithi183.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 565 kB/s | 61 kB 00:00 2023-10-08T06:55:01.007 INFO:teuthology.orchestra.run.smithi183.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 787 kB/s | 85 kB 00:00 2023-10-08T06:55:01.090 INFO:teuthology.orchestra.run.smithi183.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-10-08T06:55:01.115 INFO:teuthology.orchestra.run.smithi183.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-10-08T06:55:01.408 INFO:teuthology.orchestra.run.smithi183.stdout:(68/122): python3-scipy-1.0.0-21.module+el8.5.0 47 MB/s | 14 MB 00:00 2023-10-08T06:55:01.449 INFO:teuthology.orchestra.run.smithi183.stdout:(69/122): thrift-0.13.0-2.el8.x86_64.rpm 3.9 MB/s | 1.7 MB 00:00 2023-10-08T06:55:01.474 INFO:teuthology.orchestra.run.smithi183.stdout:(70/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-08T06:55:01.525 INFO:teuthology.orchestra.run.smithi183.stdout:(71/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.7 MB/s | 259 kB 00:00 2023-10-08T06:55:01.550 INFO:teuthology.orchestra.run.smithi183.stdout:(72/122): python3-pytz-2017.2-9.el8.noarch.rpm 538 kB/s | 54 kB 00:00 2023-10-08T06:55:01.575 INFO:teuthology.orchestra.run.smithi183.stdout:(73/122): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-08T06:55:01.600 INFO:teuthology.orchestra.run.smithi183.stdout:(74/122): python3-markupsafe-0.23-19.el8.x86_64 773 kB/s | 39 kB 00:00 2023-10-08T06:55:01.634 INFO:teuthology.orchestra.run.smithi183.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-08T06:55:01.676 INFO:teuthology.orchestra.run.smithi183.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-10-08T06:55:01.701 INFO:teuthology.orchestra.run.smithi183.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-08T06:55:01.727 INFO:teuthology.orchestra.run.smithi183.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-08T06:55:01.760 INFO:teuthology.orchestra.run.smithi183.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-08T06:55:01.802 INFO:teuthology.orchestra.run.smithi183.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 635 kB/s | 27 kB 00:00 2023-10-08T06:55:01.813 INFO:teuthology.orchestra.run.smithi169.stdout:(8/122): ceph-common-18.0.0-6609.g9725b08f.el8. 1.7 MB/s | 23 MB 00:13 2023-10-08T06:55:01.844 INFO:teuthology.orchestra.run.smithi183.stdout:(81/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-08T06:55:01.930 INFO:teuthology.orchestra.run.smithi183.stdout:(82/122): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-10-08T06:55:01.962 INFO:teuthology.orchestra.run.smithi183.stdout:(83/122): python3-prettytable-0.7.2-14.el8.noar 375 kB/s | 44 kB 00:00 2023-10-08T06:55:02.020 INFO:teuthology.orchestra.run.smithi183.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 7.6 MB/s | 457 kB 00:00 2023-10-08T06:55:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:(9/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x86 2.0 MB/s | 18 MB 00:08 2023-10-08T06:55:02.055 INFO:teuthology.orchestra.run.smithi169.stdout:(10/122): ceph-selinux-18.0.0-6609.g9725b08f.el 101 kB/s | 24 kB 00:00 2023-10-08T06:55:02.080 INFO:teuthology.orchestra.run.smithi163.stdout:(10/122): ceph-radosgw-18.0.0-6609.g9725b08f.el 2.2 MB/s | 14 MB 00:06 2023-10-08T06:55:02.096 INFO:teuthology.orchestra.run.smithi183.stdout:(85/122): python3-numpy-1.14.3-10.el8.x86_64.rp 23 MB/s | 3.7 MB 00:00 2023-10-08T06:55:02.096 INFO:teuthology.orchestra.run.smithi169.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 749 kB/s | 31 kB 00:00 2023-10-08T06:55:02.121 INFO:teuthology.orchestra.run.smithi183.stdout:(86/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-10-08T06:55:02.121 INFO:teuthology.orchestra.run.smithi037.stdout:(16/122): ceph-test-18.0.0-6609.g9725b08f.el8.x 11 MB/s | 49 MB 00:04 2023-10-08T06:55:02.130 INFO:teuthology.orchestra.run.smithi163.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 626 kB/s | 31 kB 00:00 2023-10-08T06:55:02.146 INFO:teuthology.orchestra.run.smithi183.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-08T06:55:02.171 INFO:teuthology.orchestra.run.smithi183.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-10-08T06:55:02.188 INFO:teuthology.orchestra.run.smithi183.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-10-08T06:55:02.196 INFO:teuthology.orchestra.run.smithi037.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 598 kB/s | 45 kB 00:00 2023-10-08T06:55:02.230 INFO:teuthology.orchestra.run.smithi183.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-08T06:55:02.347 INFO:teuthology.orchestra.run.smithi183.stdout:(91/122): openblas-threads-0.3.15-3.el8.x86_64. 31 MB/s | 4.9 MB 00:00 2023-10-08T06:55:02.413 INFO:teuthology.orchestra.run.smithi037.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 580 kB/s | 125 kB 00:00 2023-10-08T06:55:02.414 INFO:teuthology.orchestra.run.smithi163.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 2.9 MB/s | 839 kB 00:00 2023-10-08T06:55:02.423 INFO:teuthology.orchestra.run.smithi183.stdout:(92/122): openblas-0.3.15-3.el8.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2023-10-08T06:55:02.448 INFO:teuthology.orchestra.run.smithi183.stdout:(93/122): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-10-08T06:55:02.472 INFO:teuthology.orchestra.run.smithi169.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 2.2 MB/s | 839 kB 00:00 2023-10-08T06:55:02.473 INFO:teuthology.orchestra.run.smithi183.stdout:(94/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-08T06:55:02.489 INFO:teuthology.orchestra.run.smithi037.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 2.6 MB/s | 197 kB 00:00 2023-10-08T06:55:02.506 INFO:teuthology.orchestra.run.smithi163.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 2.0 MB/s | 183 kB 00:00 2023-10-08T06:55:02.564 INFO:teuthology.orchestra.run.smithi037.stdout:(20/122): python3-rados-18.0.0-6609.g9725b08f.e 4.8 MB/s | 371 kB 00:00 2023-10-08T06:55:02.572 INFO:teuthology.orchestra.run.smithi169.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 1.8 MB/s | 183 kB 00:00 2023-10-08T06:55:02.606 INFO:teuthology.orchestra.run.smithi163.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 1.4 MB/s | 139 kB 00:00 2023-10-08T06:55:02.672 INFO:teuthology.orchestra.run.smithi169.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 1.4 MB/s | 139 kB 00:00 2023-10-08T06:55:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 1.9 MB/s | 364 kB 00:00 2023-10-08T06:55:02.789 INFO:teuthology.orchestra.run.smithi169.stdout:(15/122): libradosstriper1-18.0.0-6609.g9725b08 4.3 MB/s | 518 kB 00:00 2023-10-08T06:55:02.790 INFO:teuthology.orchestra.run.smithi163.stdout:(15/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x8 2.0 MB/s | 18 MB 00:09 2023-10-08T06:55:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 2.1 MB/s | 107 kB 00:00 2023-10-08T06:55:02.832 INFO:teuthology.orchestra.run.smithi163.stdout:(16/122): libradosstriper1-18.0.0-6609.g9725b08 2.2 MB/s | 518 kB 00:00 2023-10-08T06:55:02.865 INFO:teuthology.orchestra.run.smithi037.stdout:(23/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-08T06:55:02.882 INFO:teuthology.orchestra.run.smithi183.stdout:(95/122): ceph-test-18.0.0-6609.g9725b08f.el8.x 3.8 MB/s | 49 MB 00:12 2023-10-08T06:55:02.907 INFO:teuthology.orchestra.run.smithi163.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 598 kB/s | 45 kB 00:00 2023-10-08T06:55:02.915 INFO:teuthology.orchestra.run.smithi183.stdout:(96/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 100 kB/s | 47 kB 00:00 2023-10-08T06:55:02.941 INFO:teuthology.orchestra.run.smithi183.stdout:(97/122): libselinux-devel-2.9-5.el8.x86_64.rpm 428 kB/s | 200 kB 00:00 2023-10-08T06:55:02.966 INFO:teuthology.orchestra.run.smithi183.stdout:(98/122): python3-jwt-1.6.1-2.el8.noarch.rpm 510 kB/s | 43 kB 00:00 2023-10-08T06:55:02.991 INFO:teuthology.orchestra.run.smithi183.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 960 kB/s | 48 kB 00:00 2023-10-08T06:55:03.007 INFO:teuthology.orchestra.run.smithi163.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 1.2 MB/s | 125 kB 00:00 2023-10-08T06:55:03.016 INFO:teuthology.orchestra.run.smithi183.stdout:(100/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-08T06:55:03.042 INFO:teuthology.orchestra.run.smithi183.stdout:(101/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-08T06:55:03.067 INFO:teuthology.orchestra.run.smithi183.stdout:(102/122): python3-requests-oauthlib-1.0.0-1.el 565 kB/s | 43 kB 00:00 2023-10-08T06:55:03.092 INFO:teuthology.orchestra.run.smithi183.stdout:(103/122): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-10-08T06:55:03.118 INFO:teuthology.orchestra.run.smithi183.stdout:(104/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-08T06:55:03.124 INFO:teuthology.orchestra.run.smithi163.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 1.6 MB/s | 197 kB 00:00 2023-10-08T06:55:03.143 INFO:teuthology.orchestra.run.smithi183.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 372 kB/s | 19 kB 00:00 2023-10-08T06:55:03.168 INFO:teuthology.orchestra.run.smithi183.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-08T06:55:03.225 INFO:teuthology.orchestra.run.smithi183.stdout:(107/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.5 MB/s | 560 kB 00:00 2023-10-08T06:55:03.252 INFO:teuthology.orchestra.run.smithi183.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 215 kB/s | 18 kB 00:00 2023-10-08T06:55:03.286 INFO:teuthology.orchestra.run.smithi183.stdout:(109/122): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-10-08T06:55:03.290 INFO:teuthology.orchestra.run.smithi037.stdout:(24/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 8.4 MB/s | 3.6 MB 00:00 2023-10-08T06:55:03.308 INFO:teuthology.orchestra.run.smithi163.stdout:(20/122): python3-rados-18.0.0-6609.g9725b08f.e 2.0 MB/s | 371 kB 00:00 2023-10-08T06:55:03.311 INFO:teuthology.orchestra.run.smithi183.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-08T06:55:03.344 INFO:teuthology.orchestra.run.smithi183.stdout:(111/122): pcre2-devel-10.32-2.el8.x86_64.rpm 4.9 MB/s | 605 kB 00:00 2023-10-08T06:55:03.366 INFO:teuthology.orchestra.run.smithi037.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 2.3 MB/s | 179 kB 00:00 2023-10-08T06:55:03.369 INFO:teuthology.orchestra.run.smithi183.stdout:(112/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-08T06:55:03.395 INFO:teuthology.orchestra.run.smithi183.stdout:(113/122): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-08T06:55:03.420 INFO:teuthology.orchestra.run.smithi183.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-08T06:55:03.446 INFO:teuthology.orchestra.run.smithi183.stdout:(115/122): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-08T06:55:03.458 INFO:teuthology.orchestra.run.smithi163.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 2.4 MB/s | 364 kB 00:00 2023-10-08T06:55:03.471 INFO:teuthology.orchestra.run.smithi183.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-08T06:55:03.496 INFO:teuthology.orchestra.run.smithi183.stdout:(117/122): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-10-08T06:55:03.516 INFO:teuthology.orchestra.run.smithi163.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 1.8 MB/s | 107 kB 00:00 2023-10-08T06:55:03.530 INFO:teuthology.orchestra.run.smithi183.stdout:(118/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-08T06:55:03.555 INFO:teuthology.orchestra.run.smithi183.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-10-08T06:55:03.583 INFO:teuthology.orchestra.run.smithi037.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 106 kB/s | 23 kB 00:00 2023-10-08T06:55:03.592 INFO:teuthology.orchestra.run.smithi163.stdout:(23/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-08T06:55:03.614 INFO:teuthology.orchestra.run.smithi183.stdout:(120/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 7.1 MB/s | 2.3 MB 00:00 2023-10-08T06:55:03.666 INFO:teuthology.orchestra.run.smithi037.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 1.5 MB/s | 132 kB 00:00 2023-10-08T06:55:04.000 INFO:teuthology.orchestra.run.smithi037.stdout:(28/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 5.3 MB/s | 1.8 MB 00:00 2023-10-08T06:55:04.023 INFO:teuthology.orchestra.run.smithi169.stdout:(16/122): ceph-radosgw-18.0.0-6609.g9725b08f.el 1.4 MB/s | 14 MB 00:09 2023-10-08T06:55:04.140 INFO:teuthology.orchestra.run.smithi169.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 384 kB/s | 45 kB 00:00 2023-10-08T06:55:04.357 INFO:teuthology.orchestra.run.smithi169.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 580 kB/s | 125 kB 00:00 2023-10-08T06:55:04.469 INFO:teuthology.orchestra.run.smithi163.stdout:(24/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 4.1 MB/s | 6.9 MB 00:01 2023-10-08T06:55:04.484 INFO:teuthology.orchestra.run.smithi037.stdout:(29/122): ceph-radosgw-18.0.0-6609.g9725b08f.el 1.8 MB/s | 14 MB 00:07 2023-10-08T06:55:04.549 INFO:teuthology.orchestra.run.smithi169.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 1.0 MB/s | 197 kB 00:00 2023-10-08T06:55:04.559 INFO:teuthology.orchestra.run.smithi163.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-08T06:55:04.647 INFO:teuthology.orchestra.run.smithi183.stdout:(121/122): librados2-18.0.0-6609.g9725b08f.el8. 3.4 MB/s | 3.7 MB 00:01 2023-10-08T06:55:04.659 INFO:teuthology.orchestra.run.smithi163.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 230 kB/s | 23 kB 00:00 2023-10-08T06:55:04.701 INFO:teuthology.orchestra.run.smithi037.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6609.g97 1.1 MB/s | 242 kB 00:00 2023-10-08T06:55:04.752 INFO:teuthology.orchestra.run.smithi163.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 1.4 MB/s | 132 kB 00:00 2023-10-08T06:55:04.784 INFO:teuthology.orchestra.run.smithi037.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 570 kB/s | 47 kB 00:00 2023-10-08T06:55:04.841 INFO:teuthology.orchestra.run.smithi169.stdout:(20/122): python3-rados-18.0.0-6609.g9725b08f.e 1.2 MB/s | 371 kB 00:00 2023-10-08T06:55:04.926 INFO:teuthology.orchestra.run.smithi037.stdout:(32/122): ceph-mgr-diskprediction-local-18.0.0- 8.0 MB/s | 7.4 MB 00:00 2023-10-08T06:55:04.951 INFO:teuthology.orchestra.run.smithi037.stdout:(33/122): ceph-prometheus-alerts-18.0.0-6609.g9 87 kB/s | 15 kB 00:00 2023-10-08T06:55:05.035 INFO:teuthology.orchestra.run.smithi037.stdout:(34/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 1.7 MB/s | 6.9 MB 00:04 2023-10-08T06:55:05.061 INFO:teuthology.orchestra.run.smithi037.stdout:(35/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 1.7 MB/s | 190 kB 00:00 2023-10-08T06:55:05.074 INFO:teuthology.orchestra.run.smithi169.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 1.5 MB/s | 364 kB 00:00 2023-10-08T06:55:05.085 INFO:teuthology.orchestra.run.smithi163.stdout:(28/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 5.3 MB/s | 1.8 MB 00:00 2023-10-08T06:55:05.111 INFO:teuthology.orchestra.run.smithi037.stdout:(36/122): ceph-volume-18.0.0-6609.g9725b08f.el8 1.4 MB/s | 261 kB 00:00 2023-10-08T06:55:05.142 INFO:teuthology.orchestra.run.smithi169.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 1.6 MB/s | 107 kB 00:00 2023-10-08T06:55:05.169 INFO:teuthology.orchestra.run.smithi163.stdout:(29/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 2.3 MB/s | 3.6 MB 00:01 2023-10-08T06:55:05.208 INFO:teuthology.orchestra.run.smithi169.stdout:(23/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 1.4 MB/s | 94 kB 00:00 2023-10-08T06:55:05.302 INFO:teuthology.orchestra.run.smithi163.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6609.g97 1.8 MB/s | 242 kB 00:00 2023-10-08T06:55:05.319 INFO:teuthology.orchestra.run.smithi037.stdout:(37/122): liboath-2.6.2-3.el8.x86_64.rpm 228 kB/s | 59 kB 00:00 2023-10-08T06:55:05.344 INFO:teuthology.orchestra.run.smithi037.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 321 kB/s | 75 kB 00:00 2023-10-08T06:55:05.378 INFO:teuthology.orchestra.run.smithi163.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 634 kB/s | 47 kB 00:00 2023-10-08T06:55:05.403 INFO:teuthology.orchestra.run.smithi037.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 750 kB/s | 44 kB 00:00 2023-10-08T06:55:05.428 INFO:teuthology.orchestra.run.smithi037.stdout:(40/122): gperftools-libs-2.7-9.el8.x86_64.rpm 780 kB/s | 306 kB 00:00 2023-10-08T06:55:05.444 INFO:teuthology.orchestra.run.smithi163.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6609.g9 218 kB/s | 15 kB 00:00 2023-10-08T06:55:05.467 INFO:teuthology.orchestra.run.smithi169.stdout:(24/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 2.6 MB/s | 6.9 MB 00:02 2023-10-08T06:55:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 440 kB/s | 33 kB 00:00 2023-10-08T06:55:05.529 INFO:teuthology.orchestra.run.smithi037.stdout:(42/122): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-10-08T06:55:05.554 INFO:teuthology.orchestra.run.smithi037.stdout:(43/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-08T06:55:05.571 INFO:teuthology.orchestra.run.smithi037.stdout:(44/122): python3-certifi-2018.10.15-7.el8.noar 243 kB/s | 16 kB 00:00 2023-10-08T06:55:05.578 INFO:teuthology.orchestra.run.smithi163.stdout:(33/122): ceph-volume-18.0.0-6609.g9725b08f.el8 1.9 MB/s | 261 kB 00:00 2023-10-08T06:55:05.584 INFO:teuthology.orchestra.run.smithi169.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 1.5 MB/s | 179 kB 00:00 2023-10-08T06:55:05.588 INFO:teuthology.orchestra.run.smithi037.stdout:(45/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-10-08T06:55:05.638 INFO:teuthology.orchestra.run.smithi037.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-08T06:55:05.642 INFO:teuthology.orchestra.run.smithi169.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 396 kB/s | 23 kB 00:00 2023-10-08T06:55:05.655 INFO:teuthology.orchestra.run.smithi037.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-10-08T06:55:05.681 INFO:teuthology.orchestra.run.smithi037.stdout:(48/122): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-08T06:55:05.695 INFO:teuthology.orchestra.run.smithi163.stdout:(34/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 1.6 MB/s | 190 kB 00:00 2023-10-08T06:55:05.701 INFO:teuthology.orchestra.run.smithi169.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 2.2 MB/s | 132 kB 00:00 2023-10-08T06:55:05.714 INFO:teuthology.orchestra.run.smithi037.stdout:(49/122): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-10-08T06:55:05.748 INFO:teuthology.orchestra.run.smithi037.stdout:(50/122): python3-logutils-0.3.5-11.el8.noarch. 728 kB/s | 49 kB 00:00 2023-10-08T06:55:05.779 INFO:teuthology.orchestra.run.smithi183.stdout:(122/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 1.7 MB/s | 3.7 MB 00:02 2023-10-08T06:55:05.782 INFO:teuthology.orchestra.run.smithi037.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 876 kB/s | 59 kB 00:00 2023-10-08T06:55:05.782 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-08T06:55:05.783 INFO:teuthology.orchestra.run.smithi183.stdout:Total 11 MB/s | 200 MB 00:17 2023-10-08T06:55:05.815 INFO:teuthology.orchestra.run.smithi037.stdout:(52/122): python3-kubernetes-11.0.0-6.el8.noarc 7.3 MB/s | 1.2 MB 00:00 2023-10-08T06:55:05.841 INFO:teuthology.orchestra.run.smithi037.stdout:(53/122): python3-natsort-7.1.1-2.el8.noarch.rp 652 kB/s | 60 kB 00:00 2023-10-08T06:55:05.882 INFO:teuthology.orchestra.run.smithi037.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-10-08T06:55:05.908 INFO:teuthology.orchestra.run.smithi037.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 502 kB/s | 34 kB 00:00 2023-10-08T06:55:05.914 INFO:teuthology.orchestra.run.smithi163.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-08T06:55:05.942 INFO:teuthology.orchestra.run.smithi037.stdout:(56/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-10-08T06:55:05.958 INFO:teuthology.orchestra.run.smithi037.stdout:(57/122): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-10-08T06:55:05.975 INFO:teuthology.orchestra.run.smithi037.stdout:(58/122): python3-rsa-4.9-2.el8.noarch.rpm 954 kB/s | 64 kB 00:00 2023-10-08T06:55:05.979 INFO:teuthology.orchestra.run.smithi163.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 911 kB/s | 59 kB 00:00 2023-10-08T06:55:06.009 INFO:teuthology.orchestra.run.smithi037.stdout:(59/122): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-10-08T06:55:06.034 INFO:teuthology.orchestra.run.smithi037.stdout:(60/122): python3-singledispatch-3.4.0.3-18.el8 316 kB/s | 24 kB 00:00 2023-10-08T06:55:06.060 INFO:teuthology.orchestra.run.smithi037.stdout:(61/122): python3-tempora-1.14.1-5.el8.noarch.r 349 kB/s | 29 kB 00:00 2023-10-08T06:55:06.071 INFO:teuthology.orchestra.run.smithi163.stdout:(37/122): ceph-mgr-diskprediction-local-18.0.0- 7.5 MB/s | 7.4 MB 00:00 2023-10-08T06:55:06.085 INFO:teuthology.orchestra.run.smithi037.stdout:(62/122): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2023-10-08T06:55:06.093 INFO:teuthology.orchestra.run.smithi169.stdout:(28/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 4.5 MB/s | 1.8 MB 00:00 2023-10-08T06:55:06.096 INFO:teuthology.orchestra.run.smithi163.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2023-10-08T06:55:06.135 INFO:teuthology.orchestra.run.smithi037.stdout:(63/122): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-08T06:55:06.155 INFO:teuthology.orchestra.run.smithi163.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 749 kB/s | 44 kB 00:00 2023-10-08T06:55:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 813 kB/s | 61 kB 00:00 2023-10-08T06:55:06.186 INFO:teuthology.orchestra.run.smithi037.stdout:(65/122): python3-webob-1.8.5-1.el8.1.noarch.rp 1.9 MB/s | 251 kB 00:00 2023-10-08T06:55:06.211 INFO:teuthology.orchestra.run.smithi037.stdout:(66/122): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-08T06:55:06.214 INFO:teuthology.orchestra.run.smithi163.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-10-08T06:55:06.236 INFO:teuthology.orchestra.run.smithi037.stdout:(67/122): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-10-08T06:55:06.262 INFO:teuthology.orchestra.run.smithi037.stdout:(68/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-08T06:55:06.264 INFO:teuthology.orchestra.run.smithi163.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 664 kB/s | 33 kB 00:00 2023-10-08T06:55:06.298 INFO:teuthology.orchestra.run.smithi163.stdout:(42/122): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-08T06:55:06.312 INFO:teuthology.orchestra.run.smithi037.stdout:(69/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-10-08T06:55:06.314 INFO:teuthology.orchestra.run.smithi163.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2023-10-08T06:55:06.337 INFO:teuthology.orchestra.run.smithi037.stdout:(70/122): libselinux-devel-2.9-5.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-10-08T06:55:06.357 INFO:teuthology.orchestra.run.smithi163.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-10-08T06:55:06.362 INFO:teuthology.orchestra.run.smithi037.stdout:(71/122): python3-jwt-1.6.1-2.el8.noarch.rpm 853 kB/s | 43 kB 00:00 2023-10-08T06:55:06.388 INFO:teuthology.orchestra.run.smithi037.stdout:(72/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-08T06:55:06.407 INFO:teuthology.orchestra.run.smithi163.stdout:(45/122): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-10-08T06:55:06.413 INFO:teuthology.orchestra.run.smithi037.stdout:(73/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2023-10-08T06:55:06.432 INFO:teuthology.orchestra.run.smithi163.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-10-08T06:55:06.438 INFO:teuthology.orchestra.run.smithi037.stdout:(74/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-08T06:55:06.449 INFO:teuthology.orchestra.run.smithi163.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2023-10-08T06:55:06.463 INFO:teuthology.orchestra.run.smithi037.stdout:(75/122): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-10-08T06:55:06.474 INFO:teuthology.orchestra.run.smithi163.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 420 kB/s | 18 kB 00:00 2023-10-08T06:55:06.505 INFO:teuthology.orchestra.run.smithi037.stdout:(76/122): thrift-0.13.0-2.el8.x86_64.rpm 5.4 MB/s | 1.7 MB 00:00 2023-10-08T06:55:06.508 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-08T06:55:06.525 INFO:teuthology.orchestra.run.smithi163.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 972 kB/s | 49 kB 00:00 2023-10-08T06:55:06.531 INFO:teuthology.orchestra.run.smithi037.stdout:(77/122): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2023-10-08T06:55:06.564 INFO:teuthology.orchestra.run.smithi037.stdout:(78/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-10-08T06:55:06.575 INFO:teuthology.orchestra.run.smithi163.stdout:(50/122): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2023-10-08T06:55:06.589 INFO:teuthology.orchestra.run.smithi037.stdout:(79/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 376 kB/s | 19 kB 00:00 2023-10-08T06:55:06.615 INFO:teuthology.orchestra.run.smithi037.stdout:(80/122): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-08T06:55:06.620 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-08T06:55:06.620 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-08T06:55:06.625 INFO:teuthology.orchestra.run.smithi163.stdout:(51/122): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-08T06:55:06.657 INFO:teuthology.orchestra.run.smithi037.stdout:(81/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-10-08T06:55:06.682 INFO:teuthology.orchestra.run.smithi037.stdout:(82/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 266 kB/s | 18 kB 00:00 2023-10-08T06:55:06.684 INFO:teuthology.orchestra.run.smithi163.stdout:(52/122): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2023-10-08T06:55:06.701 INFO:teuthology.orchestra.run.smithi169.stdout:(29/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 2.4 MB/s | 3.6 MB 00:01 2023-10-08T06:55:06.724 INFO:teuthology.orchestra.run.smithi037.stdout:(83/122): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-10-08T06:55:06.734 INFO:teuthology.orchestra.run.smithi163.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-10-08T06:55:06.760 INFO:teuthology.orchestra.run.smithi163.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-10-08T06:55:06.770 INFO:teuthology.orchestra.run.smithi037.stdout:(84/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.6 MB/s | 238 kB 00:00 2023-10-08T06:55:06.785 INFO:teuthology.orchestra.run.smithi163.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2023-10-08T06:55:06.808 INFO:teuthology.orchestra.run.smithi037.stdout:(85/122): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-10-08T06:55:06.833 INFO:teuthology.orchestra.run.smithi037.stdout:(86/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.1 MB/s | 72 kB 00:00 2023-10-08T06:55:06.843 INFO:teuthology.orchestra.run.smithi163.stdout:(56/122): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-08T06:55:06.859 INFO:teuthology.orchestra.run.smithi037.stdout:(87/122): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-08T06:55:06.860 INFO:teuthology.orchestra.run.smithi163.stdout:(57/122): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-10-08T06:55:06.884 INFO:teuthology.orchestra.run.smithi037.stdout:(88/122): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-08T06:55:06.894 INFO:teuthology.orchestra.run.smithi163.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-10-08T06:55:06.909 INFO:teuthology.orchestra.run.smithi037.stdout:(89/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-08T06:55:06.919 INFO:teuthology.orchestra.run.smithi163.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 410 kB/s | 24 kB 00:00 2023-10-08T06:55:06.934 INFO:teuthology.orchestra.run.smithi037.stdout:(90/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-08T06:55:06.945 INFO:teuthology.orchestra.run.smithi163.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2023-10-08T06:55:06.952 INFO:teuthology.orchestra.run.smithi169.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6609.g97 967 kB/s | 242 kB 00:00 2023-10-08T06:55:06.960 INFO:teuthology.orchestra.run.smithi037.stdout:(91/122): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-10-08T06:55:06.970 INFO:teuthology.orchestra.run.smithi163.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 548 kB/s | 27 kB 00:00 2023-10-08T06:55:07.002 INFO:teuthology.orchestra.run.smithi037.stdout:(92/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-10-08T06:55:07.019 INFO:teuthology.orchestra.run.smithi169.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 714 kB/s | 47 kB 00:00 2023-10-08T06:55:07.027 INFO:teuthology.orchestra.run.smithi037.stdout:(93/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-10-08T06:55:07.086 INFO:teuthology.orchestra.run.smithi037.stdout:(94/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2023-10-08T06:55:07.111 INFO:teuthology.orchestra.run.smithi037.stdout:(95/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-10-08T06:55:07.111 INFO:teuthology.orchestra.run.smithi169.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6609.g9 159 kB/s | 15 kB 00:00 2023-10-08T06:55:07.136 INFO:teuthology.orchestra.run.smithi037.stdout:(96/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-08T06:55:07.170 INFO:teuthology.orchestra.run.smithi037.stdout:(97/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-08T06:55:07.203 INFO:teuthology.orchestra.run.smithi169.stdout:(33/122): ceph-volume-18.0.0-6609.g9725b08f.el8 2.8 MB/s | 261 kB 00:00 2023-10-08T06:55:07.204 INFO:teuthology.orchestra.run.smithi037.stdout:(98/122): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-08T06:55:07.229 INFO:teuthology.orchestra.run.smithi037.stdout:(99/122): python3-markupsafe-0.23-19.el8.x86_64 663 kB/s | 39 kB 00:00 2023-10-08T06:55:07.279 INFO:teuthology.orchestra.run.smithi037.stdout:(100/122): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-10-08T06:55:07.295 INFO:teuthology.orchestra.run.smithi163.stdout:(62/122): python3-waitress-1.4.3-1.el8.noarch.r 729 kB/s | 255 kB 00:00 2023-10-08T06:55:07.312 INFO:teuthology.orchestra.run.smithi169.stdout:(34/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 1.7 MB/s | 190 kB 00:00 2023-10-08T06:55:07.312 INFO:teuthology.orchestra.run.smithi037.stdout:(101/122): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-10-08T06:55:07.329 INFO:teuthology.orchestra.run.smithi163.stdout:(63/122): python3-webob-1.8.5-1.el8.1.noarch.rp 700 kB/s | 251 kB 00:00 2023-10-08T06:55:07.338 INFO:teuthology.orchestra.run.smithi037.stdout:(102/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T06:55:07.354 INFO:teuthology.orchestra.run.smithi163.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-10-08T06:55:07.363 INFO:teuthology.orchestra.run.smithi037.stdout:(103/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-08T06:55:07.388 INFO:teuthology.orchestra.run.smithi163.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-10-08T06:55:07.413 INFO:teuthology.orchestra.run.smithi163.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 391 kB/s | 23 kB 00:00 2023-10-08T06:55:07.421 INFO:teuthology.orchestra.run.smithi037.stdout:(104/122): automake-1.16.1-7.el8.noarch.rpm 8.3 MB/s | 713 kB 00:00 2023-10-08T06:55:07.430 INFO:teuthology.orchestra.run.smithi163.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-08T06:55:07.464 INFO:teuthology.orchestra.run.smithi037.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 637 kB/s | 27 kB 00:00 2023-10-08T06:55:07.506 INFO:teuthology.orchestra.run.smithi037.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-08T06:55:07.539 INFO:teuthology.orchestra.run.smithi037.stdout:(107/122): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-10-08T06:55:07.562 INFO:teuthology.orchestra.run.smithi169.stdout:(35/122): ceph-mgr-diskprediction-local-18.0.0- 5.0 MB/s | 7.4 MB 00:01 2023-10-08T06:55:07.639 INFO:teuthology.orchestra.run.smithi037.stdout:(108/122): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-10-08T06:55:07.668 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-08T06:55:07.672 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-08T06:55:07.698 INFO:teuthology.orchestra.run.smithi037.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-08T06:55:07.704 INFO:teuthology.orchestra.run.smithi169.stdout:(36/122): gperftools-libs-2.7-9.el8.x86_64.rpm 782 kB/s | 306 kB 00:00 2023-10-08T06:55:07.739 INFO:teuthology.orchestra.run.smithi163.stdout:(68/122): python3-scipy-1.0.0-21.module+el8.5.0 44 MB/s | 14 MB 00:00 2023-10-08T06:55:07.749 INFO:teuthology.orchestra.run.smithi037.stdout:(110/122): python3-numpy-f2py-1.14.3-10.el8.x86 4.4 MB/s | 225 kB 00:00 2023-10-08T06:55:07.771 INFO:teuthology.orchestra.run.smithi169.stdout:(37/122): liboath-2.6.2-3.el8.x86_64.rpm 282 kB/s | 59 kB 00:00 2023-10-08T06:55:07.789 INFO:teuthology.orchestra.run.smithi163.stdout:(69/122): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2023-10-08T06:55:07.796 INFO:teuthology.orchestra.run.smithi169.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 818 kB/s | 75 kB 00:00 2023-10-08T06:55:07.807 INFO:teuthology.orchestra.run.smithi037.stdout:(111/122): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-10-08T06:55:07.814 INFO:teuthology.orchestra.run.smithi163.stdout:(70/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-10-08T06:55:07.832 INFO:teuthology.orchestra.run.smithi037.stdout:(112/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.5 MB/s | 126 kB 00:00 2023-10-08T06:55:07.856 INFO:teuthology.orchestra.run.smithi163.stdout:(71/122): python3-pytz-2017.2-9.el8.noarch.rpm 811 kB/s | 54 kB 00:00 2023-10-08T06:55:07.858 INFO:teuthology.orchestra.run.smithi037.stdout:(113/122): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-10-08T06:55:07.863 INFO:teuthology.orchestra.run.smithi169.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 655 kB/s | 44 kB 00:00 2023-10-08T06:55:07.881 INFO:teuthology.orchestra.run.smithi163.stdout:(72/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.1 MB/s | 259 kB 00:00 2023-10-08T06:55:07.883 INFO:teuthology.orchestra.run.smithi037.stdout:(114/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-08T06:55:07.907 INFO:teuthology.orchestra.run.smithi163.stdout:(73/122): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-08T06:55:07.916 INFO:teuthology.orchestra.run.smithi037.stdout:(115/122): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-08T06:55:07.932 INFO:teuthology.orchestra.run.smithi163.stdout:(74/122): python3-markupsafe-0.23-19.el8.x86_64 774 kB/s | 39 kB 00:00 2023-10-08T06:55:07.963 INFO:teuthology.orchestra.run.smithi169.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-10-08T06:55:07.965 INFO:teuthology.orchestra.run.smithi163.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-08T06:55:07.989 INFO:teuthology.orchestra.run.smithi169.stdout:(41/122): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-08T06:55:07.999 INFO:teuthology.orchestra.run.smithi163.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-10-08T06:55:08.024 INFO:teuthology.orchestra.run.smithi163.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T06:55:08.031 INFO:teuthology.orchestra.run.smithi169.stdout:(42/122): python3-cachetools-3.1.1-4.el8.noarch 493 kB/s | 33 kB 00:00 2023-10-08T06:55:08.050 INFO:teuthology.orchestra.run.smithi163.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-08T06:55:08.056 INFO:teuthology.orchestra.run.smithi169.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2023-10-08T06:55:08.100 INFO:teuthology.orchestra.run.smithi037.stdout:(116/122): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-10-08T06:55:08.106 INFO:teuthology.orchestra.run.smithi169.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-08T06:55:08.117 INFO:teuthology.orchestra.run.smithi163.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2023-10-08T06:55:08.132 INFO:teuthology.orchestra.run.smithi169.stdout:(45/122): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-10-08T06:55:08.142 INFO:teuthology.orchestra.run.smithi037.stdout:(117/122): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-08T06:55:08.159 INFO:teuthology.orchestra.run.smithi163.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 636 kB/s | 27 kB 00:00 2023-10-08T06:55:08.173 INFO:teuthology.orchestra.run.smithi169.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-08T06:55:08.184 INFO:teuthology.orchestra.run.smithi037.stdout:(118/122): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-08T06:55:08.199 INFO:teuthology.orchestra.run.smithi169.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-10-08T06:55:08.201 INFO:teuthology.orchestra.run.smithi163.stdout:(81/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-08T06:55:08.234 INFO:teuthology.orchestra.run.smithi163.stdout:(82/122): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-08T06:55:08.241 INFO:teuthology.orchestra.run.smithi169.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 263 kB/s | 18 kB 00:00 2023-10-08T06:55:08.259 INFO:teuthology.orchestra.run.smithi037.stdout:(119/122): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-10-08T06:55:08.308 INFO:teuthology.orchestra.run.smithi169.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 733 kB/s | 49 kB 00:00 2023-10-08T06:55:08.310 INFO:teuthology.orchestra.run.smithi163.stdout:(83/122): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-10-08T06:55:08.326 INFO:teuthology.orchestra.run.smithi037.stdout:(120/122): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-10-08T06:55:08.352 INFO:teuthology.orchestra.run.smithi163.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-08T06:55:08.372 INFO:teuthology.orchestra.run.smithi169.stdout:(50/122): python3-kubernetes-11.0.0-6.el8.noarc 6.7 MB/s | 1.2 MB 00:00 2023-10-08T06:55:08.394 INFO:teuthology.orchestra.run.smithi163.stdout:(85/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-08T06:55:08.400 INFO:teuthology.orchestra.run.smithi169.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 638 kB/s | 59 kB 00:00 2023-10-08T06:55:08.442 INFO:teuthology.orchestra.run.smithi169.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 874 kB/s | 60 kB 00:00 2023-10-08T06:55:08.461 INFO:teuthology.orchestra.run.smithi163.stdout:(86/122): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2023-10-08T06:55:08.475 INFO:teuthology.orchestra.run.smithi169.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-10-08T06:55:08.486 INFO:teuthology.orchestra.run.smithi163.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2023-10-08T06:55:08.501 INFO:teuthology.orchestra.run.smithi169.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 264 kB/s | 16 kB 00:00 2023-10-08T06:55:08.503 INFO:teuthology.orchestra.run.smithi163.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 477 kB/s | 20 kB 00:00 2023-10-08T06:55:08.520 INFO:teuthology.orchestra.run.smithi163.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 3.0 MB/s | 103 kB 00:00 2023-10-08T06:55:08.535 INFO:teuthology.orchestra.run.smithi169.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 571 kB/s | 34 kB 00:00 2023-10-08T06:55:08.553 INFO:teuthology.orchestra.run.smithi163.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-10-08T06:55:08.577 INFO:teuthology.orchestra.run.smithi169.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2023-10-08T06:55:08.602 INFO:teuthology.orchestra.run.smithi169.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 959 kB/s | 64 kB 00:00 2023-10-08T06:55:08.636 INFO:teuthology.orchestra.run.smithi169.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2023-10-08T06:55:08.661 INFO:teuthology.orchestra.run.smithi169.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 407 kB/s | 24 kB 00:00 2023-10-08T06:55:08.687 INFO:teuthology.orchestra.run.smithi163.stdout:(91/122): openblas-threads-0.3.15-3.el8.x86_64. 29 MB/s | 4.9 MB 00:00 2023-10-08T06:55:08.694 INFO:teuthology.orchestra.run.smithi169.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 501 kB/s | 29 kB 00:00 2023-10-08T06:55:08.753 INFO:teuthology.orchestra.run.smithi169.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 300 kB/s | 27 kB 00:00 2023-10-08T06:55:08.809 INFO:teuthology.orchestra.run.smithi169.stdout:(62/122): python3-waitress-1.4.3-1.el8.noarch.r 2.2 MB/s | 255 kB 00:00 2023-10-08T06:55:08.854 INFO:teuthology.orchestra.run.smithi169.stdout:(63/122): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-10-08T06:55:08.879 INFO:teuthology.orchestra.run.smithi169.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 877 kB/s | 61 kB 00:00 2023-10-08T06:55:08.921 INFO:teuthology.orchestra.run.smithi169.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-10-08T06:55:08.946 INFO:teuthology.orchestra.run.smithi169.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-10-08T06:55:08.972 INFO:teuthology.orchestra.run.smithi169.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T06:55:08.985 INFO:teuthology.orchestra.run.smithi037.stdout:(121/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 5.1 MB/s | 3.7 MB 00:00 2023-10-08T06:55:09.022 INFO:teuthology.orchestra.run.smithi169.stdout:(68/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 942 kB/s | 47 kB 00:00 2023-10-08T06:55:09.055 INFO:teuthology.orchestra.run.smithi169.stdout:(69/122): libselinux-devel-2.9-5.el8.x86_64.rpm 5.9 MB/s | 200 kB 00:00 2023-10-08T06:55:09.106 INFO:teuthology.orchestra.run.smithi169.stdout:(70/122): thrift-0.13.0-2.el8.x86_64.rpm 9.4 MB/s | 1.7 MB 00:00 2023-10-08T06:55:09.131 INFO:teuthology.orchestra.run.smithi169.stdout:(71/122): python3-jwt-1.6.1-2.el8.noarch.rpm 566 kB/s | 43 kB 00:00 2023-10-08T06:55:09.137 INFO:teuthology.orchestra.run.smithi163.stdout:(92/122): ceph-test-18.0.0-6609.g9725b08f.el8.x 4.5 MB/s | 49 MB 00:10 2023-10-08T06:55:09.181 INFO:teuthology.orchestra.run.smithi169.stdout:(72/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-10-08T06:55:09.193 INFO:teuthology.orchestra.run.smithi163.stdout:(93/122): jq-1.6-3.el8.x86_64.rpm 399 kB/s | 202 kB 00:00 2023-10-08T06:55:09.228 INFO:teuthology.orchestra.run.smithi169.stdout:(73/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-08T06:55:09.257 INFO:teuthology.orchestra.run.smithi169.stdout:(74/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-10-08T06:55:09.271 INFO:teuthology.orchestra.run.smithi163.stdout:(94/122): openblas-0.3.15-3.el8.x86_64.rpm 6.6 MB/s | 4.7 MB 00:00 2023-10-08T06:55:09.276 INFO:teuthology.orchestra.run.smithi037.stdout:(122/122): librados2-18.0.0-6609.g9725b08f.el8. 3.4 MB/s | 3.7 MB 00:01 2023-10-08T06:55:09.281 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-10-08T06:55:09.282 INFO:teuthology.orchestra.run.smithi037.stdout:Total 11 MB/s | 200 MB 00:17 2023-10-08T06:55:09.282 INFO:teuthology.orchestra.run.smithi169.stdout:(75/122): python3-requests-oauthlib-1.0.0-1.el8 793 kB/s | 43 kB 00:00 2023-10-08T06:55:09.296 INFO:teuthology.orchestra.run.smithi163.stdout:(95/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 483 kB/s | 47 kB 00:00 2023-10-08T06:55:09.308 INFO:teuthology.orchestra.run.smithi169.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-10-08T06:55:09.322 INFO:teuthology.orchestra.run.smithi163.stdout:(96/122): libselinux-devel-2.9-5.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-10-08T06:55:09.333 INFO:teuthology.orchestra.run.smithi169.stdout:(77/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-08T06:55:09.347 INFO:teuthology.orchestra.run.smithi163.stdout:(97/122): python3-jwt-1.6.1-2.el8.noarch.rpm 852 kB/s | 43 kB 00:00 2023-10-08T06:55:09.366 INFO:teuthology.orchestra.run.smithi169.stdout:(78/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-08T06:55:09.372 INFO:teuthology.orchestra.run.smithi163.stdout:(98/122): librdkafka-0.11.4-3.el8.x86_64.rpm 1.5 MB/s | 354 kB 00:00 2023-10-08T06:55:09.392 INFO:teuthology.orchestra.run.smithi169.stdout:(79/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2023-10-08T06:55:09.397 INFO:teuthology.orchestra.run.smithi163.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 955 kB/s | 48 kB 00:00 2023-10-08T06:55:09.417 INFO:teuthology.orchestra.run.smithi169.stdout:(80/122): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-08T06:55:09.423 INFO:teuthology.orchestra.run.smithi163.stdout:(100/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-08T06:55:09.448 INFO:teuthology.orchestra.run.smithi163.stdout:(101/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-10-08T06:55:09.459 INFO:teuthology.orchestra.run.smithi169.stdout:(81/122): python3-cryptography-3.2.1-5.el8.x86_ 8.2 MB/s | 559 kB 00:00 2023-10-08T06:55:09.474 INFO:teuthology.orchestra.run.smithi163.stdout:(102/122): python3-requests-oauthlib-1.0.0-1.el 565 kB/s | 43 kB 00:00 2023-10-08T06:55:09.490 INFO:teuthology.orchestra.run.smithi163.stdout:(103/122): python3-pycparser-2.14-14.el8.noarch 1.6 MB/s | 109 kB 00:00 2023-10-08T06:55:09.493 INFO:teuthology.orchestra.run.smithi169.stdout:(82/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 237 kB/s | 18 kB 00:00 2023-10-08T06:55:09.524 INFO:teuthology.orchestra.run.smithi163.stdout:(104/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-08T06:55:09.526 INFO:teuthology.orchestra.run.smithi169.stdout:(83/122): pcre2-devel-10.32-2.el8.x86_64.rpm 8.8 MB/s | 605 kB 00:00 2023-10-08T06:55:09.549 INFO:teuthology.orchestra.run.smithi163.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-10-08T06:55:09.552 INFO:teuthology.orchestra.run.smithi169.stdout:(84/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-08T06:55:09.575 INFO:teuthology.orchestra.run.smithi163.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-08T06:55:09.594 INFO:teuthology.orchestra.run.smithi169.stdout:(85/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-10-08T06:55:09.610 INFO:teuthology.orchestra.run.smithi163.stdout:(107/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-10-08T06:55:09.634 INFO:teuthology.orchestra.run.smithi163.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 306 kB/s | 18 kB 00:00 2023-10-08T06:55:09.667 INFO:teuthology.orchestra.run.smithi163.stdout:(109/122): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-10-08T06:55:09.669 INFO:teuthology.orchestra.run.smithi169.stdout:(86/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 16 MB/s | 2.3 MB 00:00 2023-10-08T06:55:09.686 INFO:teuthology.orchestra.run.smithi169.stdout:(87/122): fuse-2.9.7-15.el8.x86_64.rpm 903 kB/s | 83 kB 00:00 2023-10-08T06:55:09.692 INFO:teuthology.orchestra.run.smithi163.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-08T06:55:09.711 INFO:teuthology.orchestra.run.smithi169.stdout:(88/122): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-10-08T06:55:09.720 INFO:teuthology.orchestra.run.smithi163.stdout:(111/122): pcre2-devel-10.32-2.el8.x86_64.rpm 5.3 MB/s | 605 kB 00:00 2023-10-08T06:55:09.737 INFO:teuthology.orchestra.run.smithi169.stdout:(89/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-08T06:55:09.745 INFO:teuthology.orchestra.run.smithi163.stdout:(112/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-08T06:55:09.762 INFO:teuthology.orchestra.run.smithi169.stdout:(90/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-08T06:55:09.770 INFO:teuthology.orchestra.run.smithi163.stdout:(113/122): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-08T06:55:09.787 INFO:teuthology.orchestra.run.smithi169.stdout:(91/122): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-10-08T06:55:09.787 INFO:teuthology.orchestra.run.smithi163.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-08T06:55:09.812 INFO:teuthology.orchestra.run.smithi163.stdout:(115/122): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-10-08T06:55:09.821 INFO:teuthology.orchestra.run.smithi169.stdout:(92/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-08T06:55:09.829 INFO:teuthology.orchestra.run.smithi163.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-10-08T06:55:09.838 INFO:teuthology.orchestra.run.smithi169.stdout:(93/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 3.3 MB/s | 171 kB 00:00 2023-10-08T06:55:09.846 INFO:teuthology.orchestra.run.smithi163.stdout:(117/122): libcom_err-devel-1.45.6-4.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-10-08T06:55:09.871 INFO:teuthology.orchestra.run.smithi169.stdout:(94/122): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2023-10-08T06:55:09.880 INFO:teuthology.orchestra.run.smithi163.stdout:(118/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 13 MB/s | 644 kB 00:00 2023-10-08T06:55:09.896 INFO:teuthology.orchestra.run.smithi169.stdout:(95/122): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-10-08T06:55:09.913 INFO:teuthology.orchestra.run.smithi163.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-08T06:55:09.939 INFO:teuthology.orchestra.run.smithi169.stdout:(96/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-08T06:55:09.981 INFO:teuthology.orchestra.run.smithi163.stdout:(120/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 7.4 MB/s | 2.3 MB 00:00 2023-10-08T06:55:09.981 INFO:teuthology.orchestra.run.smithi169.stdout:(97/122): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-08T06:55:10.006 INFO:teuthology.orchestra.run.smithi169.stdout:(98/122): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-10-08T06:55:10.026 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-10-08T06:55:10.084 INFO:teuthology.orchestra.run.smithi169.stdout:(99/122): bison-3.0.4-10.el8.x86_64.rpm 8.7 MB/s | 688 kB 00:00 2023-10-08T06:55:10.140 INFO:teuthology.orchestra.run.smithi169.stdout:(100/122): python3-jinja2-2.10.1-3.el8.noarch.r 9.4 MB/s | 538 kB 00:00 2023-10-08T06:55:10.151 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-10-08T06:55:10.151 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-10-08T06:55:10.182 INFO:teuthology.orchestra.run.smithi169.stdout:(101/122): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-08T06:55:10.224 INFO:teuthology.orchestra.run.smithi169.stdout:(102/122): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-10-08T06:55:10.374 INFO:teuthology.orchestra.run.smithi169.stdout:(103/122): python3-scipy-1.0.0-21.module+el8.5. 25 MB/s | 14 MB 00:00 2023-10-08T06:55:10.397 INFO:teuthology.orchestra.run.smithi163.stdout:(121/122): librados2-18.0.0-6609.g9725b08f.el8. 7.2 MB/s | 3.7 MB 00:00 2023-10-08T06:55:10.416 INFO:teuthology.orchestra.run.smithi169.stdout:(104/122): automake-1.16.1-7.el8.noarch.rpm 3.6 MB/s | 713 kB 00:00 2023-10-08T06:55:10.450 INFO:teuthology.orchestra.run.smithi169.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 795 kB/s | 27 kB 00:00 2023-10-08T06:55:10.511 INFO:teuthology.orchestra.run.smithi169.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 5.1 MB/s | 320 kB 00:00 2023-10-08T06:55:10.873 INFO:teuthology.orchestra.run.smithi163.stdout:(122/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 3.9 MB/s | 3.7 MB 00:00 2023-10-08T06:55:10.875 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-10-08T06:55:10.876 INFO:teuthology.orchestra.run.smithi163.stdout:Total 9.7 MB/s | 200 MB 00:20 2023-10-08T06:55:10.967 INFO:teuthology.orchestra.run.smithi169.stdout:(107/122): ceph-test-18.0.0-6609.g9725b08f.el8. 5.5 MB/s | 49 MB 00:08 2023-10-08T06:55:10.992 INFO:teuthology.orchestra.run.smithi169.stdout:(108/122): python3-prettytable-0.7.2-14.el8.noa 91 kB/s | 44 kB 00:00 2023-10-08T06:55:11.059 INFO:teuthology.orchestra.run.smithi169.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 7.3 MB/s | 457 kB 00:00 2023-10-08T06:55:11.143 INFO:teuthology.orchestra.run.smithi169.stdout:(110/122): python3-babel-2.5.1-7.el8.noarch.rpm 6.2 MB/s | 4.8 MB 00:00 2023-10-08T06:55:11.168 INFO:teuthology.orchestra.run.smithi169.stdout:(111/122): python3-numpy-f2py-1.14.3-10.el8.x86 2.0 MB/s | 225 kB 00:00 2023-10-08T06:55:11.193 INFO:teuthology.orchestra.run.smithi169.stdout:(112/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-08T06:55:11.219 INFO:teuthology.orchestra.run.smithi169.stdout:(113/122): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-10-08T06:55:11.244 INFO:teuthology.orchestra.run.smithi169.stdout:(114/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-08T06:55:11.264 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-10-08T06:55:11.268 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-10-08T06:55:11.286 INFO:teuthology.orchestra.run.smithi169.stdout:(115/122): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-08T06:55:11.420 INFO:teuthology.orchestra.run.smithi169.stdout:(116/122): python3-numpy-1.14.3-10.el8.x86_64.r 8.3 MB/s | 3.7 MB 00:00 2023-10-08T06:55:11.453 INFO:teuthology.orchestra.run.smithi169.stdout:(117/122): jq-1.6-3.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2023-10-08T06:55:11.495 INFO:teuthology.orchestra.run.smithi169.stdout:(118/122): librdkafka-0.11.4-3.el8.x86_64.rpm 8.4 MB/s | 354 kB 00:00 2023-10-08T06:55:11.570 INFO:teuthology.orchestra.run.smithi169.stdout:(119/122): openblas-threads-0.3.15-3.el8.x86_64 15 MB/s | 4.9 MB 00:00 2023-10-08T06:55:11.587 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2023-10-08T06:55:11.646 INFO:teuthology.orchestra.run.smithi169.stdout:(120/122): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-10-08T06:55:11.698 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2023-10-08T06:55:11.699 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2023-10-08T06:55:11.946 INFO:teuthology.orchestra.run.smithi169.stdout:(121/122): librados2-18.0.0-6609.g9725b08f.el8. 8.3 MB/s | 3.7 MB 00:00 2023-10-08T06:55:12.419 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-08T06:55:12.607 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T06:55:12.754 INFO:teuthology.orchestra.run.smithi169.stdout:(122/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 3.1 MB/s | 3.7 MB 00:01 2023-10-08T06:55:12.757 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2023-10-08T06:55:12.757 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2023-10-08T06:55:12.757 INFO:teuthology.orchestra.run.smithi169.stdout:Total 8.2 MB/s | 200 MB 00:24 2023-10-08T06:55:12.760 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2023-10-08T06:55:12.788 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T06:55:12.982 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-10-08T06:55:13.151 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T06:55:13.286 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T06:55:13.467 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2023-10-08T06:55:13.484 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T06:55:13.579 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2023-10-08T06:55:13.579 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2023-10-08T06:55:13.892 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T06:55:14.143 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:14.553 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:14.633 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2023-10-08T06:55:14.636 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2023-10-08T06:55:15.017 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:15.137 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:15.334 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:55:15.436 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:55:15.658 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T06:55:15.862 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T06:55:16.083 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T06:55:16.208 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-10-08T06:55:16.284 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:16.392 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:16.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T06:55:16.592 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:16.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T06:55:16.676 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:16.778 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-10-08T06:55:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T06:55:16.905 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-10-08T06:55:16.967 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T06:55:17.109 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-10-08T06:55:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2023-10-08T06:55:17.471 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T06:55:17.565 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-10-08T06:55:17.640 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T06:55:17.726 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T06:55:17.786 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 5/124 2023-10-08T06:55:17.875 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T06:55:18.198 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-10-08T06:55:18.222 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 5/124 2023-10-08T06:55:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T06:55:18.445 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:18.458 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T06:55:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T06:55:18.586 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:18.658 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T06:55:18.698 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T06:55:18.778 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:18.875 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:19.084 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:55:19.111 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T06:55:19.314 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-10-08T06:55:19.315 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:19.358 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T06:55:19.517 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T06:55:19.626 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2023-10-08T06:55:19.640 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-10-08T06:55:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:19.753 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T06:55:19.824 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T06:55:19.850 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-10-08T06:55:19.889 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:19.919 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:19.991 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T06:55:20.011 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:20.036 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:20.062 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-10-08T06:55:20.126 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-10-08T06:55:20.211 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:20.247 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-10-08T06:55:20.248 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:55:20.270 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-10-08T06:55:20.344 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:55:20.394 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-10-08T06:55:20.559 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T06:55:20.601 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-10-08T06:55:20.697 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-10-08T06:55:20.767 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T06:55:20.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-10-08T06:55:20.858 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-10-08T06:55:20.909 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T06:55:20.963 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T06:55:20.993 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-10-08T06:55:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T06:55:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 5/124 2023-10-08T06:55:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:21.127 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-10-08T06:55:21.210 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T06:55:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:21.264 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-10-08T06:55:21.411 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-10-08T06:55:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 5/124 2023-10-08T06:55:21.639 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T06:55:21.692 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:21.778 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T06:55:21.825 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:55:21.949 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T06:55:22.001 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:22.052 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-10-08T06:55:22.082 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T06:55:22.100 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:55:22.261 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-10-08T06:55:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:55:22.404 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-10-08T06:55:22.479 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-10-08T06:55:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T06:55:22.659 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-10-08T06:55:22.670 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T06:55:22.706 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T06:55:22.883 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T06:55:22.896 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-10-08T06:55:22.938 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-10-08T06:55:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-10-08T06:55:23.116 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T06:55:23.234 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:23.303 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T06:55:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:55:23.501 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T06:55:23.647 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T06:55:23.812 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-10-08T06:55:23.824 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-10-08T06:55:23.956 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-10-08T06:55:24.126 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-10-08T06:55:24.129 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-10-08T06:55:24.225 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T06:55:24.233 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-10-08T06:55:24.323 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-10-08T06:55:24.354 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-10-08T06:55:24.476 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-10-08T06:55:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-10-08T06:55:24.550 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T06:55:24.726 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T06:55:24.731 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-10-08T06:55:24.858 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T06:55:24.881 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T06:55:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-10-08T06:55:25.080 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T06:55:25.119 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-10-08T06:55:25.136 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-10-08T06:55:25.216 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-10-08T06:55:25.252 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-10-08T06:55:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-10-08T06:55:25.359 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-10-08T06:55:25.426 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T06:55:25.540 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T06:55:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T06:55:25.728 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T06:55:25.812 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T06:55:25.857 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T06:55:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-10-08T06:55:25.994 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T06:55:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-10-08T06:55:26.183 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-10-08T06:55:26.367 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-10-08T06:55:26.526 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-10-08T06:55:26.668 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-10-08T06:55:26.724 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T06:55:26.861 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-10-08T06:55:26.886 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-10-08T06:55:27.035 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-10-08T06:55:27.051 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-10-08T06:55:27.142 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-10-08T06:55:27.173 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-10-08T06:55:27.307 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-10-08T06:55:27.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-10-08T06:55:27.423 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-10-08T06:55:27.568 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-10-08T06:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T06:55:27.731 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T06:55:27.751 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-10-08T06:55:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T06:55:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T06:55:27.942 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-10-08T06:55:28.088 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T06:55:28.160 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-10-08T06:55:28.258 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-10-08T06:55:28.276 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-10-08T06:55:28.369 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-10-08T06:55:28.592 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-10-08T06:55:28.654 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-10-08T06:55:28.892 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-10-08T06:55:28.898 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-10-08T06:55:29.096 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-10-08T06:55:29.131 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-10-08T06:55:29.328 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-10-08T06:55:29.366 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T06:55:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-10-08T06:55:29.515 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T06:55:29.556 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T06:55:29.676 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-10-08T06:55:29.775 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T06:55:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-10-08T06:55:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-10-08T06:55:29.984 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T06:55:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-10-08T06:55:30.040 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-10-08T06:55:30.225 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T06:55:30.245 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-10-08T06:55:30.286 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-10-08T06:55:30.426 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T06:55:30.486 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-10-08T06:55:30.520 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-10-08T06:55:30.608 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T06:55:30.696 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-10-08T06:55:30.773 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-10-08T06:55:30.773 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-10-08T06:55:30.863 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-10-08T06:55:30.935 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-10-08T06:55:30.957 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-10-08T06:55:31.000 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-10-08T06:55:31.031 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-10-08T06:55:31.048 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-10-08T06:55:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-10-08T06:55:31.252 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-10-08T06:55:31.282 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-10-08T06:55:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-10-08T06:55:31.378 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-10-08T06:55:31.465 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-10-08T06:55:31.503 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-10-08T06:55:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-10-08T06:55:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-10-08T06:55:31.651 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-10-08T06:55:31.664 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T06:55:31.703 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-10-08T06:55:31.736 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T06:55:31.813 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-10-08T06:55:31.883 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-10-08T06:55:31.952 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-10-08T06:55:32.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-10-08T06:55:32.058 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-10-08T06:55:32.061 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T06:55:32.123 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-10-08T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-10-08T06:55:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T06:55:32.272 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T06:55:32.378 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-10-08T06:55:32.416 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-10-08T06:55:32.429 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T06:55:32.458 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T06:55:32.604 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-10-08T06:55:32.605 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T06:55:32.639 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-10-08T06:55:32.739 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T06:55:32.740 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-10-08T06:55:32.841 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-10-08T06:55:32.857 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-10-08T06:55:32.971 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T06:55:32.987 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-10-08T06:55:33.033 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-10-08T06:55:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-10-08T06:55:33.118 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T06:55:33.266 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T06:55:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-10-08T06:55:33.302 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-10-08T06:55:33.313 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-10-08T06:55:33.466 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-10-08T06:55:33.471 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T06:55:33.507 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-10-08T06:55:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-10-08T06:55:33.542 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-10-08T06:55:33.666 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T06:55:33.705 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-10-08T06:55:33.750 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-10-08T06:55:33.769 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-10-08T06:55:33.849 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T06:55:33.916 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-10-08T06:55:33.953 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-10-08T06:55:33.984 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-10-08T06:55:34.025 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T06:55:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-10-08T06:55:34.122 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-10-08T06:55:34.145 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T06:55:34.298 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-10-08T06:55:34.299 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-10-08T06:55:34.317 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-10-08T06:55:34.341 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T06:55:34.501 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-10-08T06:55:34.535 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-10-08T06:55:34.558 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T06:55:34.592 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-10-08T06:55:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-10-08T06:55:34.721 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-10-08T06:55:34.744 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T06:55:34.840 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-10-08T06:55:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-10-08T06:55:34.926 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-10-08T06:55:34.981 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T06:55:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-10-08T06:55:35.074 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-10-08T06:55:35.125 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-10-08T06:55:35.179 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T06:55:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-10-08T06:55:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-10-08T06:55:35.386 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T06:55:35.432 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-10-08T06:55:35.494 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-10-08T06:55:35.586 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T06:55:35.611 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-10-08T06:55:35.636 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-10-08T06:55:35.767 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-10-08T06:55:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-10-08T06:55:35.890 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-10-08T06:55:35.993 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-10-08T06:55:36.074 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-10-08T06:55:36.135 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-10-08T06:55:36.228 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T06:55:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-10-08T06:55:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T06:55:36.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-10-08T06:55:36.453 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-10-08T06:55:36.517 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-10-08T06:55:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T06:55:36.664 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T06:55:36.696 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-10-08T06:55:36.723 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-10-08T06:55:36.739 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T06:55:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T06:55:36.908 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T06:55:36.981 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-10-08T06:55:37.006 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T06:55:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T06:55:37.137 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T06:55:37.166 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-10-08T06:55:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T06:55:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T06:55:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-10-08T06:55:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T06:55:37.420 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T06:55:37.518 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T06:55:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-10-08T06:55:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T06:55:37.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T06:55:37.715 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T06:55:37.726 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-10-08T06:55:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T06:55:37.830 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T06:55:37.956 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T06:55:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T06:55:37.991 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-10-08T06:55:38.019 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T06:55:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T06:55:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T06:55:38.245 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-10-08T06:55:38.362 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T06:55:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T06:55:38.445 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-10-08T06:55:38.499 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T06:55:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T06:55:38.642 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T06:55:38.683 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-10-08T06:55:38.752 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T06:55:38.768 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T06:55:38.831 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T06:55:38.849 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T06:55:38.963 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:38.997 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T06:55:39.018 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T06:55:39.021 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T06:55:39.182 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T06:55:39.230 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T06:55:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T06:55:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T06:55:39.446 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T06:55:39.515 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T06:55:39.539 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T06:55:39.675 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T06:55:39.694 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T06:55:39.719 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T06:55:39.818 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T06:55:39.868 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T06:55:39.910 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T06:55:40.003 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T06:55:40.050 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T06:55:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T06:55:40.286 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T06:55:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T06:55:40.593 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T06:55:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T06:55:40.978 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T06:55:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T06:55:41.187 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T06:55:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T06:55:41.395 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T06:55:41.414 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T06:55:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T06:55:41.653 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T06:55:41.660 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T06:55:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T06:55:41.847 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T06:55:41.934 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T06:55:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T06:55:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T06:55:42.217 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T06:55:42.246 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T06:55:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T06:55:42.404 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T06:55:42.540 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T06:55:42.933 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:43.163 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:43.199 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T06:55:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T06:55:43.352 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T06:55:43.430 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:43.602 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T06:55:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T06:55:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:43.767 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T06:55:43.872 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T06:55:44.049 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:44.130 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:44.206 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T06:55:44.312 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:55:44.515 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T06:55:44.677 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T06:55:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T06:55:45.614 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:45.674 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T06:55:45.889 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T06:55:47.378 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:47.585 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:47.717 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:47.933 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:48.188 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:48.560 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:48.572 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:48.701 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:55:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:48.942 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:49.074 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:55:49.671 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:49.855 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T06:55:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:50.895 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T06:55:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:56:02.878 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:56:02.879 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2023-10-08T06:56:02.879 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2023-10-08T06:56:02.879 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2023-10-08T06:56:02.879 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /run 2023-10-08T06:56:02.879 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2023-10-08T06:56:02.880 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2023-10-08T06:56:02.880 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2023-10-08T06:56:02.880 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2023-10-08T06:56:02.880 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2023-10-08T06:56:02.880 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:03.226 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:04.823 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:05.011 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:05.236 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:05.392 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:05.855 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:06.050 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:06.068 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:07.447 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /run 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-10-08T06:56:07.448 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:07.765 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:07.774 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:07.972 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:08.097 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T06:56:08.273 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T06:56:08.458 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:08.469 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-10-08T06:56:08.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:08.675 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:08.805 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:08.985 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:09.360 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:09.540 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:09.764 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:09.867 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T06:56:09.867 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2023-10-08T06:56:09.867 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2023-10-08T06:56:09.867 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /dev 2023-10-08T06:56:09.868 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /run 2023-10-08T06:56:09.868 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2023-10-08T06:56:09.868 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2023-10-08T06:56:09.868 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2023-10-08T06:56:09.868 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2023-10-08T06:56:09.868 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /dev 2023-10-08T06:56:09.868 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:09.945 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:10.099 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:10.189 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:10.235 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:10.382 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:10.499 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:10.535 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T06:56:10.548 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:10.565 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:10.656 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:10.895 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:10.915 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:10.927 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:11.030 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:11.521 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:11.697 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:11.714 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:11.836 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T06:56:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T06:56:12.234 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:12.261 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T06:56:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:12.434 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:12.498 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:12.533 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T06:56:12.682 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:12.739 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T06:56:12.855 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T06:56:12.925 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:13.035 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:13.041 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T06:56:13.147 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:13.207 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:13.414 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:13.460 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:13.777 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T06:56:13.972 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T06:56:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:14.374 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:14.390 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:14.730 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:14.869 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:14.998 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T06:56:15.045 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T06:56:15.187 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T06:56:15.206 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T06:56:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:15.749 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T06:56:15.751 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:15.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:16.041 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:16.084 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:16.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T06:56:16.605 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:16.642 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:16.762 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T06:56:16.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:16.816 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:17.048 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T06:56:17.172 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:17.200 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T06:56:17.531 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:17.659 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T06:56:17.681 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:17.845 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:17.875 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:17.911 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T06:56:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T06:56:18.120 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T06:56:18.219 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T06:56:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T06:56:18.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:18.613 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:18.754 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:18.919 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T06:56:19.137 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:19.226 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-10-08T06:56:19.391 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 114/124 2023-10-08T06:56:19.412 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T06:56:19.568 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-10-08T06:56:19.637 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:19.670 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T06:56:19.730 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T06:56:19.833 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:19.881 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T06:56:20.064 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T06:56:20.195 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T06:56:20.265 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T06:56:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:20.428 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-10-08T06:56:20.589 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T06:56:20.678 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T06:56:20.864 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T06:56:20.877 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T06:56:20.877 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:21.084 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:21.084 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:21.832 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:21.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T06:56:21.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:56:21.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T06:56:21.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T06:56:21.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T06:56:21.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T06:56:21.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T06:56:21.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T06:56:21.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T06:56:21.844 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T06:56:21.844 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T06:56:21.844 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T06:56:21.844 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T06:56:21.844 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T06:56:21.844 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T06:56:21.844 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T06:56:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T06:56:21.846 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T06:56:21.847 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T06:56:21.847 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T06:56:21.847 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T06:56:21.847 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T06:56:21.847 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T06:56:21.848 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T06:56:21.848 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T06:56:21.848 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T06:56:21.848 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T06:56:21.848 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-10-08T06:56:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-10-08T06:56:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-10-08T06:56:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-10-08T06:56:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-10-08T06:56:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-10-08T06:56:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-10-08T06:56:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-10-08T06:56:21.851 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-10-08T06:56:21.852 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T06:56:21.853 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T06:56:21.854 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T06:56:22.302 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T06:56:22.770 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T06:56:23.442 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T06:56:23.741 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-10-08T06:56:23.952 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 114/124 2023-10-08T06:56:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-10-08T06:56:24.316 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T06:56:24.364 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:24.416 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:24.416 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:48 ago on Sun 08 Oct 2023 06:54:36 AM UTC. 2023-10-08T06:56:24.463 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T06:56:24.637 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T06:56:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T06:56:24.990 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-10-08T06:56:25.043 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T06:56:25.128 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T06:56:25.214 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T06:56:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T06:56:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T06:56:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:25.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T06:56:25.590 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:25.590 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:25.745 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T06:56:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T06:56:25.993 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 113/124 2023-10-08T06:56:26.263 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:26.263 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T06:56:26.263 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T06:56:26.263 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T06:56:26.263 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T06:56:26.263 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T06:56:26.264 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T06:56:26.265 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T06:56:26.266 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T06:56:26.267 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T06:56:26.268 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-10-08T06:56:26.269 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-10-08T06:56:26.270 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-10-08T06:56:26.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-10-08T06:56:26.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-10-08T06:56:26.273 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T06:56:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T06:56:26.286 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-10-08T06:56:26.436 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-10-08T06:56:26.444 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 113/124 2023-10-08T06:56:26.448 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-10-08T06:56:26.624 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T06:56:26.764 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-10-08T06:56:26.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T06:56:26.907 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-10-08T06:56:26.919 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-10-08T06:56:26.988 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T06:56:27.024 INFO:teuthology.orchestra.run.smithi183.stdout:Installed products updated. 2023-10-08T06:56:27.136 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T06:56:27.202 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.243 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.244 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T06:56:27.245 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: jq-1.6-3.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:27.246 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T06:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T06:56:27.248 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T06:56:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T06:56:27.250 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T06:56:27.250 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T06:56:27.250 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T06:56:27.251 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T06:56:27.252 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T06:56:27.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T06:56:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T06:56:27.255 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T06:56:27.255 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T06:56:27.255 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T06:56:27.255 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:27.255 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-08T06:56:27.274 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T06:56:27.361 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-10-08T06:56:27.424 DEBUG:teuthology.parallel:result is None 2023-10-08T06:56:27.459 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-10-08T06:56:27.499 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T06:56:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-10-08T06:56:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-10-08T06:56:27.706 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T06:56:27.764 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-10-08T06:56:27.764 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-10-08T06:56:27.961 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-10-08T06:56:27.965 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:27.965 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:28.107 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-10-08T06:56:28.118 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-10-08T06:56:28.225 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-10-08T06:56:28.225 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:28.435 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T06:56:28.435 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:28.729 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:28.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T06:56:28.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T06:56:28.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T06:56:28.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T06:56:28.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T06:56:28.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:56:28.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:56:28.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:56:28.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T06:56:28.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T06:56:28.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T06:56:28.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:56:28.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T06:56:28.732 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T06:56:28.732 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T06:56:28.732 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T06:56:28.732 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T06:56:28.732 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T06:56:28.732 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T06:56:28.733 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T06:56:28.733 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T06:56:28.733 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T06:56:28.733 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T06:56:28.733 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T06:56:28.733 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T06:56:28.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T06:56:28.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T06:56:28.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T06:56:28.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T06:56:28.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T06:56:28.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T06:56:28.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T06:56:28.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T06:56:28.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T06:56:28.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T06:56:28.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T06:56:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T06:56:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T06:56:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T06:56:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T06:56:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T06:56:28.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T06:56:28.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T06:56:28.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T06:56:28.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T06:56:28.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T06:56:28.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T06:56:28.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T06:56:28.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T06:56:28.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T06:56:28.739 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T06:56:28.739 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T06:56:28.739 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T06:56:28.739 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T06:56:28.739 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T06:56:28.739 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T06:56:28.740 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T06:56:28.740 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T06:56:28.740 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T06:56:28.740 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T06:56:28.740 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T06:56:28.740 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T06:56:28.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T06:56:28.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T06:56:28.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T06:56:28.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T06:56:28.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T06:56:28.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-10-08T06:56:28.742 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-10-08T06:56:28.743 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-10-08T06:56:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-10-08T06:56:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T06:56:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T06:56:28.748 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T06:56:28.966 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:28.966 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:50 ago on Sun 08 Oct 2023 06:54:38 AM UTC. 2023-10-08T06:56:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T06:56:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T06:56:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T06:56:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T06:56:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T06:56:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T06:56:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T06:56:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T06:56:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T06:56:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-10-08T06:56:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-10-08T06:56:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-10-08T06:56:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-10-08T06:56:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T06:56:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T06:56:31.303 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:31.304 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:52 ago on Sun 08 Oct 2023 06:54:39 AM UTC. 2023-10-08T06:56:31.547 INFO:teuthology.orchestra.run.smithi163.stdout:Installed products updated. 2023-10-08T06:56:31.760 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:31.760 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2023-10-08T06:56:31.760 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.760 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.761 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.762 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: jq-1.6-3.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T06:56:31.763 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T06:56:31.765 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.766 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T06:56:31.767 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:31.768 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.769 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T06:56:31.770 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T06:56:31.771 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T06:56:31.772 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T06:56:31.772 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:31.772 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-10-08T06:56:31.776 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T06:56:31.776 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:55 ago on Sun 08 Oct 2023 06:54:36 AM UTC. 2023-10-08T06:56:31.942 DEBUG:teuthology.parallel:result is None 2023-10-08T06:56:33.884 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-10-08T06:56:34.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.128 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.129 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T06:56:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-3.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T06:56:34.131 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T06:56:34.132 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T06:56:34.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T06:56:34.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:34.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T06:56:34.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T06:56:34.137 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T06:56:34.138 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T06:56:34.139 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T06:56:34.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:34.139 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-10-08T06:56:34.324 DEBUG:teuthology.parallel:result is None 2023-10-08T06:56:34.363 INFO:teuthology.orchestra.run.smithi169.stdout:Installed products updated. 2023-10-08T06:56:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: jq-1.6-3.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T06:56:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T06:56:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T06:56:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T06:56:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T06:56:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T06:56:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T06:56:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T06:56:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T06:56:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T06:56:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T06:56:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T06:56:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T06:56:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T06:56:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T06:56:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T06:56:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:34.593 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2023-10-08T06:56:34.792 DEBUG:teuthology.parallel:result is None 2023-10-08T06:56:34.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:56:34.951 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T06:56:34.978 INFO:teuthology.orchestra.run.smithi037.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:34.978 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:34.979 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T06:56:34.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:56:35.119 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T06:56:35.147 INFO:teuthology.orchestra.run.smithi163.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:35.147 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:35.147 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T06:56:35.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:56:35.366 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T06:56:35.395 INFO:teuthology.orchestra.run.smithi169.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:35.395 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:35.395 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T06:56:35.396 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:56:35.613 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T06:56:35.641 INFO:teuthology.orchestra.run.smithi183.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:35.642 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T06:56:35.642 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T06:56:35.642 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T06:56:35.643 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:35.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T06:56:35.694 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:35.694 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T06:56:35.744 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:35.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T06:56:35.791 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:35.791 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T06:56:35.839 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T06:56:35.840 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:35.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T06:56:35.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T06:56:35.949 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:35.949 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T06:56:35.981 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T06:56:36.051 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:36.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T06:56:36.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T06:56:36.153 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:36.153 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T06:56:36.185 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T06:56:36.256 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T06:56:36.256 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:36.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T06:56:36.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T06:56:36.363 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:36.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T06:56:36.395 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T06:56:36.465 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:36.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T06:56:36.497 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T06:56:36.568 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:36.568 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T06:56:36.599 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T06:56:36.670 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T06:56:36.670 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:36.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T06:56:36.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T06:56:36.776 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:36.776 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T06:56:36.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T06:56:36.877 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:36.877 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T06:56:36.909 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T06:56:36.980 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:36.980 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T06:56:37.011 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T06:56:37.082 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T06:56:37.152 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T06:56:37.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-10-08T06:56:37.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2023-10-08T06:56:37.158 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2023-10-08T06:56:37.161 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-10-08T06:56:37.192 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T06:56:37.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T06:56:37.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T06:56:37.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T06:56:37.233 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T06:56:37.264 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T06:56:37.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T06:56:37.299 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T06:56:37.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T06:56:37.304 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T06:56:37.344 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T06:56:37.344 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T06:56:37.344 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7417408', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 9064, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_14:08:36', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T06:56:37.344 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T06:56:37.370 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T06:56:37.373 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T06:56:37.375 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T06:56:37.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T06:56:37.429 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T06:56:37.432 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T06:56:37.434 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T06:56:37.462 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:37.462 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T06:56:37.516 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T06:56:37.516 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2023-10-08T06:56:37.574 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T06:56:37.574 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:37.574 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 382850 Links: 1 2023-10-08T06:56:37.574 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:37.574 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:37.575 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-08 06:56:25.983489157 +0000 2023-10-08T06:56:37.575 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-08 06:53:28.265716975 +0000 2023-10-08T06:56:37.575 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-08 06:53:28.265716975 +0000 2023-10-08T06:56:37.575 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-08T06:56:37.575 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T06:56:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-08T06:56:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-08T06:56:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000258854 s, 2.0 MB/s 2023-10-08T06:56:37.642 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T06:56:37.701 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2023-10-08T06:56:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T06:56:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:37.760 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 390586 Links: 1 2023-10-08T06:56:37.760 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:37.760 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:37.760 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-08 06:56:25.983489157 +0000 2023-10-08T06:56:37.760 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-08 06:53:28.794704843 +0000 2023-10-08T06:56:37.761 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-08 06:53:28.794704843 +0000 2023-10-08T06:56:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-08T06:56:37.761 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T06:56:37.825 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-08T06:56:37.825 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-08T06:56:37.825 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000217495 s, 2.4 MB/s 2023-10-08T06:56:37.826 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T06:56:37.884 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2023-10-08T06:56:37.942 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 380630 Links: 1 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-08 06:56:25.983489157 +0000 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-08 06:53:29.305693125 +0000 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-08 06:53:29.305693125 +0000 2023-10-08T06:56:37.943 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-08T06:56:37.943 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T06:56:38.009 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-08T06:56:38.009 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-08T06:56:38.009 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00022589 s, 2.3 MB/s 2023-10-08T06:56:38.010 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T06:56:38.068 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2023-10-08T06:56:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T06:56:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:38.125 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 390693 Links: 1 2023-10-08T06:56:38.126 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:38.126 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:38.126 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-08 06:56:25.983489157 +0000 2023-10-08T06:56:38.126 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-08 06:53:29.845680741 +0000 2023-10-08T06:56:38.126 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-08 06:53:29.845680741 +0000 2023-10-08T06:56:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-08T06:56:38.126 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T06:56:38.190 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-08T06:56:38.190 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-08T06:56:38.191 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000181731 s, 2.8 MB/s 2023-10-08T06:56:38.192 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T06:56:38.250 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-08T06:56:38.250 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:38.250 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T06:56:38.270 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T06:56:38.271 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2023-10-08T06:56:38.332 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T06:56:38.332 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:38.332 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 394476 Links: 1 2023-10-08T06:56:38.332 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:38.332 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:38.333 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-08 06:56:28.870713859 +0000 2023-10-08T06:56:38.333 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-08 06:53:31.123428128 +0000 2023-10-08T06:56:38.333 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-08 06:53:31.123428128 +0000 2023-10-08T06:56:38.333 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2023-10-08T06:56:38.333 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T06:56:38.400 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-08T06:56:38.400 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-08T06:56:38.400 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000251201 s, 2.0 MB/s 2023-10-08T06:56:38.401 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T06:56:38.461 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 388483 Links: 1 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-08 06:56:28.870713859 +0000 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-08 06:53:31.653416974 +0000 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-08 06:53:31.653416974 +0000 2023-10-08T06:56:38.520 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2023-10-08T06:56:38.521 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T06:56:38.589 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-08T06:56:38.589 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-08T06:56:38.589 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000231749 s, 2.2 MB/s 2023-10-08T06:56:38.590 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T06:56:38.649 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 388567 Links: 1 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-08 06:56:28.870713859 +0000 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-08 06:53:32.208405294 +0000 2023-10-08T06:56:38.709 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-08 06:53:32.208405294 +0000 2023-10-08T06:56:38.710 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2023-10-08T06:56:38.710 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T06:56:38.776 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-08T06:56:38.776 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-08T06:56:38.776 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000232416 s, 2.2 MB/s 2023-10-08T06:56:38.777 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T06:56:38.840 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2023-10-08T06:56:38.898 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 396498 Links: 1 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-08 06:56:28.870713859 +0000 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-08 06:53:32.727394372 +0000 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-08 06:53:32.727394372 +0000 2023-10-08T06:56:38.899 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2023-10-08T06:56:38.899 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T06:56:38.966 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-08T06:56:38.966 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-08T06:56:38.966 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000254148 s, 2.0 MB/s 2023-10-08T06:56:38.967 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T06:56:39.027 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-10-08T06:56:39.027 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:39.027 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T06:56:39.048 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T06:56:39.049 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-10-08T06:56:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T06:56:39.110 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 393470 Links: 1 2023-10-08T06:56:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 06:56:21.553380470 +0000 2023-10-08T06:56:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 06:53:31.344069977 +0000 2023-10-08T06:56:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 06:53:31.344069977 +0000 2023-10-08T06:56:39.111 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T06:56:39.111 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T06:56:39.180 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T06:56:39.180 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T06:56:39.180 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000270255 s, 1.9 MB/s 2023-10-08T06:56:39.182 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T06:56:39.242 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 387048 Links: 1 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 06:56:21.553380470 +0000 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 06:53:31.854056445 +0000 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 06:53:31.854056445 +0000 2023-10-08T06:56:39.301 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T06:56:39.302 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T06:56:39.368 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T06:56:39.368 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T06:56:39.369 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000259775 s, 2.0 MB/s 2023-10-08T06:56:39.370 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T06:56:39.428 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-10-08T06:56:39.486 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 393618 Links: 1 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 06:56:21.553380470 +0000 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 06:53:32.379042515 +0000 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 06:53:32.379042515 +0000 2023-10-08T06:56:39.487 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T06:56:39.488 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T06:56:39.553 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T06:56:39.553 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T06:56:39.553 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.00023669 s, 2.2 MB/s 2023-10-08T06:56:39.554 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T06:56:39.612 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-10-08T06:56:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 392825 Links: 1 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 06:56:21.553380470 +0000 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 06:53:32.911028400 +0000 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 06:53:32.911028400 +0000 2023-10-08T06:56:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T06:56:39.670 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T06:56:39.736 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T06:56:39.736 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T06:56:39.736 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000194823 s, 2.6 MB/s 2023-10-08T06:56:39.737 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T06:56:39.795 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-10-08T06:56:39.795 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-10-08T06:56:39.795 INFO:tasks.ceph:Generating config... 2023-10-08T06:56:39.797 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2023-10-08T06:56:39.798 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T06:56:39.798 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T06:56:39.798 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T06:56:39.798 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T06:56:39.798 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T06:56:39.799 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T06:56:39.799 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2023-10-08T06:56:39.799 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-10-08T06:56:39.799 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T06:56:39.799 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T06:56:39.800 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T06:56:39.800 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T06:56:39.800 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T06:56:39.800 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T06:56:39.800 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T06:56:39.800 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T06:56:39.801 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T06:56:39.801 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-10-08T06:56:39.801 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T06:56:39.801 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-10-08T06:56:39.801 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T06:56:39.802 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T06:56:39.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T06:56:39.864 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T06:56:39.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T06:56:39.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:56:39.946 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '[v2:172.21.15.37:3301,v1:172.21.15.37:6790]'), ('mon.c', '[v2:172.21.15.37:3302,v1:172.21.15.37:6791]')] 2023-10-08T06:56:39.947 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],[v2:172.21.15.37:3302,v1:172.21.15.37:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2023-10-08T06:56:39.947 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:39.947 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T06:56:40.004 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --addv b '[v2:172.21.15.37:3301,v1:172.21.15.37:6790]' --addv c '[v2:172.21.15.37:3302,v1:172.21.15.37:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid a28386aa-6313-4530-b2e8-fd7736a43dc5 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:fsid a28386aa-6313-4530-b2e8-fd7736a43dc5 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-10-08T06:56:40.095951+0000 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-10-08T06:56:40.095951+0000 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-10-08T06:56:40.096 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-10-08T06:56:40.097 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-10-08T06:56:40.097 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.b 2023-10-08T06:56:40.097 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.37:3302/0,v1:172.21.15.37:6791/0] mon.c 2023-10-08T06:56:40.097 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T06:56:40.098 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T06:56:40.115 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a28386aa-6313-4530-b2e8-fd7736a43dc5... 2023-10-08T06:56:40.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T06:56:40.157 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T06:56:40.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T06:56:40.164 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T06:56:40.201 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-08T06:56:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-08T06:56:40.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.204 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],[v2:172.21.15.37:3302,v1:172.21.15.37:6791]" 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = a28386aa-6313-4530-b2e8-fd7736a43dc5 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.205 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-08T06:56:40.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.207 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore compression algorithm = lz4 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore compression mode = aggressive 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-08T06:56:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: osd blocked scrub grace period = 3600 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: osd max markdown count = 1000 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-08T06:56:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T06:56:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-08T06:56:40.212 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-10-08T06:56:40.213 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-10-08T06:56:40.214 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2023-10-08T06:56:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2023-10-08T06:56:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2023-10-08T06:56:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2023-10-08T06:56:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2023-10-08T06:56:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],[v2:172.21.15.37:3302,v1:172.21.15.37:6791]" 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = a28386aa-6313-4530-b2e8-fd7736a43dc5 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2023-10-08T06:56:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2023-10-08T06:56:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore compression algorithm = lz4 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore compression mode = aggressive 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2023-10-08T06:56:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: osd blocked scrub grace period = 3600 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: osd max markdown count = 1000 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2023-10-08T06:56:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2023-10-08T06:56:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T06:56:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T06:56:40.225 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-10-08T06:56:40.226 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.227 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-10-08T06:56:40.228 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-10-08T06:56:40.229 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],[v2:172.21.15.37:3302,v1:172.21.15.37:6791]" 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = a28386aa-6313-4530-b2e8-fd7736a43dc5 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-10-08T06:56:40.230 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.231 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2023-10-08T06:56:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore compression algorithm = lz4 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore compression mode = aggressive 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: osd blocked scrub grace period = 3600 2023-10-08T06:56:40.233 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: osd max markdown count = 1000 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-10-08T06:56:40.234 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-10-08T06:56:40.235 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-10-08T06:56:40.236 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2023-10-08T06:56:40.237 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-10-08T06:56:40.238 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-10-08T06:56:40.238 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-10-08T06:56:40.240 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2023-10-08T06:56:40.240 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2023-10-08T06:56:40.240 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T06:56:40.240 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2023-10-08T06:56:40.241 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2023-10-08T06:56:40.242 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.243 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],[v2:172.21.15.37:3302,v1:172.21.15.37:6791]" 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = a28386aa-6313-4530-b2e8-fd7736a43dc5 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2023-10-08T06:56:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2023-10-08T06:56:40.245 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.246 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore compression algorithm = lz4 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore compression mode = aggressive 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T06:56:40.247 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: osd blocked scrub grace period = 3600 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: osd max markdown count = 1000 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2023-10-08T06:56:40.248 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2023-10-08T06:56:40.249 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T06:56:40.250 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T06:56:40.251 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2023-10-08T06:56:40.252 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2023-10-08T06:56:40.252 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2023-10-08T06:56:40.252 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2023-10-08T06:56:40.252 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2023-10-08T06:56:40.252 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-10-08T06:56:40.252 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T06:56:40.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T06:56:40.338 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T06:56:40.338 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:40.338 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T06:56:40.356 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:40.356 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T06:56:40.413 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-10-08T06:56:40.413 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:40.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T06:56:40.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:56:40.490 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:40.491 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:40.548 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2023-10-08T06:56:40.548 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:40.548 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T06:56:40.548 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:56:40.592 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:40.592 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:40.650 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2023-10-08T06:56:40.650 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:40.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T06:56:40.651 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:56:40.694 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:40.695 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:40.753 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T06:56:40.753 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:40.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T06:56:40.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:56:40.793 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:40.793 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:40.851 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T06:56:40.851 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T06:56:40.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T06:56:40.909 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T06:56:40.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T06:56:40.968 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T06:56:40.970 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T06:56:40.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T06:56:41.025 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T06:56:41.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T06:56:41.075 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T06:56:41.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T06:56:41.119 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T06:56:41.132 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T06:56:41.133 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-10-08T06:56:41.133 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T06:56:41.164 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-08T06:56:41.164 INFO:tasks.ceph:role: osd.0 2023-10-08T06:56:41.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-08T06:56:41.165 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T06:56:41.243 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:56:41.243 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:56:41.243 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:56:41.243 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T06:56:41.244 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:56:41.244 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:56:41.244 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:56:41.244 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:56:41.244 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:56:41.244 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:56:41.675 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-10-08T06:56:41.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-10-08T06:56:41.678 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T06:56:41.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T06:56:41.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:42.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-08T06:56:42.002+0000 7fb59195a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T06:56:42.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-08T06:56:42.005+0000 7fb59195a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T06:56:42.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-08T06:56:42.005+0000 7fb59195a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T06:56:42.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-08T06:56:42.005+0000 7fb59195a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T06:56:42.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-08T06:56:42.005+0000 7fb59195a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T06:56:42.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-08T06:56:42.008+0000 7fb59195a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T06:56:44.868 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T06:56:44.908 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T06:56:44.940 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-10-08T06:56:44.941 INFO:tasks.ceph:role: osd.1 2023-10-08T06:56:44.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-08T06:56:44.941 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T06:56:45.019 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:56:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:56:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:56:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T06:56:45.019 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:56:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:56:45.020 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:56:45.020 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:56:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:56:45.020 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:56:45.450 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-10-08T06:56:45.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-10-08T06:56:45.453 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-10-08T06:56:45.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T06:56:45.775 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-08T06:56:45.907+0000 7f14a262f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T06:56:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-08T06:56:45.907+0000 7f14a262f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T06:56:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-08T06:56:45.907+0000 7f14a262f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T06:56:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-08T06:56:45.907+0000 7f14a262f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T06:56:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-08T06:56:45.907+0000 7f14a262f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T06:56:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-08T06:56:45.908+0000 7f14a262f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T06:56:48.788 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T06:56:48.830 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T06:56:48.863 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-10-08T06:56:48.863 INFO:tasks.ceph:role: osd.2 2023-10-08T06:56:48.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T06:56:48.864 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T06:56:48.942 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:56:48.942 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:56:48.942 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:56:48.942 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T06:56:48.943 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:56:48.943 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:56:48.943 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:56:48.943 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:56:48.943 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:56:48.943 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:56:49.389 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-08T06:56:49.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-08T06:56:49.391 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-10-08T06:56:49.575 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T06:56:49.613 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:49.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T06:56:49.720+0000 7f3351090640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T06:56:49.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T06:56:49.723+0000 7f3351090640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T06:56:49.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T06:56:49.723+0000 7f3351090640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T06:56:49.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T06:56:49.723+0000 7f3351090640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T06:56:49.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T06:56:49.723+0000 7f3351090640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T06:56:49.731 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T06:56:49.729+0000 7f3351090640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T06:56:52.595 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T06:56:52.635 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T06:56:52.635 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:52.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T06:56:52.668 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:52.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T06:56:52.742 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:52.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T06:56:52.814 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:52.815 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T06:56:52.848 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:52.848 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T06:56:52.880 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:52.880 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T06:56:52.911 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-08T06:56:52.912 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T06:56:52.933 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T06:56:52.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T06:56:53.005 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-10-08T06:56:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCoUiJlFkcwNhAAR6noZo7k/woX4AqAWZe/6g== 2023-10-08T06:56:53.005 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-10-08T06:56:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCoUiJlG7G3ORAAx7jZ8JywIKSj4JQHaLr1EA== 2023-10-08T06:56:53.005 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-08T06:56:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCpUiJlCf2AARAAvqB3ZLxdzG25zsT23QTb8Q== 2023-10-08T06:56:53.005 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-10-08T06:56:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCqUiJlOxsvABAAt+dpP2OVbMIUmE1ICRvhdg== 2023-10-08T06:56:53.006 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-10-08T06:56:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCtUiJlx+MiNhAAO4zHUbEi7LN8KwVJ+jHnHw== 2023-10-08T06:56:53.006 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-10-08T06:56:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCxUiJlNXMCKxAAS9A+6A3PrFuxVjAKOrx22g== 2023-10-08T06:56:53.006 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-10-08T06:56:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCpUiJlv6ofBxAAMqVLWHXlHLSYB+8z4MNEWg== 2023-10-08T06:56:53.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T06:56:53.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T06:56:53.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:56:53.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:56:53.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:56:53.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:56:53.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:56:53.447 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T06:56:53.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T06:56:53.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T06:56:53.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T06:56:53.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T06:56:53.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T06:56:53.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T06:56:53.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T06:56:53.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T06:56:53.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T06:56:54.014 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:56:54.071 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T06:56:54.071 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T06:56:54.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T06:56:54.113 INFO:tasks.ceph.mon.a:Started 2023-10-08T06:56:54.113 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T06:56:54.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T06:56:54.115 INFO:tasks.ceph.mon.b:Started 2023-10-08T06:56:54.116 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T06:56:54.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T06:56:54.117 INFO:tasks.ceph.mon.c:Started 2023-10-08T06:56:54.118 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T06:56:54.118 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T06:56:54.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T06:56:54.120 INFO:tasks.ceph.mgr.x:Started 2023-10-08T06:56:54.120 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T06:56:54.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T06:56:54.123 INFO:tasks.ceph.mgr.y:Started 2023-10-08T06:56:54.123 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T06:56:54.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T06:56:54.583 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-10-08T06:56:54.594 INFO:tasks.ceph:check_enable_crimson: False 2023-10-08T06:56:54.594 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T06:56:54.594 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-08T06:56:54.595 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T06:56:54.612 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:54.612+0000 7fb4548d6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T06:56:54.627 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-08T06:56:54.627 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T06:56:54.658 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T06:56:54.658 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T06:56:54.681 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:54.681+0000 7fb4548d6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T06:56:54.689 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06 0 2023-10-08T06:56:54.761 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:54.760+0000 7fb4548d6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T06:56:54.843 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:54.842+0000 7fb4548d6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T06:56:54.946 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-10-08T06:56:54.952 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:54.952+0000 7faa50c03200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T06:56:54.959 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new da732e65-55c2-489e-bec4-ce4124704896 1 2023-10-08T06:56:54.997 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:54.997+0000 7fb4548d6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T06:56:55.022 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.022+0000 7faa50c03200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T06:56:55.099 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.098+0000 7faa50c03200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T06:56:55.168 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-08T06:56:55.180 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1 2 2023-10-08T06:56:55.182 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.182+0000 7faa50c03200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T06:56:55.331 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.331+0000 7faa50c03200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T06:56:55.386 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-10-08T06:56:55.399 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T06:56:55.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T06:56:55.401 INFO:tasks.ceph.osd.0:Started 2023-10-08T06:56:55.402 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T06:56:55.402 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T06:56:55.404 INFO:tasks.ceph.osd.1:Started 2023-10-08T06:56:55.404 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T06:56:55.405 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T06:56:55.407 INFO:tasks.ceph.osd.2:Started 2023-10-08T06:56:55.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:56:55.421 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:55.421+0000 7fb4548d6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T06:56:55.549 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:55.549+0000 7fb4548d6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:56:55.385351+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:56:55.631 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T06:56:55.632 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T06:56:55.657 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:55.657+0000 7fb4548d6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T06:56:55.700 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.700+0000 7faa50c03200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T06:56:55.822 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.821+0000 7faa50c03200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T06:56:55.825 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:55.825+0000 7fb4548d6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T06:56:55.899 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.899+0000 7faa50c03200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T06:56:55.934 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T06:56:55.990 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:55.990+0000 7faa50c03200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T06:56:55.998 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:56:55.997+0000 7f0f466f4640 -1 Falling back to public interface 2023-10-08T06:56:56.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:56:56.003+0000 7f5f794e9640 -1 Falling back to public interface 2023-10-08T06:56:56.013 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:56:56.012+0000 7f7a967d2640 -1 Falling back to public interface 2023-10-08T06:56:56.141 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-08T06:56:56.142 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":5,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:56:55.385351+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:56:56.153 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-10-08T06:56:56.714 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:56.714+0000 7faa50c03200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T06:56:56.722 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:56.721+0000 7fb4548d6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T06:56:57.407 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:57.407+0000 7faa50c03200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T06:56:57.407 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:57.407+0000 7fb4548d6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T06:56:57.481 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:57.480+0000 7faa50c03200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T06:56:57.481 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:57.480+0000 7fb4548d6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T06:56:58.221 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:58.220+0000 7fb4548d6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:56:58.221 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:58.220+0000 7faa50c03200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:56:58.303 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:58.303+0000 7fb4548d6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T06:56:58.304 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:58.303+0000 7faa50c03200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T06:56:58.454 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:58.454+0000 7faa50c03200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:56:58.454 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:58.454+0000 7fb4548d6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:56:58.707 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:58.706+0000 7fb4548d6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T06:56:58.707 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:58.707+0000 7faa50c03200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T06:56:58.936 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:58.935+0000 7fb4548d6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T06:56:58.936 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:58.935+0000 7faa50c03200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T06:56:59.078 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:59.078+0000 7fb4548d6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T06:56:59.078 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:59.078+0000 7faa50c03200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T06:56:59.321 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:59.321+0000 7faa50c03200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T06:56:59.321 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:59.321+0000 7fb4548d6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T06:56:59.467 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:56:59.467+0000 7f0f466f4640 -1 osd.2 0 log_to_monitors true 2023-10-08T06:56:59.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:56:59.469+0000 7f5f794e9640 -1 osd.0 0 log_to_monitors true 2023-10-08T06:56:59.488 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:59.488+0000 7faa50c03200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T06:56:59.489 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:59.489+0000 7fb4548d6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T06:56:59.493 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:56:59.494+0000 7f7a967d2640 -1 osd.1 0 log_to_monitors true 2023-10-08T06:56:59.622 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:59.622+0000 7fb4548d6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T06:56:59.623 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:59.622+0000 7faa50c03200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T06:56:59.968 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:56:59.968+0000 7fb4548d6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T06:56:59.969 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:56:59.968+0000 7faa50c03200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T06:57:00.074 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:57:00.074+0000 7fb4548d6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T06:57:00.075 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:57:00.074+0000 7faa50c03200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T06:57:00.275 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:57:00.274+0000 7fb4548d6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T06:57:00.275 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:57:00.274+0000 7faa50c03200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T06:57:00.934 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-10-08T06:57:00.934+0000 7fb4548d6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T06:57:00.934 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:57:00.934+0000 7faa50c03200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T06:57:01.951 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:57:01.951+0000 7faa08bb2700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T06:57:01.954 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-08T06:57:01.954+0000 7faa08bb2700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T06:57:02.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:02.007+0000 7f5f6e0a2700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T06:57:02.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:02.021+0000 7f5f6547b700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:57:02.101 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:02.101+0000 7f0f3aaac700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T06:57:02.111 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:02.111+0000 7f0f32686700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:57:02.176 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:02.176+0000 7f7a8b38b700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T06:57:02.192 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:02.192+0000 7f7a82764700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:57:02.455 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:02.796 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-08T06:57:02.796 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":7,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:01.229324+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:02.809 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-10-08T06:57:09.112 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:09.453 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-08T06:57:09.453 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:07.267436+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:09.466 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-10-08T06:57:09.466 INFO:tasks.ceph:Creating RBD pool 2023-10-08T06:57:09.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-08T06:57:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-10-08T06:57:10.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-08T06:57:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-08T06:57:11.311 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T06:57:11.311 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T06:57:11.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T06:57:11.314 INFO:tasks.ceph.mds.a:Started 2023-10-08T06:57:11.314 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T06:57:11.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:11.399 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-08T06:57:11.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:11.659 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":14,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:11.284183+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:11.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:57:11.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:57:12.012 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-08T06:57:12.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T06:57:12.364 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-08T06:57:12.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:57:12.757 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:12.757 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6803/3692271632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3692271632},{"type":"v1","addr":"172.21.15.37:6803","nonce":3692271632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T06:57:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2023-10-08T06:57:12.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:13.107 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:13.107 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":15,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:12.288513+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:13.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:57:13.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:57:13.460 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-08T06:57:13.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T06:57:13.813 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-08T06:57:13.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T06:57:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:14.162 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-08T06:57:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-08T06:57:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-08T06:57:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-08T06:57:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-08T06:57:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:14.163 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-08T06:57:14.176 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T06:57:14.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T06:57:15.311 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-08T06:57:15.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T06:57:16.315 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-08T06:57:16.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T06:57:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 3 and data pool 4 2023-10-08T06:57:17.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:17.683 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:17.684 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:16.720836+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:17.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:18.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:18.034 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:16.720836+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:18.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T06:57:19.351 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T06:57:19.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T06:57:20.359 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T06:57:20.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:57:20.745 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:20.746 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:57:16.721133+0000","modified":"2023-10-08T06:57:19.748631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6803/3692271632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3692271632},{"type":"v1","addr":"172.21.15.37:6803","nonce":3692271632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:57:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-08T06:57:20.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:21.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:21.098 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:18.323568+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:21.112 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T06:57:21.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:21.420 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-10-08T06:57:21.419+0000 7fec250f3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T06:57:21.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:21.470 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T06:57:20.943183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81716,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033804,"statfs":{"total":289910292480,"available":289826615296,"internally_reserved":0,"allocated":663552,"data_stored":1354044,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.638065"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337861+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:17.337861+0000","last_peered":"2023-10-08T06:57:17.337861+0000","last_clean":"2023-10-08T06:57:17.337861+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:17.337861+0000","last_undegraded":"2023-10-08T06:57:17.337861+0000","last_fullsized":"2023-10-08T06:57:17.337861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:34.090520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337402+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:17.337402+0000","last_peered":"2023-10-08T06:57:17.337402+0000","last_clean":"2023-10-08T06:57:17.337402+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:17.337402+0000","last_undegraded":"2023-10-08T06:57:17.337402+0000","last_fullsized":"2023-10-08T06:57:17.337402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:25:32.722947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334697+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.334697+0000","last_peered":"2023-10-08T06:57:18.334697+0000","last_clean":"2023-10-08T06:57:18.334697+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.334697+0000","last_undegraded":"2023-10-08T06:57:18.334697+0000","last_fullsized":"2023-10-08T06:57:18.334697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334477+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.334477+0000","last_peered":"2023-10-08T06:57:18.334477+0000","last_clean":"2023-10-08T06:57:18.334477+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.334477+0000","last_undegraded":"2023-10-08T06:57:18.334477+0000","last_fullsized":"2023-10-08T06:57:18.334477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337637+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:17.337637+0000","last_peered":"2023-10-08T06:57:17.337637+0000","last_clean":"2023-10-08T06:57:17.337637+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:17.337637+0000","last_undegraded":"2023-10-08T06:57:17.337637+0000","last_fullsized":"2023-10-08T06:57:17.337637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:17.019299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333757+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.333757+0000","last_peered":"2023-10-08T06:57:18.333757+0000","last_clean":"2023-10-08T06:57:18.333757+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.333757+0000","last_undegraded":"2023-10-08T06:57:18.333757+0000","last_fullsized":"2023-10-08T06:57:18.333757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333585+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.333585+0000","last_peered":"2023-10-08T06:57:18.333585+0000","last_clean":"2023-10-08T06:57:18.333585+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.333585+0000","last_undegraded":"2023-10-08T06:57:18.333585+0000","last_fullsized":"2023-10-08T06:57:18.333585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333429+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.333429+0000","last_peered":"2023-10-08T06:57:18.333429+0000","last_clean":"2023-10-08T06:57:18.333429+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.333429+0000","last_undegraded":"2023-10-08T06:57:18.333429+0000","last_fullsized":"2023-10-08T06:57:18.333429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331881+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.331881+0000","last_peered":"2023-10-08T06:57:18.331881+0000","last_clean":"2023-10-08T06:57:18.331881+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.331881+0000","last_undegraded":"2023-10-08T06:57:18.331881+0000","last_fullsized":"2023-10-08T06:57:18.331881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.334107+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:17.334107+0000","last_peered":"2023-10-08T06:57:17.334107+0000","last_clean":"2023-10-08T06:57:17.334107+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:17.334107+0000","last_undegraded":"2023-10-08T06:57:17.334107+0000","last_fullsized":"2023-10-08T06:57:17.334107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:20.427267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334400+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.334400+0000","last_peered":"2023-10-08T06:57:18.334400+0000","last_clean":"2023-10-08T06:57:18.334400+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.334400+0000","last_undegraded":"2023-10-08T06:57:18.334400+0000","last_fullsized":"2023-10-08T06:57:18.334400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338455+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:17.338455+0000","last_peered":"2023-10-08T06:57:17.338455+0000","last_clean":"2023-10-08T06:57:17.338455+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:17.338455+0000","last_undegraded":"2023-10-08T06:57:17.338455+0000","last_fullsized":"2023-10-08T06:57:17.338455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:56.506185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337619+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:17.337619+0000","last_peered":"2023-10-08T06:57:17.337619+0000","last_clean":"2023-10-08T06:57:17.337619+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:17.337619+0000","last_undegraded":"2023-10-08T06:57:17.337619+0000","last_fullsized":"2023-10-08T06:57:17.337619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:35.829713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334425+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.334425+0000","last_peered":"2023-10-08T06:57:18.334425+0000","last_clean":"2023-10-08T06:57:18.334425+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.334425+0000","last_undegraded":"2023-10-08T06:57:18.334425+0000","last_fullsized":"2023-10-08T06:57:18.334425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333883+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.333883+0000","last_peered":"2023-10-08T06:57:18.333883+0000","last_clean":"2023-10-08T06:57:18.333883+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.333883+0000","last_undegraded":"2023-10-08T06:57:18.333883+0000","last_fullsized":"2023-10-08T06:57:18.333883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333504+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.333504+0000","last_peered":"2023-10-08T06:57:18.333504+0000","last_clean":"2023-10-08T06:57:18.333504+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.333504+0000","last_undegraded":"2023-10-08T06:57:18.333504+0000","last_fullsized":"2023-10-08T06:57:18.333504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331981+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.331981+0000","last_peered":"2023-10-08T06:57:18.331981+0000","last_clean":"2023-10-08T06:57:18.331981+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.331981+0000","last_undegraded":"2023-10-08T06:57:18.331981+0000","last_fullsized":"2023-10-08T06:57:18.331981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333653+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:17.333653+0000","last_peered":"2023-10-08T06:57:17.333653+0000","last_clean":"2023-10-08T06:57:17.333653+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:17.333653+0000","last_undegraded":"2023-10-08T06:57:17.333653+0000","last_fullsized":"2023-10-08T06:57:17.333653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.658648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331998+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.331998+0000","last_peered":"2023-10-08T06:57:18.331998+0000","last_clean":"2023-10-08T06:57:18.331998+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.331998+0000","last_undegraded":"2023-10-08T06:57:18.331998+0000","last_fullsized":"2023-10-08T06:57:18.331998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334495+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.334495+0000","last_peered":"2023-10-08T06:57:18.334495+0000","last_clean":"2023-10-08T06:57:18.334495+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.334495+0000","last_undegraded":"2023-10-08T06:57:18.334495+0000","last_fullsized":"2023-10-08T06:57:18.334495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333990+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.333990+0000","last_peered":"2023-10-08T06:57:18.333990+0000","last_clean":"2023-10-08T06:57:18.333990+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.333990+0000","last_undegraded":"2023-10-08T06:57:18.333990+0000","last_fullsized":"2023-10-08T06:57:18.333990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338512+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:17.338512+0000","last_peered":"2023-10-08T06:57:17.338512+0000","last_clean":"2023-10-08T06:57:17.338512+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:17.338512+0000","last_undegraded":"2023-10-08T06:57:17.338512+0000","last_fullsized":"2023-10-08T06:57:17.338512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:58.091507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331586+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.331586+0000","last_peered":"2023-10-08T06:57:18.331586+0000","last_clean":"2023-10-08T06:57:18.331586+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.331586+0000","last_undegraded":"2023-10-08T06:57:18.331586+0000","last_fullsized":"2023-10-08T06:57:18.331586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333005+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:17.333005+0000","last_peered":"2023-10-08T06:57:17.333005+0000","last_clean":"2023-10-08T06:57:17.333005+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:17.333005+0000","last_undegraded":"2023-10-08T06:57:17.333005+0000","last_fullsized":"2023-10-08T06:57:17.333005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:00.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.334457+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:17.334457+0000","last_peered":"2023-10-08T06:57:17.334457+0000","last_clean":"2023-10-08T06:57:17.334457+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:17.334457+0000","last_undegraded":"2023-10-08T06:57:17.334457+0000","last_fullsized":"2023-10-08T06:57:17.334457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:57.239544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331941+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.331941+0000","last_peered":"2023-10-08T06:57:18.331941+0000","last_clean":"2023-10-08T06:57:18.331941+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.331941+0000","last_undegraded":"2023-10-08T06:57:18.331941+0000","last_fullsized":"2023-10-08T06:57:18.331941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334529+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.334529+0000","last_peered":"2023-10-08T06:57:18.334529+0000","last_clean":"2023-10-08T06:57:18.334529+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.334529+0000","last_undegraded":"2023-10-08T06:57:18.334529+0000","last_fullsized":"2023-10-08T06:57:18.334529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337588+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:17.337588+0000","last_peered":"2023-10-08T06:57:17.337588+0000","last_clean":"2023-10-08T06:57:17.337588+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:17.337588+0000","last_undegraded":"2023-10-08T06:57:17.337588+0000","last_fullsized":"2023-10-08T06:57:17.337588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.343360+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:17.343360+0000","last_peered":"2023-10-08T06:57:17.343360+0000","last_clean":"2023-10-08T06:57:17.343360+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:17.343360+0000","last_undegraded":"2023-10-08T06:57:17.343360+0000","last_fullsized":"2023-10-08T06:57:17.343360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:22:54.351647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331590+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.331590+0000","last_peered":"2023-10-08T06:57:18.331590+0000","last_clean":"2023-10-08T06:57:18.331590+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.331590+0000","last_undegraded":"2023-10-08T06:57:18.331590+0000","last_fullsized":"2023-10-08T06:57:18.331590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332180+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.332180+0000","last_peered":"2023-10-08T06:57:18.332180+0000","last_clean":"2023-10-08T06:57:18.332180+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.332180+0000","last_undegraded":"2023-10-08T06:57:18.332180+0000","last_fullsized":"2023-10-08T06:57:18.332180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331115+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.331115+0000","last_peered":"2023-10-08T06:57:18.331115+0000","last_clean":"2023-10-08T06:57:18.331115+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.331115+0000","last_undegraded":"2023-10-08T06:57:18.331115+0000","last_fullsized":"2023-10-08T06:57:18.331115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337985+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:17.337985+0000","last_peered":"2023-10-08T06:57:17.337985+0000","last_clean":"2023-10-08T06:57:17.337985+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:17.337985+0000","last_undegraded":"2023-10-08T06:57:17.337985+0000","last_fullsized":"2023-10-08T06:57:17.337985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:01.072616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332324+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.332324+0000","last_peered":"2023-10-08T06:57:18.332324+0000","last_clean":"2023-10-08T06:57:18.332324+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.332324+0000","last_undegraded":"2023-10-08T06:57:18.332324+0000","last_fullsized":"2023-10-08T06:57:18.332324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331371+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.331371+0000","last_peered":"2023-10-08T06:57:18.331371+0000","last_clean":"2023-10-08T06:57:18.331371+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.331371+0000","last_undegraded":"2023-10-08T06:57:18.331371+0000","last_fullsized":"2023-10-08T06:57:18.331371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334291+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.334291+0000","last_peered":"2023-10-08T06:57:18.334291+0000","last_clean":"2023-10-08T06:57:18.334291+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.334291+0000","last_undegraded":"2023-10-08T06:57:18.334291+0000","last_fullsized":"2023-10-08T06:57:18.334291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331763+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.331763+0000","last_peered":"2023-10-08T06:57:18.331763+0000","last_clean":"2023-10-08T06:57:18.331763+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.331763+0000","last_undegraded":"2023-10-08T06:57:18.331763+0000","last_fullsized":"2023-10-08T06:57:18.331763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.342813+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:17.342813+0000","last_peered":"2023-10-08T06:57:17.342813+0000","last_clean":"2023-10-08T06:57:17.342813+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:17.342813+0000","last_undegraded":"2023-10-08T06:57:17.342813+0000","last_fullsized":"2023-10-08T06:57:17.342813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331669+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.331669+0000","last_peered":"2023-10-08T06:57:18.331669+0000","last_clean":"2023-10-08T06:57:18.331669+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.331669+0000","last_undegraded":"2023-10-08T06:57:18.331669+0000","last_fullsized":"2023-10-08T06:57:18.331669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334290+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.334290+0000","last_peered":"2023-10-08T06:57:18.334290+0000","last_clean":"2023-10-08T06:57:18.334290+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.334290+0000","last_undegraded":"2023-10-08T06:57:18.334290+0000","last_fullsized":"2023-10-08T06:57:18.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334365+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.334365+0000","last_peered":"2023-10-08T06:57:18.334365+0000","last_clean":"2023-10-08T06:57:18.334365+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.334365+0000","last_undegraded":"2023-10-08T06:57:18.334365+0000","last_fullsized":"2023-10-08T06:57:18.334365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334237+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.334237+0000","last_peered":"2023-10-08T06:57:18.334237+0000","last_clean":"2023-10-08T06:57:18.334237+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.334237+0000","last_undegraded":"2023-10-08T06:57:18.334237+0000","last_fullsized":"2023-10-08T06:57:18.334237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337479+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:17.337479+0000","last_peered":"2023-10-08T06:57:17.337479+0000","last_clean":"2023-10-08T06:57:17.337479+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:17.337479+0000","last_undegraded":"2023-10-08T06:57:17.337479+0000","last_fullsized":"2023-10-08T06:57:17.337479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:04.784122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331687+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.331687+0000","last_peered":"2023-10-08T06:57:18.331687+0000","last_clean":"2023-10-08T06:57:18.331687+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.331687+0000","last_undegraded":"2023-10-08T06:57:18.331687+0000","last_fullsized":"2023-10-08T06:57:18.331687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333407+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:17.333407+0000","last_peered":"2023-10-08T06:57:17.333407+0000","last_clean":"2023-10-08T06:57:17.333407+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:17.333407+0000","last_undegraded":"2023-10-08T06:57:17.333407+0000","last_fullsized":"2023-10-08T06:57:17.333407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:07.482027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.326308+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:17.326308+0000","last_peered":"2023-10-08T06:57:17.326308+0000","last_clean":"2023-10-08T06:57:17.326308+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:17.326308+0000","last_undegraded":"2023-10-08T06:57:17.326308+0000","last_fullsized":"2023-10-08T06:57:17.326308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332284+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.332284+0000","last_peered":"2023-10-08T06:57:18.332284+0000","last_clean":"2023-10-08T06:57:18.332284+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.332284+0000","last_undegraded":"2023-10-08T06:57:18.332284+0000","last_fullsized":"2023-10-08T06:57:18.332284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333778+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.333778+0000","last_peered":"2023-10-08T06:57:18.333778+0000","last_clean":"2023-10-08T06:57:18.333778+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.333778+0000","last_undegraded":"2023-10-08T06:57:18.333778+0000","last_fullsized":"2023-10-08T06:57:18.333778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332441+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.332441+0000","last_peered":"2023-10-08T06:57:18.332441+0000","last_clean":"2023-10-08T06:57:18.332441+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.332441+0000","last_undegraded":"2023-10-08T06:57:18.332441+0000","last_fullsized":"2023-10-08T06:57:18.332441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334724+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.334724+0000","last_peered":"2023-10-08T06:57:18.334724+0000","last_clean":"2023-10-08T06:57:18.334724+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.334724+0000","last_undegraded":"2023-10-08T06:57:18.334724+0000","last_fullsized":"2023-10-08T06:57:18.334724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.343002+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:17.343002+0000","last_peered":"2023-10-08T06:57:17.343002+0000","last_clean":"2023-10-08T06:57:17.343002+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:17.343002+0000","last_undegraded":"2023-10-08T06:57:17.343002+0000","last_fullsized":"2023-10-08T06:57:17.343002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:09.797173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.342090+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:17.342090+0000","last_peered":"2023-10-08T06:57:17.342090+0000","last_clean":"2023-10-08T06:57:17.342090+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:17.342090+0000","last_undegraded":"2023-10-08T06:57:17.342090+0000","last_fullsized":"2023-10-08T06:57:17.342090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333840+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:17.333840+0000","last_peered":"2023-10-08T06:57:17.333840+0000","last_clean":"2023-10-08T06:57:17.333840+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:17.333840+0000","last_undegraded":"2023-10-08T06:57:17.333840+0000","last_fullsized":"2023-10-08T06:57:17.333840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:52.594257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334506+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.334506+0000","last_peered":"2023-10-08T06:57:18.334506+0000","last_clean":"2023-10-08T06:57:18.334506+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.334506+0000","last_undegraded":"2023-10-08T06:57:18.334506+0000","last_fullsized":"2023-10-08T06:57:18.334506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334249+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.334249+0000","last_peered":"2023-10-08T06:57:18.334249+0000","last_clean":"2023-10-08T06:57:18.334249+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.334249+0000","last_undegraded":"2023-10-08T06:57:18.334249+0000","last_fullsized":"2023-10-08T06:57:18.334249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333896+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.333896+0000","last_peered":"2023-10-08T06:57:18.333896+0000","last_clean":"2023-10-08T06:57:18.333896+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.333896+0000","last_undegraded":"2023-10-08T06:57:18.333896+0000","last_fullsized":"2023-10-08T06:57:18.333896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332051+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.332051+0000","last_peered":"2023-10-08T06:57:18.332051+0000","last_clean":"2023-10-08T06:57:18.332051+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.332051+0000","last_undegraded":"2023-10-08T06:57:18.332051+0000","last_fullsized":"2023-10-08T06:57:18.332051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331427+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.331427+0000","last_peered":"2023-10-08T06:57:18.331427+0000","last_clean":"2023-10-08T06:57:18.331427+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.331427+0000","last_undegraded":"2023-10-08T06:57:18.331427+0000","last_fullsized":"2023-10-08T06:57:18.331427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334184+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.334184+0000","last_peered":"2023-10-08T06:57:18.334184+0000","last_clean":"2023-10-08T06:57:18.334184+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.334184+0000","last_undegraded":"2023-10-08T06:57:18.334184+0000","last_fullsized":"2023-10-08T06:57:18.334184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333798+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.333798+0000","last_peered":"2023-10-08T06:57:18.333798+0000","last_clean":"2023-10-08T06:57:18.333798+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.333798+0000","last_undegraded":"2023-10-08T06:57:18.333798+0000","last_fullsized":"2023-10-08T06:57:18.333798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334844+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.334844+0000","last_peered":"2023-10-08T06:57:18.334844+0000","last_clean":"2023-10-08T06:57:18.334844+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.334844+0000","last_undegraded":"2023-10-08T06:57:18.334844+0000","last_fullsized":"2023-10-08T06:57:18.334844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.325187+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:17.325187+0000","last_peered":"2023-10-08T06:57:17.325187+0000","last_clean":"2023-10-08T06:57:17.325187+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:17.325187+0000","last_undegraded":"2023-10-08T06:57:17.325187+0000","last_fullsized":"2023-10-08T06:57:17.325187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334527+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.334527+0000","last_peered":"2023-10-08T06:57:18.334527+0000","last_clean":"2023-10-08T06:57:18.334527+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.334527+0000","last_undegraded":"2023-10-08T06:57:18.334527+0000","last_fullsized":"2023-10-08T06:57:18.334527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322986+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:17.322986+0000","last_peered":"2023-10-08T06:57:17.322986+0000","last_clean":"2023-10-08T06:57:17.322986+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:17.322986+0000","last_undegraded":"2023-10-08T06:57:17.322986+0000","last_fullsized":"2023-10-08T06:57:17.322986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332280+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.332280+0000","last_peered":"2023-10-08T06:57:18.332280+0000","last_clean":"2023-10-08T06:57:18.332280+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.332280+0000","last_undegraded":"2023-10-08T06:57:18.332280+0000","last_fullsized":"2023-10-08T06:57:18.332280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322034+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:17.322034+0000","last_peered":"2023-10-08T06:57:17.322034+0000","last_clean":"2023-10-08T06:57:17.322034+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:17.322034+0000","last_undegraded":"2023-10-08T06:57:17.322034+0000","last_fullsized":"2023-10-08T06:57:17.322034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334630+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.334630+0000","last_peered":"2023-10-08T06:57:18.334630+0000","last_clean":"2023-10-08T06:57:18.334630+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.334630+0000","last_undegraded":"2023-10-08T06:57:18.334630+0000","last_fullsized":"2023-10-08T06:57:18.334630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338538+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:17.338538+0000","last_peered":"2023-10-08T06:57:17.338538+0000","last_clean":"2023-10-08T06:57:17.338538+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:17.338538+0000","last_undegraded":"2023-10-08T06:57:17.338538+0000","last_fullsized":"2023-10-08T06:57:17.338538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:09.833019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329398+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:17.329398+0000","last_peered":"2023-10-08T06:57:17.329398+0000","last_clean":"2023-10-08T06:57:17.329398+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:17.329398+0000","last_undegraded":"2023-10-08T06:57:17.329398+0000","last_fullsized":"2023-10-08T06:57:17.329398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334137+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.334137+0000","last_peered":"2023-10-08T06:57:18.334137+0000","last_clean":"2023-10-08T06:57:18.334137+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.334137+0000","last_undegraded":"2023-10-08T06:57:18.334137+0000","last_fullsized":"2023-10-08T06:57:18.334137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332274+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.332274+0000","last_peered":"2023-10-08T06:57:18.332274+0000","last_clean":"2023-10-08T06:57:18.332274+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.332274+0000","last_undegraded":"2023-10-08T06:57:18.332274+0000","last_fullsized":"2023-10-08T06:57:18.332274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.321071+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:17.321071+0000","last_peered":"2023-10-08T06:57:17.321071+0000","last_clean":"2023-10-08T06:57:17.321071+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:17.321071+0000","last_undegraded":"2023-10-08T06:57:17.321071+0000","last_fullsized":"2023-10-08T06:57:17.321071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322534+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:17.322534+0000","last_peered":"2023-10-08T06:57:17.322534+0000","last_clean":"2023-10-08T06:57:17.322534+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:17.322534+0000","last_undegraded":"2023-10-08T06:57:17.322534+0000","last_fullsized":"2023-10-08T06:57:17.322534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332451+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.332451+0000","last_peered":"2023-10-08T06:57:18.332451+0000","last_clean":"2023-10-08T06:57:18.332451+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.332451+0000","last_undegraded":"2023-10-08T06:57:18.332451+0000","last_fullsized":"2023-10-08T06:57:18.332451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330319+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:17.330319+0000","last_peered":"2023-10-08T06:57:17.330319+0000","last_clean":"2023-10-08T06:57:17.330319+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:17.330319+0000","last_undegraded":"2023-10-08T06:57:17.330319+0000","last_fullsized":"2023-10-08T06:57:17.330319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329262+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:17.329262+0000","last_peered":"2023-10-08T06:57:17.329262+0000","last_clean":"2023-10-08T06:57:17.329262+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:17.329262+0000","last_undegraded":"2023-10-08T06:57:17.329262+0000","last_fullsized":"2023-10-08T06:57:17.329262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331430+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.331430+0000","last_peered":"2023-10-08T06:57:18.331430+0000","last_clean":"2023-10-08T06:57:18.331430+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.331430+0000","last_undegraded":"2023-10-08T06:57:18.331430+0000","last_fullsized":"2023-10-08T06:57:18.331430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334793+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.334793+0000","last_peered":"2023-10-08T06:57:18.334793+0000","last_clean":"2023-10-08T06:57:18.334793+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.334793+0000","last_undegraded":"2023-10-08T06:57:18.334793+0000","last_fullsized":"2023-10-08T06:57:18.334793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330138+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:17.330138+0000","last_peered":"2023-10-08T06:57:17.330138+0000","last_clean":"2023-10-08T06:57:17.330138+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:17.330138+0000","last_undegraded":"2023-10-08T06:57:17.330138+0000","last_fullsized":"2023-10-08T06:57:17.330138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331051+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.331051+0000","last_peered":"2023-10-08T06:57:18.331051+0000","last_clean":"2023-10-08T06:57:18.331051+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.331051+0000","last_undegraded":"2023-10-08T06:57:18.331051+0000","last_fullsized":"2023-10-08T06:57:18.331051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333299+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:17.333299+0000","last_peered":"2023-10-08T06:57:17.333299+0000","last_clean":"2023-10-08T06:57:17.333299+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:17.333299+0000","last_undegraded":"2023-10-08T06:57:17.333299+0000","last_fullsized":"2023-10-08T06:57:17.333299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:02.772522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T06:57:16.318161+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:16.318161+0000","last_peered":"2023-10-08T06:57:16.318161+0000","last_clean":"2023-10-08T06:57:16.318161+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:16.318161+0000","last_undegraded":"2023-10-08T06:57:16.318161+0000","last_fullsized":"2023-10-08T06:57:16.318161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332015+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.332015+0000","last_peered":"2023-10-08T06:57:18.332015+0000","last_clean":"2023-10-08T06:57:18.332015+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.332015+0000","last_undegraded":"2023-10-08T06:57:18.332015+0000","last_fullsized":"2023-10-08T06:57:18.332015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338555+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:17.338555+0000","last_peered":"2023-10-08T06:57:17.338555+0000","last_clean":"2023-10-08T06:57:17.338555+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:17.338555+0000","last_undegraded":"2023-10-08T06:57:17.338555+0000","last_fullsized":"2023-10-08T06:57:17.338555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:57.316540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332004+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.332004+0000","last_peered":"2023-10-08T06:57:18.332004+0000","last_clean":"2023-10-08T06:57:18.332004+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.332004+0000","last_undegraded":"2023-10-08T06:57:18.332004+0000","last_fullsized":"2023-10-08T06:57:18.332004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.323142+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:17.323142+0000","last_peered":"2023-10-08T06:57:17.323142+0000","last_clean":"2023-10-08T06:57:17.323142+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:17.323142+0000","last_undegraded":"2023-10-08T06:57:17.323142+0000","last_fullsized":"2023-10-08T06:57:17.323142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.330989+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.330989+0000","last_peered":"2023-10-08T06:57:18.330989+0000","last_clean":"2023-10-08T06:57:18.330989+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.330989+0000","last_undegraded":"2023-10-08T06:57:18.330989+0000","last_fullsized":"2023-10-08T06:57:18.330989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.331023+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:17.331023+0000","last_peered":"2023-10-08T06:57:17.331023+0000","last_clean":"2023-10-08T06:57:17.331023+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:17.331023+0000","last_undegraded":"2023-10-08T06:57:17.331023+0000","last_fullsized":"2023-10-08T06:57:17.331023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331904+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:18.331904+0000","last_peered":"2023-10-08T06:57:18.331904+0000","last_clean":"2023-10-08T06:57:18.331904+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:18.331904+0000","last_undegraded":"2023-10-08T06:57:18.331904+0000","last_fullsized":"2023-10-08T06:57:18.331904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.334452+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:17.334452+0000","last_peered":"2023-10-08T06:57:17.334452+0000","last_clean":"2023-10-08T06:57:17.334452+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:17.334452+0000","last_undegraded":"2023-10-08T06:57:17.334452+0000","last_fullsized":"2023-10-08T06:57:17.334452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:07:32.156268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.341846+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:17.341846+0000","last_peered":"2023-10-08T06:57:17.341846+0000","last_clean":"2023-10-08T06:57:17.341846+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:17.341846+0000","last_undegraded":"2023-10-08T06:57:17.341846+0000","last_fullsized":"2023-10-08T06:57:17.341846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.335779+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:17.335779+0000","last_peered":"2023-10-08T06:57:17.335779+0000","last_clean":"2023-10-08T06:57:17.335779+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:17.335779+0000","last_undegraded":"2023-10-08T06:57:17.335779+0000","last_fullsized":"2023-10-08T06:57:17.335779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:46.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334243+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.334243+0000","last_peered":"2023-10-08T06:57:18.334243+0000","last_clean":"2023-10-08T06:57:18.334243+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.334243+0000","last_undegraded":"2023-10-08T06:57:18.334243+0000","last_fullsized":"2023-10-08T06:57:18.334243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334062+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.334062+0000","last_peered":"2023-10-08T06:57:18.334062+0000","last_clean":"2023-10-08T06:57:18.334062+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.334062+0000","last_undegraded":"2023-10-08T06:57:18.334062+0000","last_fullsized":"2023-10-08T06:57:18.334062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.342752+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:17.342752+0000","last_peered":"2023-10-08T06:57:17.342752+0000","last_clean":"2023-10-08T06:57:17.342752+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:17.342752+0000","last_undegraded":"2023-10-08T06:57:17.342752+0000","last_fullsized":"2023-10-08T06:57:17.342752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333951+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.333951+0000","last_peered":"2023-10-08T06:57:18.333951+0000","last_clean":"2023-10-08T06:57:18.333951+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.333951+0000","last_undegraded":"2023-10-08T06:57:18.333951+0000","last_fullsized":"2023-10-08T06:57:18.333951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332288+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.332288+0000","last_peered":"2023-10-08T06:57:18.332288+0000","last_clean":"2023-10-08T06:57:18.332288+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.332288+0000","last_undegraded":"2023-10-08T06:57:18.332288+0000","last_fullsized":"2023-10-08T06:57:18.332288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.332598+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:17.332598+0000","last_peered":"2023-10-08T06:57:17.332598+0000","last_clean":"2023-10-08T06:57:17.332598+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:17.332598+0000","last_undegraded":"2023-10-08T06:57:17.332598+0000","last_fullsized":"2023-10-08T06:57:17.332598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:46.357149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332218+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.332218+0000","last_peered":"2023-10-08T06:57:18.332218+0000","last_clean":"2023-10-08T06:57:18.332218+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.332218+0000","last_undegraded":"2023-10-08T06:57:18.332218+0000","last_fullsized":"2023-10-08T06:57:18.332218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334155+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.334155+0000","last_peered":"2023-10-08T06:57:18.334155+0000","last_clean":"2023-10-08T06:57:18.334155+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.334155+0000","last_undegraded":"2023-10-08T06:57:18.334155+0000","last_fullsized":"2023-10-08T06:57:18.334155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333744+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.333744+0000","last_peered":"2023-10-08T06:57:18.333744+0000","last_clean":"2023-10-08T06:57:18.333744+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.333744+0000","last_undegraded":"2023-10-08T06:57:18.333744+0000","last_fullsized":"2023-10-08T06:57:18.333744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331439+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.331439+0000","last_peered":"2023-10-08T06:57:18.331439+0000","last_clean":"2023-10-08T06:57:18.331439+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.331439+0000","last_undegraded":"2023-10-08T06:57:18.331439+0000","last_fullsized":"2023-10-08T06:57:18.331439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338011+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:17.338011+0000","last_peered":"2023-10-08T06:57:17.338011+0000","last_clean":"2023-10-08T06:57:17.338011+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:17.338011+0000","last_undegraded":"2023-10-08T06:57:17.338011+0000","last_fullsized":"2023-10-08T06:57:17.338011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:37.096975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331729+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.331729+0000","last_peered":"2023-10-08T06:57:18.331729+0000","last_clean":"2023-10-08T06:57:18.331729+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.331729+0000","last_undegraded":"2023-10-08T06:57:18.331729+0000","last_fullsized":"2023-10-08T06:57:18.331729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338412+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:17.338412+0000","last_peered":"2023-10-08T06:57:17.338412+0000","last_clean":"2023-10-08T06:57:17.338412+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:17.338412+0000","last_undegraded":"2023-10-08T06:57:17.338412+0000","last_fullsized":"2023-10-08T06:57:17.338412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:31:40.652306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":650475,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":645256,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:21.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:21.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:21.854 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:21.864 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T06:57:20.943183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81716,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033804,"statfs":{"total":289910292480,"available":289826615296,"internally_reserved":0,"allocated":663552,"data_stored":1354044,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.638065"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337861+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:17.337861+0000","last_peered":"2023-10-08T06:57:17.337861+0000","last_clean":"2023-10-08T06:57:17.337861+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:17.337861+0000","last_undegraded":"2023-10-08T06:57:17.337861+0000","last_fullsized":"2023-10-08T06:57:17.337861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:34.090520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337402+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:17.337402+0000","last_peered":"2023-10-08T06:57:17.337402+0000","last_clean":"2023-10-08T06:57:17.337402+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:17.337402+0000","last_undegraded":"2023-10-08T06:57:17.337402+0000","last_fullsized":"2023-10-08T06:57:17.337402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:25:32.722947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334697+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.334697+0000","last_peered":"2023-10-08T06:57:18.334697+0000","last_clean":"2023-10-08T06:57:18.334697+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.334697+0000","last_undegraded":"2023-10-08T06:57:18.334697+0000","last_fullsized":"2023-10-08T06:57:18.334697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334477+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.334477+0000","last_peered":"2023-10-08T06:57:18.334477+0000","last_clean":"2023-10-08T06:57:18.334477+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.334477+0000","last_undegraded":"2023-10-08T06:57:18.334477+0000","last_fullsized":"2023-10-08T06:57:18.334477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337637+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:17.337637+0000","last_peered":"2023-10-08T06:57:17.337637+0000","last_clean":"2023-10-08T06:57:17.337637+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:17.337637+0000","last_undegraded":"2023-10-08T06:57:17.337637+0000","last_fullsized":"2023-10-08T06:57:17.337637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:17.019299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333757+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.333757+0000","last_peered":"2023-10-08T06:57:18.333757+0000","last_clean":"2023-10-08T06:57:18.333757+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.333757+0000","last_undegraded":"2023-10-08T06:57:18.333757+0000","last_fullsized":"2023-10-08T06:57:18.333757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333585+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.333585+0000","last_peered":"2023-10-08T06:57:18.333585+0000","last_clean":"2023-10-08T06:57:18.333585+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.333585+0000","last_undegraded":"2023-10-08T06:57:18.333585+0000","last_fullsized":"2023-10-08T06:57:18.333585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333429+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.333429+0000","last_peered":"2023-10-08T06:57:18.333429+0000","last_clean":"2023-10-08T06:57:18.333429+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.333429+0000","last_undegraded":"2023-10-08T06:57:18.333429+0000","last_fullsized":"2023-10-08T06:57:18.333429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331881+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.331881+0000","last_peered":"2023-10-08T06:57:18.331881+0000","last_clean":"2023-10-08T06:57:18.331881+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.331881+0000","last_undegraded":"2023-10-08T06:57:18.331881+0000","last_fullsized":"2023-10-08T06:57:18.331881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.334107+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:17.334107+0000","last_peered":"2023-10-08T06:57:17.334107+0000","last_clean":"2023-10-08T06:57:17.334107+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:17.334107+0000","last_undegraded":"2023-10-08T06:57:17.334107+0000","last_fullsized":"2023-10-08T06:57:17.334107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:20.427267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334400+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.334400+0000","last_peered":"2023-10-08T06:57:18.334400+0000","last_clean":"2023-10-08T06:57:18.334400+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.334400+0000","last_undegraded":"2023-10-08T06:57:18.334400+0000","last_fullsized":"2023-10-08T06:57:18.334400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338455+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:17.338455+0000","last_peered":"2023-10-08T06:57:17.338455+0000","last_clean":"2023-10-08T06:57:17.338455+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:17.338455+0000","last_undegraded":"2023-10-08T06:57:17.338455+0000","last_fullsized":"2023-10-08T06:57:17.338455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:56.506185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337619+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:17.337619+0000","last_peered":"2023-10-08T06:57:17.337619+0000","last_clean":"2023-10-08T06:57:17.337619+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:17.337619+0000","last_undegraded":"2023-10-08T06:57:17.337619+0000","last_fullsized":"2023-10-08T06:57:17.337619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:35.829713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334425+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.334425+0000","last_peered":"2023-10-08T06:57:18.334425+0000","last_clean":"2023-10-08T06:57:18.334425+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.334425+0000","last_undegraded":"2023-10-08T06:57:18.334425+0000","last_fullsized":"2023-10-08T06:57:18.334425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333883+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.333883+0000","last_peered":"2023-10-08T06:57:18.333883+0000","last_clean":"2023-10-08T06:57:18.333883+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.333883+0000","last_undegraded":"2023-10-08T06:57:18.333883+0000","last_fullsized":"2023-10-08T06:57:18.333883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333504+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.333504+0000","last_peered":"2023-10-08T06:57:18.333504+0000","last_clean":"2023-10-08T06:57:18.333504+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.333504+0000","last_undegraded":"2023-10-08T06:57:18.333504+0000","last_fullsized":"2023-10-08T06:57:18.333504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331981+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.331981+0000","last_peered":"2023-10-08T06:57:18.331981+0000","last_clean":"2023-10-08T06:57:18.331981+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.331981+0000","last_undegraded":"2023-10-08T06:57:18.331981+0000","last_fullsized":"2023-10-08T06:57:18.331981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333653+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:17.333653+0000","last_peered":"2023-10-08T06:57:17.333653+0000","last_clean":"2023-10-08T06:57:17.333653+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:17.333653+0000","last_undegraded":"2023-10-08T06:57:17.333653+0000","last_fullsized":"2023-10-08T06:57:17.333653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.658648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331998+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.331998+0000","last_peered":"2023-10-08T06:57:18.331998+0000","last_clean":"2023-10-08T06:57:18.331998+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.331998+0000","last_undegraded":"2023-10-08T06:57:18.331998+0000","last_fullsized":"2023-10-08T06:57:18.331998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334495+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.334495+0000","last_peered":"2023-10-08T06:57:18.334495+0000","last_clean":"2023-10-08T06:57:18.334495+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.334495+0000","last_undegraded":"2023-10-08T06:57:18.334495+0000","last_fullsized":"2023-10-08T06:57:18.334495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333990+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.333990+0000","last_peered":"2023-10-08T06:57:18.333990+0000","last_clean":"2023-10-08T06:57:18.333990+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.333990+0000","last_undegraded":"2023-10-08T06:57:18.333990+0000","last_fullsized":"2023-10-08T06:57:18.333990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338512+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:17.338512+0000","last_peered":"2023-10-08T06:57:17.338512+0000","last_clean":"2023-10-08T06:57:17.338512+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:17.338512+0000","last_undegraded":"2023-10-08T06:57:17.338512+0000","last_fullsized":"2023-10-08T06:57:17.338512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:58.091507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331586+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.331586+0000","last_peered":"2023-10-08T06:57:18.331586+0000","last_clean":"2023-10-08T06:57:18.331586+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.331586+0000","last_undegraded":"2023-10-08T06:57:18.331586+0000","last_fullsized":"2023-10-08T06:57:18.331586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333005+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:17.333005+0000","last_peered":"2023-10-08T06:57:17.333005+0000","last_clean":"2023-10-08T06:57:17.333005+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:17.333005+0000","last_undegraded":"2023-10-08T06:57:17.333005+0000","last_fullsized":"2023-10-08T06:57:17.333005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:00.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.334457+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:17.334457+0000","last_peered":"2023-10-08T06:57:17.334457+0000","last_clean":"2023-10-08T06:57:17.334457+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:17.334457+0000","last_undegraded":"2023-10-08T06:57:17.334457+0000","last_fullsized":"2023-10-08T06:57:17.334457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:57.239544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331941+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.331941+0000","last_peered":"2023-10-08T06:57:18.331941+0000","last_clean":"2023-10-08T06:57:18.331941+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.331941+0000","last_undegraded":"2023-10-08T06:57:18.331941+0000","last_fullsized":"2023-10-08T06:57:18.331941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334529+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.334529+0000","last_peered":"2023-10-08T06:57:18.334529+0000","last_clean":"2023-10-08T06:57:18.334529+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.334529+0000","last_undegraded":"2023-10-08T06:57:18.334529+0000","last_fullsized":"2023-10-08T06:57:18.334529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337588+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:17.337588+0000","last_peered":"2023-10-08T06:57:17.337588+0000","last_clean":"2023-10-08T06:57:17.337588+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:17.337588+0000","last_undegraded":"2023-10-08T06:57:17.337588+0000","last_fullsized":"2023-10-08T06:57:17.337588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.343360+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:17.343360+0000","last_peered":"2023-10-08T06:57:17.343360+0000","last_clean":"2023-10-08T06:57:17.343360+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:17.343360+0000","last_undegraded":"2023-10-08T06:57:17.343360+0000","last_fullsized":"2023-10-08T06:57:17.343360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:22:54.351647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331590+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.331590+0000","last_peered":"2023-10-08T06:57:18.331590+0000","last_clean":"2023-10-08T06:57:18.331590+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.331590+0000","last_undegraded":"2023-10-08T06:57:18.331590+0000","last_fullsized":"2023-10-08T06:57:18.331590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332180+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.332180+0000","last_peered":"2023-10-08T06:57:18.332180+0000","last_clean":"2023-10-08T06:57:18.332180+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.332180+0000","last_undegraded":"2023-10-08T06:57:18.332180+0000","last_fullsized":"2023-10-08T06:57:18.332180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331115+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.331115+0000","last_peered":"2023-10-08T06:57:18.331115+0000","last_clean":"2023-10-08T06:57:18.331115+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.331115+0000","last_undegraded":"2023-10-08T06:57:18.331115+0000","last_fullsized":"2023-10-08T06:57:18.331115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337985+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:17.337985+0000","last_peered":"2023-10-08T06:57:17.337985+0000","last_clean":"2023-10-08T06:57:17.337985+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:17.337985+0000","last_undegraded":"2023-10-08T06:57:17.337985+0000","last_fullsized":"2023-10-08T06:57:17.337985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:01.072616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332324+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.332324+0000","last_peered":"2023-10-08T06:57:18.332324+0000","last_clean":"2023-10-08T06:57:18.332324+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.332324+0000","last_undegraded":"2023-10-08T06:57:18.332324+0000","last_fullsized":"2023-10-08T06:57:18.332324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331371+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.331371+0000","last_peered":"2023-10-08T06:57:18.331371+0000","last_clean":"2023-10-08T06:57:18.331371+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.331371+0000","last_undegraded":"2023-10-08T06:57:18.331371+0000","last_fullsized":"2023-10-08T06:57:18.331371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334291+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.334291+0000","last_peered":"2023-10-08T06:57:18.334291+0000","last_clean":"2023-10-08T06:57:18.334291+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.334291+0000","last_undegraded":"2023-10-08T06:57:18.334291+0000","last_fullsized":"2023-10-08T06:57:18.334291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331763+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.331763+0000","last_peered":"2023-10-08T06:57:18.331763+0000","last_clean":"2023-10-08T06:57:18.331763+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.331763+0000","last_undegraded":"2023-10-08T06:57:18.331763+0000","last_fullsized":"2023-10-08T06:57:18.331763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.342813+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:17.342813+0000","last_peered":"2023-10-08T06:57:17.342813+0000","last_clean":"2023-10-08T06:57:17.342813+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:17.342813+0000","last_undegraded":"2023-10-08T06:57:17.342813+0000","last_fullsized":"2023-10-08T06:57:17.342813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331669+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.331669+0000","last_peered":"2023-10-08T06:57:18.331669+0000","last_clean":"2023-10-08T06:57:18.331669+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.331669+0000","last_undegraded":"2023-10-08T06:57:18.331669+0000","last_fullsized":"2023-10-08T06:57:18.331669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334290+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.334290+0000","last_peered":"2023-10-08T06:57:18.334290+0000","last_clean":"2023-10-08T06:57:18.334290+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.334290+0000","last_undegraded":"2023-10-08T06:57:18.334290+0000","last_fullsized":"2023-10-08T06:57:18.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334365+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.334365+0000","last_peered":"2023-10-08T06:57:18.334365+0000","last_clean":"2023-10-08T06:57:18.334365+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.334365+0000","last_undegraded":"2023-10-08T06:57:18.334365+0000","last_fullsized":"2023-10-08T06:57:18.334365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334237+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.334237+0000","last_peered":"2023-10-08T06:57:18.334237+0000","last_clean":"2023-10-08T06:57:18.334237+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.334237+0000","last_undegraded":"2023-10-08T06:57:18.334237+0000","last_fullsized":"2023-10-08T06:57:18.334237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.337479+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:17.337479+0000","last_peered":"2023-10-08T06:57:17.337479+0000","last_clean":"2023-10-08T06:57:17.337479+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:17.337479+0000","last_undegraded":"2023-10-08T06:57:17.337479+0000","last_fullsized":"2023-10-08T06:57:17.337479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:04.784122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331687+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.331687+0000","last_peered":"2023-10-08T06:57:18.331687+0000","last_clean":"2023-10-08T06:57:18.331687+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.331687+0000","last_undegraded":"2023-10-08T06:57:18.331687+0000","last_fullsized":"2023-10-08T06:57:18.331687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333407+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:17.333407+0000","last_peered":"2023-10-08T06:57:17.333407+0000","last_clean":"2023-10-08T06:57:17.333407+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:17.333407+0000","last_undegraded":"2023-10-08T06:57:17.333407+0000","last_fullsized":"2023-10-08T06:57:17.333407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:07.482027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.326308+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:17.326308+0000","last_peered":"2023-10-08T06:57:17.326308+0000","last_clean":"2023-10-08T06:57:17.326308+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:17.326308+0000","last_undegraded":"2023-10-08T06:57:17.326308+0000","last_fullsized":"2023-10-08T06:57:17.326308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332284+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.332284+0000","last_peered":"2023-10-08T06:57:18.332284+0000","last_clean":"2023-10-08T06:57:18.332284+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.332284+0000","last_undegraded":"2023-10-08T06:57:18.332284+0000","last_fullsized":"2023-10-08T06:57:18.332284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333778+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.333778+0000","last_peered":"2023-10-08T06:57:18.333778+0000","last_clean":"2023-10-08T06:57:18.333778+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.333778+0000","last_undegraded":"2023-10-08T06:57:18.333778+0000","last_fullsized":"2023-10-08T06:57:18.333778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332441+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.332441+0000","last_peered":"2023-10-08T06:57:18.332441+0000","last_clean":"2023-10-08T06:57:18.332441+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.332441+0000","last_undegraded":"2023-10-08T06:57:18.332441+0000","last_fullsized":"2023-10-08T06:57:18.332441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334724+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.334724+0000","last_peered":"2023-10-08T06:57:18.334724+0000","last_clean":"2023-10-08T06:57:18.334724+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.334724+0000","last_undegraded":"2023-10-08T06:57:18.334724+0000","last_fullsized":"2023-10-08T06:57:18.334724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.343002+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:17.343002+0000","last_peered":"2023-10-08T06:57:17.343002+0000","last_clean":"2023-10-08T06:57:17.343002+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:17.343002+0000","last_undegraded":"2023-10-08T06:57:17.343002+0000","last_fullsized":"2023-10-08T06:57:17.343002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:09.797173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.342090+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:17.342090+0000","last_peered":"2023-10-08T06:57:17.342090+0000","last_clean":"2023-10-08T06:57:17.342090+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:17.342090+0000","last_undegraded":"2023-10-08T06:57:17.342090+0000","last_fullsized":"2023-10-08T06:57:17.342090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333840+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:17.333840+0000","last_peered":"2023-10-08T06:57:17.333840+0000","last_clean":"2023-10-08T06:57:17.333840+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:17.333840+0000","last_undegraded":"2023-10-08T06:57:17.333840+0000","last_fullsized":"2023-10-08T06:57:17.333840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:52.594257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334506+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.334506+0000","last_peered":"2023-10-08T06:57:18.334506+0000","last_clean":"2023-10-08T06:57:18.334506+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.334506+0000","last_undegraded":"2023-10-08T06:57:18.334506+0000","last_fullsized":"2023-10-08T06:57:18.334506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334249+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.334249+0000","last_peered":"2023-10-08T06:57:18.334249+0000","last_clean":"2023-10-08T06:57:18.334249+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.334249+0000","last_undegraded":"2023-10-08T06:57:18.334249+0000","last_fullsized":"2023-10-08T06:57:18.334249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333896+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.333896+0000","last_peered":"2023-10-08T06:57:18.333896+0000","last_clean":"2023-10-08T06:57:18.333896+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.333896+0000","last_undegraded":"2023-10-08T06:57:18.333896+0000","last_fullsized":"2023-10-08T06:57:18.333896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332051+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.332051+0000","last_peered":"2023-10-08T06:57:18.332051+0000","last_clean":"2023-10-08T06:57:18.332051+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.332051+0000","last_undegraded":"2023-10-08T06:57:18.332051+0000","last_fullsized":"2023-10-08T06:57:18.332051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331427+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.331427+0000","last_peered":"2023-10-08T06:57:18.331427+0000","last_clean":"2023-10-08T06:57:18.331427+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.331427+0000","last_undegraded":"2023-10-08T06:57:18.331427+0000","last_fullsized":"2023-10-08T06:57:18.331427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334184+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.334184+0000","last_peered":"2023-10-08T06:57:18.334184+0000","last_clean":"2023-10-08T06:57:18.334184+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.334184+0000","last_undegraded":"2023-10-08T06:57:18.334184+0000","last_fullsized":"2023-10-08T06:57:18.334184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333798+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.333798+0000","last_peered":"2023-10-08T06:57:18.333798+0000","last_clean":"2023-10-08T06:57:18.333798+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.333798+0000","last_undegraded":"2023-10-08T06:57:18.333798+0000","last_fullsized":"2023-10-08T06:57:18.333798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334844+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.334844+0000","last_peered":"2023-10-08T06:57:18.334844+0000","last_clean":"2023-10-08T06:57:18.334844+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.334844+0000","last_undegraded":"2023-10-08T06:57:18.334844+0000","last_fullsized":"2023-10-08T06:57:18.334844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.325187+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:17.325187+0000","last_peered":"2023-10-08T06:57:17.325187+0000","last_clean":"2023-10-08T06:57:17.325187+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:17.325187+0000","last_undegraded":"2023-10-08T06:57:17.325187+0000","last_fullsized":"2023-10-08T06:57:17.325187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334527+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.334527+0000","last_peered":"2023-10-08T06:57:18.334527+0000","last_clean":"2023-10-08T06:57:18.334527+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.334527+0000","last_undegraded":"2023-10-08T06:57:18.334527+0000","last_fullsized":"2023-10-08T06:57:18.334527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322986+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:17.322986+0000","last_peered":"2023-10-08T06:57:17.322986+0000","last_clean":"2023-10-08T06:57:17.322986+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:17.322986+0000","last_undegraded":"2023-10-08T06:57:17.322986+0000","last_fullsized":"2023-10-08T06:57:17.322986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332280+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.332280+0000","last_peered":"2023-10-08T06:57:18.332280+0000","last_clean":"2023-10-08T06:57:18.332280+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.332280+0000","last_undegraded":"2023-10-08T06:57:18.332280+0000","last_fullsized":"2023-10-08T06:57:18.332280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322034+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:17.322034+0000","last_peered":"2023-10-08T06:57:17.322034+0000","last_clean":"2023-10-08T06:57:17.322034+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:17.322034+0000","last_undegraded":"2023-10-08T06:57:17.322034+0000","last_fullsized":"2023-10-08T06:57:17.322034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334630+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.334630+0000","last_peered":"2023-10-08T06:57:18.334630+0000","last_clean":"2023-10-08T06:57:18.334630+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.334630+0000","last_undegraded":"2023-10-08T06:57:18.334630+0000","last_fullsized":"2023-10-08T06:57:18.334630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338538+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:17.338538+0000","last_peered":"2023-10-08T06:57:17.338538+0000","last_clean":"2023-10-08T06:57:17.338538+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:17.338538+0000","last_undegraded":"2023-10-08T06:57:17.338538+0000","last_fullsized":"2023-10-08T06:57:17.338538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:09.833019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329398+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:17.329398+0000","last_peered":"2023-10-08T06:57:17.329398+0000","last_clean":"2023-10-08T06:57:17.329398+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:17.329398+0000","last_undegraded":"2023-10-08T06:57:17.329398+0000","last_fullsized":"2023-10-08T06:57:17.329398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334137+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.334137+0000","last_peered":"2023-10-08T06:57:18.334137+0000","last_clean":"2023-10-08T06:57:18.334137+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.334137+0000","last_undegraded":"2023-10-08T06:57:18.334137+0000","last_fullsized":"2023-10-08T06:57:18.334137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332274+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.332274+0000","last_peered":"2023-10-08T06:57:18.332274+0000","last_clean":"2023-10-08T06:57:18.332274+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.332274+0000","last_undegraded":"2023-10-08T06:57:18.332274+0000","last_fullsized":"2023-10-08T06:57:18.332274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.321071+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:17.321071+0000","last_peered":"2023-10-08T06:57:17.321071+0000","last_clean":"2023-10-08T06:57:17.321071+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:17.321071+0000","last_undegraded":"2023-10-08T06:57:17.321071+0000","last_fullsized":"2023-10-08T06:57:17.321071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322534+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:17.322534+0000","last_peered":"2023-10-08T06:57:17.322534+0000","last_clean":"2023-10-08T06:57:17.322534+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:17.322534+0000","last_undegraded":"2023-10-08T06:57:17.322534+0000","last_fullsized":"2023-10-08T06:57:17.322534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332451+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.332451+0000","last_peered":"2023-10-08T06:57:18.332451+0000","last_clean":"2023-10-08T06:57:18.332451+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.332451+0000","last_undegraded":"2023-10-08T06:57:18.332451+0000","last_fullsized":"2023-10-08T06:57:18.332451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330319+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:17.330319+0000","last_peered":"2023-10-08T06:57:17.330319+0000","last_clean":"2023-10-08T06:57:17.330319+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:17.330319+0000","last_undegraded":"2023-10-08T06:57:17.330319+0000","last_fullsized":"2023-10-08T06:57:17.330319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329262+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:17.329262+0000","last_peered":"2023-10-08T06:57:17.329262+0000","last_clean":"2023-10-08T06:57:17.329262+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:17.329262+0000","last_undegraded":"2023-10-08T06:57:17.329262+0000","last_fullsized":"2023-10-08T06:57:17.329262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331430+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.331430+0000","last_peered":"2023-10-08T06:57:18.331430+0000","last_clean":"2023-10-08T06:57:18.331430+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.331430+0000","last_undegraded":"2023-10-08T06:57:18.331430+0000","last_fullsized":"2023-10-08T06:57:18.331430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334793+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.334793+0000","last_peered":"2023-10-08T06:57:18.334793+0000","last_clean":"2023-10-08T06:57:18.334793+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.334793+0000","last_undegraded":"2023-10-08T06:57:18.334793+0000","last_fullsized":"2023-10-08T06:57:18.334793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330138+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:17.330138+0000","last_peered":"2023-10-08T06:57:17.330138+0000","last_clean":"2023-10-08T06:57:17.330138+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:17.330138+0000","last_undegraded":"2023-10-08T06:57:17.330138+0000","last_fullsized":"2023-10-08T06:57:17.330138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331051+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.331051+0000","last_peered":"2023-10-08T06:57:18.331051+0000","last_clean":"2023-10-08T06:57:18.331051+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.331051+0000","last_undegraded":"2023-10-08T06:57:18.331051+0000","last_fullsized":"2023-10-08T06:57:18.331051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.333299+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:17.333299+0000","last_peered":"2023-10-08T06:57:17.333299+0000","last_clean":"2023-10-08T06:57:17.333299+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:17.333299+0000","last_undegraded":"2023-10-08T06:57:17.333299+0000","last_fullsized":"2023-10-08T06:57:17.333299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:02.772522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T06:57:16.318161+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:16.318161+0000","last_peered":"2023-10-08T06:57:16.318161+0000","last_clean":"2023-10-08T06:57:16.318161+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:16.318161+0000","last_undegraded":"2023-10-08T06:57:16.318161+0000","last_fullsized":"2023-10-08T06:57:16.318161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332015+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.332015+0000","last_peered":"2023-10-08T06:57:18.332015+0000","last_clean":"2023-10-08T06:57:18.332015+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.332015+0000","last_undegraded":"2023-10-08T06:57:18.332015+0000","last_fullsized":"2023-10-08T06:57:18.332015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338555+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:17.338555+0000","last_peered":"2023-10-08T06:57:17.338555+0000","last_clean":"2023-10-08T06:57:17.338555+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:17.338555+0000","last_undegraded":"2023-10-08T06:57:17.338555+0000","last_fullsized":"2023-10-08T06:57:17.338555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:57.316540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332004+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.332004+0000","last_peered":"2023-10-08T06:57:18.332004+0000","last_clean":"2023-10-08T06:57:18.332004+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.332004+0000","last_undegraded":"2023-10-08T06:57:18.332004+0000","last_fullsized":"2023-10-08T06:57:18.332004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.323142+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:17.323142+0000","last_peered":"2023-10-08T06:57:17.323142+0000","last_clean":"2023-10-08T06:57:17.323142+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:17.323142+0000","last_undegraded":"2023-10-08T06:57:17.323142+0000","last_fullsized":"2023-10-08T06:57:17.323142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.330989+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.330989+0000","last_peered":"2023-10-08T06:57:18.330989+0000","last_clean":"2023-10-08T06:57:18.330989+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.330989+0000","last_undegraded":"2023-10-08T06:57:18.330989+0000","last_fullsized":"2023-10-08T06:57:18.330989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.331023+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:17.331023+0000","last_peered":"2023-10-08T06:57:17.331023+0000","last_clean":"2023-10-08T06:57:17.331023+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:17.331023+0000","last_undegraded":"2023-10-08T06:57:17.331023+0000","last_fullsized":"2023-10-08T06:57:17.331023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331904+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:18.331904+0000","last_peered":"2023-10-08T06:57:18.331904+0000","last_clean":"2023-10-08T06:57:18.331904+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:18.331904+0000","last_undegraded":"2023-10-08T06:57:18.331904+0000","last_fullsized":"2023-10-08T06:57:18.331904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.334452+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:17.334452+0000","last_peered":"2023-10-08T06:57:17.334452+0000","last_clean":"2023-10-08T06:57:17.334452+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:17.334452+0000","last_undegraded":"2023-10-08T06:57:17.334452+0000","last_fullsized":"2023-10-08T06:57:17.334452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:07:32.156268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.341846+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:17.341846+0000","last_peered":"2023-10-08T06:57:17.341846+0000","last_clean":"2023-10-08T06:57:17.341846+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:17.341846+0000","last_undegraded":"2023-10-08T06:57:17.341846+0000","last_fullsized":"2023-10-08T06:57:17.341846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.335779+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:17.335779+0000","last_peered":"2023-10-08T06:57:17.335779+0000","last_clean":"2023-10-08T06:57:17.335779+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:17.335779+0000","last_undegraded":"2023-10-08T06:57:17.335779+0000","last_fullsized":"2023-10-08T06:57:17.335779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:46.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334243+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.334243+0000","last_peered":"2023-10-08T06:57:18.334243+0000","last_clean":"2023-10-08T06:57:18.334243+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.334243+0000","last_undegraded":"2023-10-08T06:57:18.334243+0000","last_fullsized":"2023-10-08T06:57:18.334243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334062+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.334062+0000","last_peered":"2023-10-08T06:57:18.334062+0000","last_clean":"2023-10-08T06:57:18.334062+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.334062+0000","last_undegraded":"2023-10-08T06:57:18.334062+0000","last_fullsized":"2023-10-08T06:57:18.334062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.342752+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:17.342752+0000","last_peered":"2023-10-08T06:57:17.342752+0000","last_clean":"2023-10-08T06:57:17.342752+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:17.342752+0000","last_undegraded":"2023-10-08T06:57:17.342752+0000","last_fullsized":"2023-10-08T06:57:17.342752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333951+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.333951+0000","last_peered":"2023-10-08T06:57:18.333951+0000","last_clean":"2023-10-08T06:57:18.333951+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.333951+0000","last_undegraded":"2023-10-08T06:57:18.333951+0000","last_fullsized":"2023-10-08T06:57:18.333951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332288+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.332288+0000","last_peered":"2023-10-08T06:57:18.332288+0000","last_clean":"2023-10-08T06:57:18.332288+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.332288+0000","last_undegraded":"2023-10-08T06:57:18.332288+0000","last_fullsized":"2023-10-08T06:57:18.332288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.332598+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:17.332598+0000","last_peered":"2023-10-08T06:57:17.332598+0000","last_clean":"2023-10-08T06:57:17.332598+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:17.332598+0000","last_undegraded":"2023-10-08T06:57:17.332598+0000","last_fullsized":"2023-10-08T06:57:17.332598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:46.357149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332218+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.332218+0000","last_peered":"2023-10-08T06:57:18.332218+0000","last_clean":"2023-10-08T06:57:18.332218+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.332218+0000","last_undegraded":"2023-10-08T06:57:18.332218+0000","last_fullsized":"2023-10-08T06:57:18.332218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334155+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.334155+0000","last_peered":"2023-10-08T06:57:18.334155+0000","last_clean":"2023-10-08T06:57:18.334155+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.334155+0000","last_undegraded":"2023-10-08T06:57:18.334155+0000","last_fullsized":"2023-10-08T06:57:18.334155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333744+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.333744+0000","last_peered":"2023-10-08T06:57:18.333744+0000","last_clean":"2023-10-08T06:57:18.333744+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.333744+0000","last_undegraded":"2023-10-08T06:57:18.333744+0000","last_fullsized":"2023-10-08T06:57:18.333744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331439+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.331439+0000","last_peered":"2023-10-08T06:57:18.331439+0000","last_clean":"2023-10-08T06:57:18.331439+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.331439+0000","last_undegraded":"2023-10-08T06:57:18.331439+0000","last_fullsized":"2023-10-08T06:57:18.331439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338011+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:17.338011+0000","last_peered":"2023-10-08T06:57:17.338011+0000","last_clean":"2023-10-08T06:57:17.338011+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:17.338011+0000","last_undegraded":"2023-10-08T06:57:17.338011+0000","last_fullsized":"2023-10-08T06:57:17.338011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:37.096975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331729+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.331729+0000","last_peered":"2023-10-08T06:57:18.331729+0000","last_clean":"2023-10-08T06:57:18.331729+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.331729+0000","last_undegraded":"2023-10-08T06:57:18.331729+0000","last_fullsized":"2023-10-08T06:57:18.331729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.338412+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:17.338412+0000","last_peered":"2023-10-08T06:57:17.338412+0000","last_clean":"2023-10-08T06:57:17.338412+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:17.338412+0000","last_undegraded":"2023-10-08T06:57:17.338412+0000","last_fullsized":"2023-10-08T06:57:17.338412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:31:40.652306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":650475,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":645256,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:21.870 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T06:57:21.870 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T06:57:21.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T06:57:21.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T06:57:21.871 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T06:57:22.302 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:22.314 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3446690208},{"type":"v1","addr":"172.21.15.37:6801","nonce":3446690208}]},"active_addr":"172.21.15.37:6801/3446690208","active_change":"2023-10-08T06:57:00.935924+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":76153269}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":599329663}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":617057934}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":4201209491}]}]} 2023-10-08T06:57:22.320 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T06:57:22.320 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T06:57:22.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:22.655 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:22.655 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:18.323568+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:22.669 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T06:57:22.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:23.008 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:18.323568+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:23.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T06:57:23.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T06:57:23.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T06:57:23.195 INFO:teuthology.orchestra.run.smithi037.stdout:34359738374 2023-10-08T06:57:23.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T06:57:23.205 INFO:teuthology.orchestra.run.smithi037.stdout:34359738374 2023-10-08T06:57:23.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T06:57:23.207 INFO:teuthology.orchestra.run.smithi037.stdout:34359738375 2023-10-08T06:57:23.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T06:57:23.544 INFO:teuthology.orchestra.run.smithi037.stdout:34359738373 2023-10-08T06:57:23.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2023-10-08T06:57:23.593 INFO:teuthology.orchestra.run.smithi037.stdout:34359738373 2023-10-08T06:57:23.595 INFO:teuthology.orchestra.run.smithi037.stdout:34359738374 2023-10-08T06:57:23.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-10-08T06:57:23.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2023-10-08T06:57:24.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T06:57:24.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T06:57:24.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T06:57:24.936 INFO:teuthology.orchestra.run.smithi037.stdout:34359738373 2023-10-08T06:57:24.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2023-10-08T06:57:24.964 INFO:teuthology.orchestra.run.smithi037.stdout:34359738373 2023-10-08T06:57:24.977 INFO:teuthology.orchestra.run.smithi037.stdout:34359738374 2023-10-08T06:57:24.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-10-08T06:57:24.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2023-10-08T06:57:25.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T06:57:25.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T06:57:25.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T06:57:26.319 INFO:teuthology.orchestra.run.smithi037.stdout:34359738375 2023-10-08T06:57:26.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.0 2023-10-08T06:57:26.334 DEBUG:teuthology.parallel:result is None 2023-10-08T06:57:26.352 INFO:teuthology.orchestra.run.smithi037.stdout:34359738375 2023-10-08T06:57:26.361 INFO:teuthology.orchestra.run.smithi037.stdout:34359738376 2023-10-08T06:57:26.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.1 2023-10-08T06:57:26.369 DEBUG:teuthology.parallel:result is None 2023-10-08T06:57:26.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.2 2023-10-08T06:57:26.378 DEBUG:teuthology.parallel:result is None 2023-10-08T06:57:26.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T06:57:26.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:26.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:26.759 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:26.770 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-08T06:57:24.943991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81728,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033792,"statfs":{"total":289910292480,"available":289826603008,"internally_reserved":0,"allocated":671744,"data_stored":1358647,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001614"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200953+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:19.200953+0000","last_peered":"2023-10-08T06:57:19.200953+0000","last_clean":"2023-10-08T06:57:19.200953+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:19.200953+0000","last_undegraded":"2023-10-08T06:57:19.200953+0000","last_fullsized":"2023-10-08T06:57:19.200953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200608+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:19.200608+0000","last_peered":"2023-10-08T06:57:19.200608+0000","last_clean":"2023-10-08T06:57:19.200608+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:19.200608+0000","last_undegraded":"2023-10-08T06:57:19.200608+0000","last_fullsized":"2023-10-08T06:57:19.200608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334697+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.334697+0000","last_peered":"2023-10-08T06:57:18.334697+0000","last_clean":"2023-10-08T06:57:18.334697+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.334697+0000","last_undegraded":"2023-10-08T06:57:18.334697+0000","last_fullsized":"2023-10-08T06:57:18.334697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334477+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.334477+0000","last_peered":"2023-10-08T06:57:18.334477+0000","last_clean":"2023-10-08T06:57:18.334477+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.334477+0000","last_undegraded":"2023-10-08T06:57:18.334477+0000","last_fullsized":"2023-10-08T06:57:18.334477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200220+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:19.200220+0000","last_peered":"2023-10-08T06:57:19.200220+0000","last_clean":"2023-10-08T06:57:19.200220+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:19.200220+0000","last_undegraded":"2023-10-08T06:57:19.200220+0000","last_fullsized":"2023-10-08T06:57:19.200220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333757+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.333757+0000","last_peered":"2023-10-08T06:57:18.333757+0000","last_clean":"2023-10-08T06:57:18.333757+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.333757+0000","last_undegraded":"2023-10-08T06:57:18.333757+0000","last_fullsized":"2023-10-08T06:57:18.333757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333585+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.333585+0000","last_peered":"2023-10-08T06:57:18.333585+0000","last_clean":"2023-10-08T06:57:18.333585+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.333585+0000","last_undegraded":"2023-10-08T06:57:18.333585+0000","last_fullsized":"2023-10-08T06:57:18.333585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333429+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.333429+0000","last_peered":"2023-10-08T06:57:18.333429+0000","last_clean":"2023-10-08T06:57:18.333429+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.333429+0000","last_undegraded":"2023-10-08T06:57:18.333429+0000","last_fullsized":"2023-10-08T06:57:18.333429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331881+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.331881+0000","last_peered":"2023-10-08T06:57:18.331881+0000","last_clean":"2023-10-08T06:57:18.331881+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.331881+0000","last_undegraded":"2023-10-08T06:57:18.331881+0000","last_fullsized":"2023-10-08T06:57:18.331881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200786+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:19.200786+0000","last_peered":"2023-10-08T06:57:19.200786+0000","last_clean":"2023-10-08T06:57:19.200786+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:19.200786+0000","last_undegraded":"2023-10-08T06:57:19.200786+0000","last_fullsized":"2023-10-08T06:57:19.200786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334400+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.334400+0000","last_peered":"2023-10-08T06:57:18.334400+0000","last_clean":"2023-10-08T06:57:18.334400+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.334400+0000","last_undegraded":"2023-10-08T06:57:18.334400+0000","last_fullsized":"2023-10-08T06:57:18.334400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199983+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:19.199983+0000","last_peered":"2023-10-08T06:57:19.199983+0000","last_clean":"2023-10-08T06:57:19.199983+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:19.199983+0000","last_undegraded":"2023-10-08T06:57:19.199983+0000","last_fullsized":"2023-10-08T06:57:19.199983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200029+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:19.200029+0000","last_peered":"2023-10-08T06:57:19.200029+0000","last_clean":"2023-10-08T06:57:19.200029+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:19.200029+0000","last_undegraded":"2023-10-08T06:57:19.200029+0000","last_fullsized":"2023-10-08T06:57:19.200029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334425+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.334425+0000","last_peered":"2023-10-08T06:57:18.334425+0000","last_clean":"2023-10-08T06:57:18.334425+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.334425+0000","last_undegraded":"2023-10-08T06:57:18.334425+0000","last_fullsized":"2023-10-08T06:57:18.334425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333883+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.333883+0000","last_peered":"2023-10-08T06:57:18.333883+0000","last_clean":"2023-10-08T06:57:18.333883+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.333883+0000","last_undegraded":"2023-10-08T06:57:18.333883+0000","last_fullsized":"2023-10-08T06:57:18.333883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333504+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.333504+0000","last_peered":"2023-10-08T06:57:18.333504+0000","last_clean":"2023-10-08T06:57:18.333504+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.333504+0000","last_undegraded":"2023-10-08T06:57:18.333504+0000","last_fullsized":"2023-10-08T06:57:18.333504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331981+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.331981+0000","last_peered":"2023-10-08T06:57:18.331981+0000","last_clean":"2023-10-08T06:57:18.331981+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.331981+0000","last_undegraded":"2023-10-08T06:57:18.331981+0000","last_fullsized":"2023-10-08T06:57:18.331981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200897+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:19.200897+0000","last_peered":"2023-10-08T06:57:19.200897+0000","last_clean":"2023-10-08T06:57:19.200897+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:19.200897+0000","last_undegraded":"2023-10-08T06:57:19.200897+0000","last_fullsized":"2023-10-08T06:57:19.200897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331998+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.331998+0000","last_peered":"2023-10-08T06:57:18.331998+0000","last_clean":"2023-10-08T06:57:18.331998+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.331998+0000","last_undegraded":"2023-10-08T06:57:18.331998+0000","last_fullsized":"2023-10-08T06:57:18.331998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334495+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.334495+0000","last_peered":"2023-10-08T06:57:18.334495+0000","last_clean":"2023-10-08T06:57:18.334495+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.334495+0000","last_undegraded":"2023-10-08T06:57:18.334495+0000","last_fullsized":"2023-10-08T06:57:18.334495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333990+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.333990+0000","last_peered":"2023-10-08T06:57:18.333990+0000","last_clean":"2023-10-08T06:57:18.333990+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.333990+0000","last_undegraded":"2023-10-08T06:57:18.333990+0000","last_fullsized":"2023-10-08T06:57:18.333990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199761+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:19.199761+0000","last_peered":"2023-10-08T06:57:19.199761+0000","last_clean":"2023-10-08T06:57:19.199761+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:19.199761+0000","last_undegraded":"2023-10-08T06:57:19.199761+0000","last_fullsized":"2023-10-08T06:57:19.199761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:15.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331586+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.331586+0000","last_peered":"2023-10-08T06:57:18.331586+0000","last_clean":"2023-10-08T06:57:18.331586+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.331586+0000","last_undegraded":"2023-10-08T06:57:18.331586+0000","last_fullsized":"2023-10-08T06:57:18.331586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199836+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:19.199836+0000","last_peered":"2023-10-08T06:57:19.199836+0000","last_clean":"2023-10-08T06:57:19.199836+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:19.199836+0000","last_undegraded":"2023-10-08T06:57:19.199836+0000","last_fullsized":"2023-10-08T06:57:19.199836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200845+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:19.200845+0000","last_peered":"2023-10-08T06:57:19.200845+0000","last_clean":"2023-10-08T06:57:19.200845+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:19.200845+0000","last_undegraded":"2023-10-08T06:57:19.200845+0000","last_fullsized":"2023-10-08T06:57:19.200845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331941+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.331941+0000","last_peered":"2023-10-08T06:57:18.331941+0000","last_clean":"2023-10-08T06:57:18.331941+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.331941+0000","last_undegraded":"2023-10-08T06:57:18.331941+0000","last_fullsized":"2023-10-08T06:57:18.331941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334529+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.334529+0000","last_peered":"2023-10-08T06:57:18.334529+0000","last_clean":"2023-10-08T06:57:18.334529+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.334529+0000","last_undegraded":"2023-10-08T06:57:18.334529+0000","last_fullsized":"2023-10-08T06:57:18.334529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955164+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:18.955164+0000","last_peered":"2023-10-08T06:57:18.955164+0000","last_clean":"2023-10-08T06:57:18.955164+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:18.955164+0000","last_undegraded":"2023-10-08T06:57:18.955164+0000","last_fullsized":"2023-10-08T06:57:18.955164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200640+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:19.200640+0000","last_peered":"2023-10-08T06:57:19.200640+0000","last_clean":"2023-10-08T06:57:19.200640+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:19.200640+0000","last_undegraded":"2023-10-08T06:57:19.200640+0000","last_fullsized":"2023-10-08T06:57:19.200640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331590+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.331590+0000","last_peered":"2023-10-08T06:57:18.331590+0000","last_clean":"2023-10-08T06:57:18.331590+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.331590+0000","last_undegraded":"2023-10-08T06:57:18.331590+0000","last_fullsized":"2023-10-08T06:57:18.331590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332180+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.332180+0000","last_peered":"2023-10-08T06:57:18.332180+0000","last_clean":"2023-10-08T06:57:18.332180+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.332180+0000","last_undegraded":"2023-10-08T06:57:18.332180+0000","last_fullsized":"2023-10-08T06:57:18.332180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331115+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.331115+0000","last_peered":"2023-10-08T06:57:18.331115+0000","last_clean":"2023-10-08T06:57:18.331115+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.331115+0000","last_undegraded":"2023-10-08T06:57:18.331115+0000","last_fullsized":"2023-10-08T06:57:18.331115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200839+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:19.200839+0000","last_peered":"2023-10-08T06:57:19.200839+0000","last_clean":"2023-10-08T06:57:19.200839+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:19.200839+0000","last_undegraded":"2023-10-08T06:57:19.200839+0000","last_fullsized":"2023-10-08T06:57:19.200839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332324+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.332324+0000","last_peered":"2023-10-08T06:57:18.332324+0000","last_clean":"2023-10-08T06:57:18.332324+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.332324+0000","last_undegraded":"2023-10-08T06:57:18.332324+0000","last_fullsized":"2023-10-08T06:57:18.332324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331371+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.331371+0000","last_peered":"2023-10-08T06:57:18.331371+0000","last_clean":"2023-10-08T06:57:18.331371+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.331371+0000","last_undegraded":"2023-10-08T06:57:18.331371+0000","last_fullsized":"2023-10-08T06:57:18.331371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334291+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.334291+0000","last_peered":"2023-10-08T06:57:18.334291+0000","last_clean":"2023-10-08T06:57:18.334291+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.334291+0000","last_undegraded":"2023-10-08T06:57:18.334291+0000","last_fullsized":"2023-10-08T06:57:18.334291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331763+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.331763+0000","last_peered":"2023-10-08T06:57:18.331763+0000","last_clean":"2023-10-08T06:57:18.331763+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.331763+0000","last_undegraded":"2023-10-08T06:57:18.331763+0000","last_fullsized":"2023-10-08T06:57:18.331763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955311+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:18.955311+0000","last_peered":"2023-10-08T06:57:18.955311+0000","last_clean":"2023-10-08T06:57:18.955311+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:18.955311+0000","last_undegraded":"2023-10-08T06:57:18.955311+0000","last_fullsized":"2023-10-08T06:57:18.955311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331669+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.331669+0000","last_peered":"2023-10-08T06:57:18.331669+0000","last_clean":"2023-10-08T06:57:18.331669+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.331669+0000","last_undegraded":"2023-10-08T06:57:18.331669+0000","last_fullsized":"2023-10-08T06:57:18.331669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334290+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.334290+0000","last_peered":"2023-10-08T06:57:18.334290+0000","last_clean":"2023-10-08T06:57:18.334290+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.334290+0000","last_undegraded":"2023-10-08T06:57:18.334290+0000","last_fullsized":"2023-10-08T06:57:18.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334365+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.334365+0000","last_peered":"2023-10-08T06:57:18.334365+0000","last_clean":"2023-10-08T06:57:18.334365+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.334365+0000","last_undegraded":"2023-10-08T06:57:18.334365+0000","last_fullsized":"2023-10-08T06:57:18.334365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334237+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.334237+0000","last_peered":"2023-10-08T06:57:18.334237+0000","last_clean":"2023-10-08T06:57:18.334237+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.334237+0000","last_undegraded":"2023-10-08T06:57:18.334237+0000","last_fullsized":"2023-10-08T06:57:18.334237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200115+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:19.200115+0000","last_peered":"2023-10-08T06:57:19.200115+0000","last_clean":"2023-10-08T06:57:19.200115+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:19.200115+0000","last_undegraded":"2023-10-08T06:57:19.200115+0000","last_fullsized":"2023-10-08T06:57:19.200115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331687+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.331687+0000","last_peered":"2023-10-08T06:57:18.331687+0000","last_clean":"2023-10-08T06:57:18.331687+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.331687+0000","last_undegraded":"2023-10-08T06:57:18.331687+0000","last_fullsized":"2023-10-08T06:57:18.331687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200606+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:19.200606+0000","last_peered":"2023-10-08T06:57:19.200606+0000","last_clean":"2023-10-08T06:57:19.200606+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:19.200606+0000","last_undegraded":"2023-10-08T06:57:19.200606+0000","last_fullsized":"2023-10-08T06:57:19.200606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955092+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:18.955092+0000","last_peered":"2023-10-08T06:57:18.955092+0000","last_clean":"2023-10-08T06:57:18.955092+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:18.955092+0000","last_undegraded":"2023-10-08T06:57:18.955092+0000","last_fullsized":"2023-10-08T06:57:18.955092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332284+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.332284+0000","last_peered":"2023-10-08T06:57:18.332284+0000","last_clean":"2023-10-08T06:57:18.332284+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.332284+0000","last_undegraded":"2023-10-08T06:57:18.332284+0000","last_fullsized":"2023-10-08T06:57:18.332284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333778+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.333778+0000","last_peered":"2023-10-08T06:57:18.333778+0000","last_clean":"2023-10-08T06:57:18.333778+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.333778+0000","last_undegraded":"2023-10-08T06:57:18.333778+0000","last_fullsized":"2023-10-08T06:57:18.333778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332441+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.332441+0000","last_peered":"2023-10-08T06:57:18.332441+0000","last_clean":"2023-10-08T06:57:18.332441+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.332441+0000","last_undegraded":"2023-10-08T06:57:18.332441+0000","last_fullsized":"2023-10-08T06:57:18.332441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334724+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.334724+0000","last_peered":"2023-10-08T06:57:18.334724+0000","last_clean":"2023-10-08T06:57:18.334724+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.334724+0000","last_undegraded":"2023-10-08T06:57:18.334724+0000","last_fullsized":"2023-10-08T06:57:18.334724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199355+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:19.199355+0000","last_peered":"2023-10-08T06:57:19.199355+0000","last_clean":"2023-10-08T06:57:19.199355+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:19.199355+0000","last_undegraded":"2023-10-08T06:57:19.199355+0000","last_fullsized":"2023-10-08T06:57:19.199355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955383+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:18.955383+0000","last_peered":"2023-10-08T06:57:18.955383+0000","last_clean":"2023-10-08T06:57:18.955383+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:18.955383+0000","last_undegraded":"2023-10-08T06:57:18.955383+0000","last_fullsized":"2023-10-08T06:57:18.955383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199953+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:19.199953+0000","last_peered":"2023-10-08T06:57:19.199953+0000","last_clean":"2023-10-08T06:57:19.199953+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:19.199953+0000","last_undegraded":"2023-10-08T06:57:19.199953+0000","last_fullsized":"2023-10-08T06:57:19.199953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334506+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.334506+0000","last_peered":"2023-10-08T06:57:18.334506+0000","last_clean":"2023-10-08T06:57:18.334506+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.334506+0000","last_undegraded":"2023-10-08T06:57:18.334506+0000","last_fullsized":"2023-10-08T06:57:18.334506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334249+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.334249+0000","last_peered":"2023-10-08T06:57:18.334249+0000","last_clean":"2023-10-08T06:57:18.334249+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.334249+0000","last_undegraded":"2023-10-08T06:57:18.334249+0000","last_fullsized":"2023-10-08T06:57:18.334249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333896+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.333896+0000","last_peered":"2023-10-08T06:57:18.333896+0000","last_clean":"2023-10-08T06:57:18.333896+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.333896+0000","last_undegraded":"2023-10-08T06:57:18.333896+0000","last_fullsized":"2023-10-08T06:57:18.333896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332051+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.332051+0000","last_peered":"2023-10-08T06:57:18.332051+0000","last_clean":"2023-10-08T06:57:18.332051+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.332051+0000","last_undegraded":"2023-10-08T06:57:18.332051+0000","last_fullsized":"2023-10-08T06:57:18.332051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331427+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.331427+0000","last_peered":"2023-10-08T06:57:18.331427+0000","last_clean":"2023-10-08T06:57:18.331427+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.331427+0000","last_undegraded":"2023-10-08T06:57:18.331427+0000","last_fullsized":"2023-10-08T06:57:18.331427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334184+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.334184+0000","last_peered":"2023-10-08T06:57:18.334184+0000","last_clean":"2023-10-08T06:57:18.334184+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.334184+0000","last_undegraded":"2023-10-08T06:57:18.334184+0000","last_fullsized":"2023-10-08T06:57:18.334184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333798+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.333798+0000","last_peered":"2023-10-08T06:57:18.333798+0000","last_clean":"2023-10-08T06:57:18.333798+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.333798+0000","last_undegraded":"2023-10-08T06:57:18.333798+0000","last_fullsized":"2023-10-08T06:57:18.333798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334844+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.334844+0000","last_peered":"2023-10-08T06:57:18.334844+0000","last_clean":"2023-10-08T06:57:18.334844+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.334844+0000","last_undegraded":"2023-10-08T06:57:18.334844+0000","last_fullsized":"2023-10-08T06:57:18.334844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955080+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:18.955080+0000","last_peered":"2023-10-08T06:57:18.955080+0000","last_clean":"2023-10-08T06:57:18.955080+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:18.955080+0000","last_undegraded":"2023-10-08T06:57:18.955080+0000","last_fullsized":"2023-10-08T06:57:18.955080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334527+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.334527+0000","last_peered":"2023-10-08T06:57:18.334527+0000","last_clean":"2023-10-08T06:57:18.334527+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.334527+0000","last_undegraded":"2023-10-08T06:57:18.334527+0000","last_fullsized":"2023-10-08T06:57:18.334527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955052+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:18.955052+0000","last_peered":"2023-10-08T06:57:18.955052+0000","last_clean":"2023-10-08T06:57:18.955052+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:18.955052+0000","last_undegraded":"2023-10-08T06:57:18.955052+0000","last_fullsized":"2023-10-08T06:57:18.955052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332280+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.332280+0000","last_peered":"2023-10-08T06:57:18.332280+0000","last_clean":"2023-10-08T06:57:18.332280+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.332280+0000","last_undegraded":"2023-10-08T06:57:18.332280+0000","last_fullsized":"2023-10-08T06:57:18.332280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322034+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:17.322034+0000","last_peered":"2023-10-08T06:57:17.322034+0000","last_clean":"2023-10-08T06:57:17.322034+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:17.322034+0000","last_undegraded":"2023-10-08T06:57:17.322034+0000","last_fullsized":"2023-10-08T06:57:17.322034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334630+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.334630+0000","last_peered":"2023-10-08T06:57:18.334630+0000","last_clean":"2023-10-08T06:57:18.334630+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.334630+0000","last_undegraded":"2023-10-08T06:57:18.334630+0000","last_fullsized":"2023-10-08T06:57:18.334630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199918+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:19.199918+0000","last_peered":"2023-10-08T06:57:19.199918+0000","last_clean":"2023-10-08T06:57:19.199918+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:19.199918+0000","last_undegraded":"2023-10-08T06:57:19.199918+0000","last_fullsized":"2023-10-08T06:57:19.199918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329398+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:17.329398+0000","last_peered":"2023-10-08T06:57:17.329398+0000","last_clean":"2023-10-08T06:57:17.329398+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:17.329398+0000","last_undegraded":"2023-10-08T06:57:17.329398+0000","last_fullsized":"2023-10-08T06:57:17.329398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334137+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.334137+0000","last_peered":"2023-10-08T06:57:18.334137+0000","last_clean":"2023-10-08T06:57:18.334137+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.334137+0000","last_undegraded":"2023-10-08T06:57:18.334137+0000","last_fullsized":"2023-10-08T06:57:18.334137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332274+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.332274+0000","last_peered":"2023-10-08T06:57:18.332274+0000","last_clean":"2023-10-08T06:57:18.332274+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.332274+0000","last_undegraded":"2023-10-08T06:57:18.332274+0000","last_fullsized":"2023-10-08T06:57:18.332274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.321071+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:17.321071+0000","last_peered":"2023-10-08T06:57:17.321071+0000","last_clean":"2023-10-08T06:57:17.321071+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:17.321071+0000","last_undegraded":"2023-10-08T06:57:17.321071+0000","last_fullsized":"2023-10-08T06:57:17.321071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955037+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:18.955037+0000","last_peered":"2023-10-08T06:57:18.955037+0000","last_clean":"2023-10-08T06:57:18.955037+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:18.955037+0000","last_undegraded":"2023-10-08T06:57:18.955037+0000","last_fullsized":"2023-10-08T06:57:18.955037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332451+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.332451+0000","last_peered":"2023-10-08T06:57:18.332451+0000","last_clean":"2023-10-08T06:57:18.332451+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.332451+0000","last_undegraded":"2023-10-08T06:57:18.332451+0000","last_fullsized":"2023-10-08T06:57:18.332451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330319+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:17.330319+0000","last_peered":"2023-10-08T06:57:17.330319+0000","last_clean":"2023-10-08T06:57:17.330319+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:17.330319+0000","last_undegraded":"2023-10-08T06:57:17.330319+0000","last_fullsized":"2023-10-08T06:57:17.330319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329262+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:17.329262+0000","last_peered":"2023-10-08T06:57:17.329262+0000","last_clean":"2023-10-08T06:57:17.329262+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:17.329262+0000","last_undegraded":"2023-10-08T06:57:17.329262+0000","last_fullsized":"2023-10-08T06:57:17.329262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331430+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.331430+0000","last_peered":"2023-10-08T06:57:18.331430+0000","last_clean":"2023-10-08T06:57:18.331430+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.331430+0000","last_undegraded":"2023-10-08T06:57:18.331430+0000","last_fullsized":"2023-10-08T06:57:18.331430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334793+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.334793+0000","last_peered":"2023-10-08T06:57:18.334793+0000","last_clean":"2023-10-08T06:57:18.334793+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.334793+0000","last_undegraded":"2023-10-08T06:57:18.334793+0000","last_fullsized":"2023-10-08T06:57:18.334793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330138+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:17.330138+0000","last_peered":"2023-10-08T06:57:17.330138+0000","last_clean":"2023-10-08T06:57:17.330138+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:17.330138+0000","last_undegraded":"2023-10-08T06:57:17.330138+0000","last_fullsized":"2023-10-08T06:57:17.330138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331051+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.331051+0000","last_peered":"2023-10-08T06:57:18.331051+0000","last_clean":"2023-10-08T06:57:18.331051+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.331051+0000","last_undegraded":"2023-10-08T06:57:18.331051+0000","last_fullsized":"2023-10-08T06:57:18.331051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200820+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:19.200820+0000","last_peered":"2023-10-08T06:57:19.200820+0000","last_clean":"2023-10-08T06:57:19.200820+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:19.200820+0000","last_undegraded":"2023-10-08T06:57:19.200820+0000","last_fullsized":"2023-10-08T06:57:19.200820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.325509+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:17.325509+0000","last_peered":"2023-10-08T06:57:17.325509+0000","last_clean":"2023-10-08T06:57:17.325509+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:17.325509+0000","last_undegraded":"2023-10-08T06:57:17.325509+0000","last_fullsized":"2023-10-08T06:57:17.325509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332015+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.332015+0000","last_peered":"2023-10-08T06:57:18.332015+0000","last_clean":"2023-10-08T06:57:18.332015+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.332015+0000","last_undegraded":"2023-10-08T06:57:18.332015+0000","last_fullsized":"2023-10-08T06:57:18.332015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200292+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:19.200292+0000","last_peered":"2023-10-08T06:57:19.200292+0000","last_clean":"2023-10-08T06:57:19.200292+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:19.200292+0000","last_undegraded":"2023-10-08T06:57:19.200292+0000","last_fullsized":"2023-10-08T06:57:19.200292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332004+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.332004+0000","last_peered":"2023-10-08T06:57:18.332004+0000","last_clean":"2023-10-08T06:57:18.332004+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.332004+0000","last_undegraded":"2023-10-08T06:57:18.332004+0000","last_fullsized":"2023-10-08T06:57:18.332004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.323142+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:17.323142+0000","last_peered":"2023-10-08T06:57:17.323142+0000","last_clean":"2023-10-08T06:57:17.323142+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:17.323142+0000","last_undegraded":"2023-10-08T06:57:17.323142+0000","last_fullsized":"2023-10-08T06:57:17.323142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.330989+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.330989+0000","last_peered":"2023-10-08T06:57:18.330989+0000","last_clean":"2023-10-08T06:57:18.330989+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.330989+0000","last_undegraded":"2023-10-08T06:57:18.330989+0000","last_fullsized":"2023-10-08T06:57:18.330989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.331023+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:17.331023+0000","last_peered":"2023-10-08T06:57:17.331023+0000","last_clean":"2023-10-08T06:57:17.331023+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:17.331023+0000","last_undegraded":"2023-10-08T06:57:17.331023+0000","last_fullsized":"2023-10-08T06:57:17.331023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952345+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:18.952345+0000","last_peered":"2023-10-08T06:57:18.952345+0000","last_clean":"2023-10-08T06:57:18.952345+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:18.952345+0000","last_undegraded":"2023-10-08T06:57:18.952345+0000","last_fullsized":"2023-10-08T06:57:18.952345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199708+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:19.199708+0000","last_peered":"2023-10-08T06:57:19.199708+0000","last_clean":"2023-10-08T06:57:19.199708+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:19.199708+0000","last_undegraded":"2023-10-08T06:57:19.199708+0000","last_fullsized":"2023-10-08T06:57:19.199708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955224+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:18.955224+0000","last_peered":"2023-10-08T06:57:18.955224+0000","last_clean":"2023-10-08T06:57:18.955224+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:18.955224+0000","last_undegraded":"2023-10-08T06:57:18.955224+0000","last_fullsized":"2023-10-08T06:57:18.955224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200258+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:19.200258+0000","last_peered":"2023-10-08T06:57:19.200258+0000","last_clean":"2023-10-08T06:57:19.200258+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:19.200258+0000","last_undegraded":"2023-10-08T06:57:19.200258+0000","last_fullsized":"2023-10-08T06:57:19.200258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334243+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.334243+0000","last_peered":"2023-10-08T06:57:18.334243+0000","last_clean":"2023-10-08T06:57:18.334243+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.334243+0000","last_undegraded":"2023-10-08T06:57:18.334243+0000","last_fullsized":"2023-10-08T06:57:18.334243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334062+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.334062+0000","last_peered":"2023-10-08T06:57:18.334062+0000","last_clean":"2023-10-08T06:57:18.334062+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.334062+0000","last_undegraded":"2023-10-08T06:57:18.334062+0000","last_fullsized":"2023-10-08T06:57:18.334062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955330+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:18.955330+0000","last_peered":"2023-10-08T06:57:18.955330+0000","last_clean":"2023-10-08T06:57:18.955330+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:18.955330+0000","last_undegraded":"2023-10-08T06:57:18.955330+0000","last_fullsized":"2023-10-08T06:57:18.955330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333951+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.333951+0000","last_peered":"2023-10-08T06:57:18.333951+0000","last_clean":"2023-10-08T06:57:18.333951+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.333951+0000","last_undegraded":"2023-10-08T06:57:18.333951+0000","last_fullsized":"2023-10-08T06:57:18.333951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332288+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.332288+0000","last_peered":"2023-10-08T06:57:18.332288+0000","last_clean":"2023-10-08T06:57:18.332288+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.332288+0000","last_undegraded":"2023-10-08T06:57:18.332288+0000","last_fullsized":"2023-10-08T06:57:18.332288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199990+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:19.199990+0000","last_peered":"2023-10-08T06:57:19.199990+0000","last_clean":"2023-10-08T06:57:19.199990+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:19.199990+0000","last_undegraded":"2023-10-08T06:57:19.199990+0000","last_fullsized":"2023-10-08T06:57:19.199990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332218+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.332218+0000","last_peered":"2023-10-08T06:57:18.332218+0000","last_clean":"2023-10-08T06:57:18.332218+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.332218+0000","last_undegraded":"2023-10-08T06:57:18.332218+0000","last_fullsized":"2023-10-08T06:57:18.332218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334155+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.334155+0000","last_peered":"2023-10-08T06:57:18.334155+0000","last_clean":"2023-10-08T06:57:18.334155+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.334155+0000","last_undegraded":"2023-10-08T06:57:18.334155+0000","last_fullsized":"2023-10-08T06:57:18.334155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333744+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.333744+0000","last_peered":"2023-10-08T06:57:18.333744+0000","last_clean":"2023-10-08T06:57:18.333744+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.333744+0000","last_undegraded":"2023-10-08T06:57:18.333744+0000","last_fullsized":"2023-10-08T06:57:18.333744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331439+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.331439+0000","last_peered":"2023-10-08T06:57:18.331439+0000","last_clean":"2023-10-08T06:57:18.331439+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.331439+0000","last_undegraded":"2023-10-08T06:57:18.331439+0000","last_fullsized":"2023-10-08T06:57:18.331439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199961+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:19.199961+0000","last_peered":"2023-10-08T06:57:19.199961+0000","last_clean":"2023-10-08T06:57:19.199961+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:19.199961+0000","last_undegraded":"2023-10-08T06:57:19.199961+0000","last_fullsized":"2023-10-08T06:57:19.199961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331729+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.331729+0000","last_peered":"2023-10-08T06:57:18.331729+0000","last_clean":"2023-10-08T06:57:18.331729+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.331729+0000","last_undegraded":"2023-10-08T06:57:18.331729+0000","last_fullsized":"2023-10-08T06:57:18.331729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200274+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:19.200274+0000","last_peered":"2023-10-08T06:57:19.200274+0000","last_clean":"2023-10-08T06:57:19.200274+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:19.200274+0000","last_undegraded":"2023-10-08T06:57:19.200274+0000","last_fullsized":"2023-10-08T06:57:19.200274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":650475,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":649859,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:26.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:27.153 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:27.165 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-08T06:57:26.944584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81728,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033792,"statfs":{"total":289910292480,"available":289826603008,"internally_reserved":0,"allocated":671744,"data_stored":1358647,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.625421"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200953+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:19.200953+0000","last_peered":"2023-10-08T06:57:19.200953+0000","last_clean":"2023-10-08T06:57:19.200953+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:19.200953+0000","last_undegraded":"2023-10-08T06:57:19.200953+0000","last_fullsized":"2023-10-08T06:57:19.200953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200608+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:19.200608+0000","last_peered":"2023-10-08T06:57:19.200608+0000","last_clean":"2023-10-08T06:57:19.200608+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:19.200608+0000","last_undegraded":"2023-10-08T06:57:19.200608+0000","last_fullsized":"2023-10-08T06:57:19.200608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334697+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.334697+0000","last_peered":"2023-10-08T06:57:18.334697+0000","last_clean":"2023-10-08T06:57:18.334697+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.334697+0000","last_undegraded":"2023-10-08T06:57:18.334697+0000","last_fullsized":"2023-10-08T06:57:18.334697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334477+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.334477+0000","last_peered":"2023-10-08T06:57:18.334477+0000","last_clean":"2023-10-08T06:57:18.334477+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.334477+0000","last_undegraded":"2023-10-08T06:57:18.334477+0000","last_fullsized":"2023-10-08T06:57:18.334477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200220+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:19.200220+0000","last_peered":"2023-10-08T06:57:19.200220+0000","last_clean":"2023-10-08T06:57:19.200220+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:19.200220+0000","last_undegraded":"2023-10-08T06:57:19.200220+0000","last_fullsized":"2023-10-08T06:57:19.200220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333757+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.333757+0000","last_peered":"2023-10-08T06:57:18.333757+0000","last_clean":"2023-10-08T06:57:18.333757+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.333757+0000","last_undegraded":"2023-10-08T06:57:18.333757+0000","last_fullsized":"2023-10-08T06:57:18.333757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333585+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.333585+0000","last_peered":"2023-10-08T06:57:18.333585+0000","last_clean":"2023-10-08T06:57:18.333585+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.333585+0000","last_undegraded":"2023-10-08T06:57:18.333585+0000","last_fullsized":"2023-10-08T06:57:18.333585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333429+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.333429+0000","last_peered":"2023-10-08T06:57:18.333429+0000","last_clean":"2023-10-08T06:57:18.333429+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.333429+0000","last_undegraded":"2023-10-08T06:57:18.333429+0000","last_fullsized":"2023-10-08T06:57:18.333429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331881+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.331881+0000","last_peered":"2023-10-08T06:57:18.331881+0000","last_clean":"2023-10-08T06:57:18.331881+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.331881+0000","last_undegraded":"2023-10-08T06:57:18.331881+0000","last_fullsized":"2023-10-08T06:57:18.331881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200786+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:19.200786+0000","last_peered":"2023-10-08T06:57:19.200786+0000","last_clean":"2023-10-08T06:57:19.200786+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:19.200786+0000","last_undegraded":"2023-10-08T06:57:19.200786+0000","last_fullsized":"2023-10-08T06:57:19.200786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334400+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.334400+0000","last_peered":"2023-10-08T06:57:18.334400+0000","last_clean":"2023-10-08T06:57:18.334400+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.334400+0000","last_undegraded":"2023-10-08T06:57:18.334400+0000","last_fullsized":"2023-10-08T06:57:18.334400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199983+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:19.199983+0000","last_peered":"2023-10-08T06:57:19.199983+0000","last_clean":"2023-10-08T06:57:19.199983+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:19.199983+0000","last_undegraded":"2023-10-08T06:57:19.199983+0000","last_fullsized":"2023-10-08T06:57:19.199983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200029+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:19.200029+0000","last_peered":"2023-10-08T06:57:19.200029+0000","last_clean":"2023-10-08T06:57:19.200029+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:19.200029+0000","last_undegraded":"2023-10-08T06:57:19.200029+0000","last_fullsized":"2023-10-08T06:57:19.200029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334425+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.334425+0000","last_peered":"2023-10-08T06:57:18.334425+0000","last_clean":"2023-10-08T06:57:18.334425+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.334425+0000","last_undegraded":"2023-10-08T06:57:18.334425+0000","last_fullsized":"2023-10-08T06:57:18.334425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333883+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.333883+0000","last_peered":"2023-10-08T06:57:18.333883+0000","last_clean":"2023-10-08T06:57:18.333883+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.333883+0000","last_undegraded":"2023-10-08T06:57:18.333883+0000","last_fullsized":"2023-10-08T06:57:18.333883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333504+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.333504+0000","last_peered":"2023-10-08T06:57:18.333504+0000","last_clean":"2023-10-08T06:57:18.333504+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.333504+0000","last_undegraded":"2023-10-08T06:57:18.333504+0000","last_fullsized":"2023-10-08T06:57:18.333504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331981+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.331981+0000","last_peered":"2023-10-08T06:57:18.331981+0000","last_clean":"2023-10-08T06:57:18.331981+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.331981+0000","last_undegraded":"2023-10-08T06:57:18.331981+0000","last_fullsized":"2023-10-08T06:57:18.331981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200897+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:19.200897+0000","last_peered":"2023-10-08T06:57:19.200897+0000","last_clean":"2023-10-08T06:57:19.200897+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:19.200897+0000","last_undegraded":"2023-10-08T06:57:19.200897+0000","last_fullsized":"2023-10-08T06:57:19.200897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331998+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.331998+0000","last_peered":"2023-10-08T06:57:18.331998+0000","last_clean":"2023-10-08T06:57:18.331998+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.331998+0000","last_undegraded":"2023-10-08T06:57:18.331998+0000","last_fullsized":"2023-10-08T06:57:18.331998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334495+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.334495+0000","last_peered":"2023-10-08T06:57:18.334495+0000","last_clean":"2023-10-08T06:57:18.334495+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.334495+0000","last_undegraded":"2023-10-08T06:57:18.334495+0000","last_fullsized":"2023-10-08T06:57:18.334495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333990+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.333990+0000","last_peered":"2023-10-08T06:57:18.333990+0000","last_clean":"2023-10-08T06:57:18.333990+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.333990+0000","last_undegraded":"2023-10-08T06:57:18.333990+0000","last_fullsized":"2023-10-08T06:57:18.333990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199761+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:19.199761+0000","last_peered":"2023-10-08T06:57:19.199761+0000","last_clean":"2023-10-08T06:57:19.199761+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:19.199761+0000","last_undegraded":"2023-10-08T06:57:19.199761+0000","last_fullsized":"2023-10-08T06:57:19.199761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:15.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331586+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.331586+0000","last_peered":"2023-10-08T06:57:18.331586+0000","last_clean":"2023-10-08T06:57:18.331586+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.331586+0000","last_undegraded":"2023-10-08T06:57:18.331586+0000","last_fullsized":"2023-10-08T06:57:18.331586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199836+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:19.199836+0000","last_peered":"2023-10-08T06:57:19.199836+0000","last_clean":"2023-10-08T06:57:19.199836+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:19.199836+0000","last_undegraded":"2023-10-08T06:57:19.199836+0000","last_fullsized":"2023-10-08T06:57:19.199836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200845+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:19.200845+0000","last_peered":"2023-10-08T06:57:19.200845+0000","last_clean":"2023-10-08T06:57:19.200845+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:19.200845+0000","last_undegraded":"2023-10-08T06:57:19.200845+0000","last_fullsized":"2023-10-08T06:57:19.200845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331941+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.331941+0000","last_peered":"2023-10-08T06:57:18.331941+0000","last_clean":"2023-10-08T06:57:18.331941+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.331941+0000","last_undegraded":"2023-10-08T06:57:18.331941+0000","last_fullsized":"2023-10-08T06:57:18.331941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334529+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.334529+0000","last_peered":"2023-10-08T06:57:18.334529+0000","last_clean":"2023-10-08T06:57:18.334529+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.334529+0000","last_undegraded":"2023-10-08T06:57:18.334529+0000","last_fullsized":"2023-10-08T06:57:18.334529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955164+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:18.955164+0000","last_peered":"2023-10-08T06:57:18.955164+0000","last_clean":"2023-10-08T06:57:18.955164+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:18.955164+0000","last_undegraded":"2023-10-08T06:57:18.955164+0000","last_fullsized":"2023-10-08T06:57:18.955164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200640+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:19.200640+0000","last_peered":"2023-10-08T06:57:19.200640+0000","last_clean":"2023-10-08T06:57:19.200640+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:19.200640+0000","last_undegraded":"2023-10-08T06:57:19.200640+0000","last_fullsized":"2023-10-08T06:57:19.200640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331590+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.331590+0000","last_peered":"2023-10-08T06:57:18.331590+0000","last_clean":"2023-10-08T06:57:18.331590+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.331590+0000","last_undegraded":"2023-10-08T06:57:18.331590+0000","last_fullsized":"2023-10-08T06:57:18.331590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332180+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.332180+0000","last_peered":"2023-10-08T06:57:18.332180+0000","last_clean":"2023-10-08T06:57:18.332180+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.332180+0000","last_undegraded":"2023-10-08T06:57:18.332180+0000","last_fullsized":"2023-10-08T06:57:18.332180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331115+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.331115+0000","last_peered":"2023-10-08T06:57:18.331115+0000","last_clean":"2023-10-08T06:57:18.331115+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.331115+0000","last_undegraded":"2023-10-08T06:57:18.331115+0000","last_fullsized":"2023-10-08T06:57:18.331115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200839+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:19.200839+0000","last_peered":"2023-10-08T06:57:19.200839+0000","last_clean":"2023-10-08T06:57:19.200839+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:19.200839+0000","last_undegraded":"2023-10-08T06:57:19.200839+0000","last_fullsized":"2023-10-08T06:57:19.200839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332324+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.332324+0000","last_peered":"2023-10-08T06:57:18.332324+0000","last_clean":"2023-10-08T06:57:18.332324+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.332324+0000","last_undegraded":"2023-10-08T06:57:18.332324+0000","last_fullsized":"2023-10-08T06:57:18.332324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331371+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.331371+0000","last_peered":"2023-10-08T06:57:18.331371+0000","last_clean":"2023-10-08T06:57:18.331371+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.331371+0000","last_undegraded":"2023-10-08T06:57:18.331371+0000","last_fullsized":"2023-10-08T06:57:18.331371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334291+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.334291+0000","last_peered":"2023-10-08T06:57:18.334291+0000","last_clean":"2023-10-08T06:57:18.334291+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.334291+0000","last_undegraded":"2023-10-08T06:57:18.334291+0000","last_fullsized":"2023-10-08T06:57:18.334291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331763+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.331763+0000","last_peered":"2023-10-08T06:57:18.331763+0000","last_clean":"2023-10-08T06:57:18.331763+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.331763+0000","last_undegraded":"2023-10-08T06:57:18.331763+0000","last_fullsized":"2023-10-08T06:57:18.331763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955311+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:18.955311+0000","last_peered":"2023-10-08T06:57:18.955311+0000","last_clean":"2023-10-08T06:57:18.955311+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:18.955311+0000","last_undegraded":"2023-10-08T06:57:18.955311+0000","last_fullsized":"2023-10-08T06:57:18.955311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331669+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.331669+0000","last_peered":"2023-10-08T06:57:18.331669+0000","last_clean":"2023-10-08T06:57:18.331669+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.331669+0000","last_undegraded":"2023-10-08T06:57:18.331669+0000","last_fullsized":"2023-10-08T06:57:18.331669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334290+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.334290+0000","last_peered":"2023-10-08T06:57:18.334290+0000","last_clean":"2023-10-08T06:57:18.334290+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.334290+0000","last_undegraded":"2023-10-08T06:57:18.334290+0000","last_fullsized":"2023-10-08T06:57:18.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334365+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.334365+0000","last_peered":"2023-10-08T06:57:18.334365+0000","last_clean":"2023-10-08T06:57:18.334365+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.334365+0000","last_undegraded":"2023-10-08T06:57:18.334365+0000","last_fullsized":"2023-10-08T06:57:18.334365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334237+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.334237+0000","last_peered":"2023-10-08T06:57:18.334237+0000","last_clean":"2023-10-08T06:57:18.334237+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.334237+0000","last_undegraded":"2023-10-08T06:57:18.334237+0000","last_fullsized":"2023-10-08T06:57:18.334237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200115+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:19.200115+0000","last_peered":"2023-10-08T06:57:19.200115+0000","last_clean":"2023-10-08T06:57:19.200115+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:19.200115+0000","last_undegraded":"2023-10-08T06:57:19.200115+0000","last_fullsized":"2023-10-08T06:57:19.200115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331687+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.331687+0000","last_peered":"2023-10-08T06:57:18.331687+0000","last_clean":"2023-10-08T06:57:18.331687+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.331687+0000","last_undegraded":"2023-10-08T06:57:18.331687+0000","last_fullsized":"2023-10-08T06:57:18.331687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200606+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:19.200606+0000","last_peered":"2023-10-08T06:57:19.200606+0000","last_clean":"2023-10-08T06:57:19.200606+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:19.200606+0000","last_undegraded":"2023-10-08T06:57:19.200606+0000","last_fullsized":"2023-10-08T06:57:19.200606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955092+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:18.955092+0000","last_peered":"2023-10-08T06:57:18.955092+0000","last_clean":"2023-10-08T06:57:18.955092+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:18.955092+0000","last_undegraded":"2023-10-08T06:57:18.955092+0000","last_fullsized":"2023-10-08T06:57:18.955092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332284+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.332284+0000","last_peered":"2023-10-08T06:57:18.332284+0000","last_clean":"2023-10-08T06:57:18.332284+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.332284+0000","last_undegraded":"2023-10-08T06:57:18.332284+0000","last_fullsized":"2023-10-08T06:57:18.332284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333778+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.333778+0000","last_peered":"2023-10-08T06:57:18.333778+0000","last_clean":"2023-10-08T06:57:18.333778+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.333778+0000","last_undegraded":"2023-10-08T06:57:18.333778+0000","last_fullsized":"2023-10-08T06:57:18.333778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332441+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.332441+0000","last_peered":"2023-10-08T06:57:18.332441+0000","last_clean":"2023-10-08T06:57:18.332441+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.332441+0000","last_undegraded":"2023-10-08T06:57:18.332441+0000","last_fullsized":"2023-10-08T06:57:18.332441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334724+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.334724+0000","last_peered":"2023-10-08T06:57:18.334724+0000","last_clean":"2023-10-08T06:57:18.334724+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.334724+0000","last_undegraded":"2023-10-08T06:57:18.334724+0000","last_fullsized":"2023-10-08T06:57:18.334724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199355+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:19.199355+0000","last_peered":"2023-10-08T06:57:19.199355+0000","last_clean":"2023-10-08T06:57:19.199355+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:19.199355+0000","last_undegraded":"2023-10-08T06:57:19.199355+0000","last_fullsized":"2023-10-08T06:57:19.199355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955383+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:18.955383+0000","last_peered":"2023-10-08T06:57:18.955383+0000","last_clean":"2023-10-08T06:57:18.955383+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:18.955383+0000","last_undegraded":"2023-10-08T06:57:18.955383+0000","last_fullsized":"2023-10-08T06:57:18.955383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199953+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:19.199953+0000","last_peered":"2023-10-08T06:57:19.199953+0000","last_clean":"2023-10-08T06:57:19.199953+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:19.199953+0000","last_undegraded":"2023-10-08T06:57:19.199953+0000","last_fullsized":"2023-10-08T06:57:19.199953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334506+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.334506+0000","last_peered":"2023-10-08T06:57:18.334506+0000","last_clean":"2023-10-08T06:57:18.334506+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.334506+0000","last_undegraded":"2023-10-08T06:57:18.334506+0000","last_fullsized":"2023-10-08T06:57:18.334506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334249+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.334249+0000","last_peered":"2023-10-08T06:57:18.334249+0000","last_clean":"2023-10-08T06:57:18.334249+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.334249+0000","last_undegraded":"2023-10-08T06:57:18.334249+0000","last_fullsized":"2023-10-08T06:57:18.334249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333896+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.333896+0000","last_peered":"2023-10-08T06:57:18.333896+0000","last_clean":"2023-10-08T06:57:18.333896+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.333896+0000","last_undegraded":"2023-10-08T06:57:18.333896+0000","last_fullsized":"2023-10-08T06:57:18.333896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332051+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.332051+0000","last_peered":"2023-10-08T06:57:18.332051+0000","last_clean":"2023-10-08T06:57:18.332051+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.332051+0000","last_undegraded":"2023-10-08T06:57:18.332051+0000","last_fullsized":"2023-10-08T06:57:18.332051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331427+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.331427+0000","last_peered":"2023-10-08T06:57:18.331427+0000","last_clean":"2023-10-08T06:57:18.331427+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.331427+0000","last_undegraded":"2023-10-08T06:57:18.331427+0000","last_fullsized":"2023-10-08T06:57:18.331427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334184+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.334184+0000","last_peered":"2023-10-08T06:57:18.334184+0000","last_clean":"2023-10-08T06:57:18.334184+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.334184+0000","last_undegraded":"2023-10-08T06:57:18.334184+0000","last_fullsized":"2023-10-08T06:57:18.334184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333798+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.333798+0000","last_peered":"2023-10-08T06:57:18.333798+0000","last_clean":"2023-10-08T06:57:18.333798+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.333798+0000","last_undegraded":"2023-10-08T06:57:18.333798+0000","last_fullsized":"2023-10-08T06:57:18.333798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334844+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.334844+0000","last_peered":"2023-10-08T06:57:18.334844+0000","last_clean":"2023-10-08T06:57:18.334844+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.334844+0000","last_undegraded":"2023-10-08T06:57:18.334844+0000","last_fullsized":"2023-10-08T06:57:18.334844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955080+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:18.955080+0000","last_peered":"2023-10-08T06:57:18.955080+0000","last_clean":"2023-10-08T06:57:18.955080+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:18.955080+0000","last_undegraded":"2023-10-08T06:57:18.955080+0000","last_fullsized":"2023-10-08T06:57:18.955080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334527+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.334527+0000","last_peered":"2023-10-08T06:57:18.334527+0000","last_clean":"2023-10-08T06:57:18.334527+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.334527+0000","last_undegraded":"2023-10-08T06:57:18.334527+0000","last_fullsized":"2023-10-08T06:57:18.334527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955052+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:18.955052+0000","last_peered":"2023-10-08T06:57:18.955052+0000","last_clean":"2023-10-08T06:57:18.955052+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:18.955052+0000","last_undegraded":"2023-10-08T06:57:18.955052+0000","last_fullsized":"2023-10-08T06:57:18.955052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332280+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.332280+0000","last_peered":"2023-10-08T06:57:18.332280+0000","last_clean":"2023-10-08T06:57:18.332280+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.332280+0000","last_undegraded":"2023-10-08T06:57:18.332280+0000","last_fullsized":"2023-10-08T06:57:18.332280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322034+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:17.322034+0000","last_peered":"2023-10-08T06:57:17.322034+0000","last_clean":"2023-10-08T06:57:17.322034+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:17.322034+0000","last_undegraded":"2023-10-08T06:57:17.322034+0000","last_fullsized":"2023-10-08T06:57:17.322034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334630+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.334630+0000","last_peered":"2023-10-08T06:57:18.334630+0000","last_clean":"2023-10-08T06:57:18.334630+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.334630+0000","last_undegraded":"2023-10-08T06:57:18.334630+0000","last_fullsized":"2023-10-08T06:57:18.334630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199918+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:19.199918+0000","last_peered":"2023-10-08T06:57:19.199918+0000","last_clean":"2023-10-08T06:57:19.199918+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:19.199918+0000","last_undegraded":"2023-10-08T06:57:19.199918+0000","last_fullsized":"2023-10-08T06:57:19.199918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329398+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:17.329398+0000","last_peered":"2023-10-08T06:57:17.329398+0000","last_clean":"2023-10-08T06:57:17.329398+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:17.329398+0000","last_undegraded":"2023-10-08T06:57:17.329398+0000","last_fullsized":"2023-10-08T06:57:17.329398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334137+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.334137+0000","last_peered":"2023-10-08T06:57:18.334137+0000","last_clean":"2023-10-08T06:57:18.334137+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.334137+0000","last_undegraded":"2023-10-08T06:57:18.334137+0000","last_fullsized":"2023-10-08T06:57:18.334137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332274+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.332274+0000","last_peered":"2023-10-08T06:57:18.332274+0000","last_clean":"2023-10-08T06:57:18.332274+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.332274+0000","last_undegraded":"2023-10-08T06:57:18.332274+0000","last_fullsized":"2023-10-08T06:57:18.332274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.321071+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:17.321071+0000","last_peered":"2023-10-08T06:57:17.321071+0000","last_clean":"2023-10-08T06:57:17.321071+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:17.321071+0000","last_undegraded":"2023-10-08T06:57:17.321071+0000","last_fullsized":"2023-10-08T06:57:17.321071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955037+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:18.955037+0000","last_peered":"2023-10-08T06:57:18.955037+0000","last_clean":"2023-10-08T06:57:18.955037+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:18.955037+0000","last_undegraded":"2023-10-08T06:57:18.955037+0000","last_fullsized":"2023-10-08T06:57:18.955037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332451+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.332451+0000","last_peered":"2023-10-08T06:57:18.332451+0000","last_clean":"2023-10-08T06:57:18.332451+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.332451+0000","last_undegraded":"2023-10-08T06:57:18.332451+0000","last_fullsized":"2023-10-08T06:57:18.332451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330319+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:17.330319+0000","last_peered":"2023-10-08T06:57:17.330319+0000","last_clean":"2023-10-08T06:57:17.330319+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:17.330319+0000","last_undegraded":"2023-10-08T06:57:17.330319+0000","last_fullsized":"2023-10-08T06:57:17.330319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329262+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:17.329262+0000","last_peered":"2023-10-08T06:57:17.329262+0000","last_clean":"2023-10-08T06:57:17.329262+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:17.329262+0000","last_undegraded":"2023-10-08T06:57:17.329262+0000","last_fullsized":"2023-10-08T06:57:17.329262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331430+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.331430+0000","last_peered":"2023-10-08T06:57:18.331430+0000","last_clean":"2023-10-08T06:57:18.331430+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.331430+0000","last_undegraded":"2023-10-08T06:57:18.331430+0000","last_fullsized":"2023-10-08T06:57:18.331430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334793+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.334793+0000","last_peered":"2023-10-08T06:57:18.334793+0000","last_clean":"2023-10-08T06:57:18.334793+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.334793+0000","last_undegraded":"2023-10-08T06:57:18.334793+0000","last_fullsized":"2023-10-08T06:57:18.334793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330138+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:17.330138+0000","last_peered":"2023-10-08T06:57:17.330138+0000","last_clean":"2023-10-08T06:57:17.330138+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:17.330138+0000","last_undegraded":"2023-10-08T06:57:17.330138+0000","last_fullsized":"2023-10-08T06:57:17.330138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331051+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.331051+0000","last_peered":"2023-10-08T06:57:18.331051+0000","last_clean":"2023-10-08T06:57:18.331051+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.331051+0000","last_undegraded":"2023-10-08T06:57:18.331051+0000","last_fullsized":"2023-10-08T06:57:18.331051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200820+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:19.200820+0000","last_peered":"2023-10-08T06:57:19.200820+0000","last_clean":"2023-10-08T06:57:19.200820+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:19.200820+0000","last_undegraded":"2023-10-08T06:57:19.200820+0000","last_fullsized":"2023-10-08T06:57:19.200820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.325509+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:17.325509+0000","last_peered":"2023-10-08T06:57:17.325509+0000","last_clean":"2023-10-08T06:57:17.325509+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:17.325509+0000","last_undegraded":"2023-10-08T06:57:17.325509+0000","last_fullsized":"2023-10-08T06:57:17.325509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332015+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.332015+0000","last_peered":"2023-10-08T06:57:18.332015+0000","last_clean":"2023-10-08T06:57:18.332015+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.332015+0000","last_undegraded":"2023-10-08T06:57:18.332015+0000","last_fullsized":"2023-10-08T06:57:18.332015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200292+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:19.200292+0000","last_peered":"2023-10-08T06:57:19.200292+0000","last_clean":"2023-10-08T06:57:19.200292+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:19.200292+0000","last_undegraded":"2023-10-08T06:57:19.200292+0000","last_fullsized":"2023-10-08T06:57:19.200292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332004+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.332004+0000","last_peered":"2023-10-08T06:57:18.332004+0000","last_clean":"2023-10-08T06:57:18.332004+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.332004+0000","last_undegraded":"2023-10-08T06:57:18.332004+0000","last_fullsized":"2023-10-08T06:57:18.332004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.323142+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:17.323142+0000","last_peered":"2023-10-08T06:57:17.323142+0000","last_clean":"2023-10-08T06:57:17.323142+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:17.323142+0000","last_undegraded":"2023-10-08T06:57:17.323142+0000","last_fullsized":"2023-10-08T06:57:17.323142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.330989+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.330989+0000","last_peered":"2023-10-08T06:57:18.330989+0000","last_clean":"2023-10-08T06:57:18.330989+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.330989+0000","last_undegraded":"2023-10-08T06:57:18.330989+0000","last_fullsized":"2023-10-08T06:57:18.330989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.331023+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:17.331023+0000","last_peered":"2023-10-08T06:57:17.331023+0000","last_clean":"2023-10-08T06:57:17.331023+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:17.331023+0000","last_undegraded":"2023-10-08T06:57:17.331023+0000","last_fullsized":"2023-10-08T06:57:17.331023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952345+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:18.952345+0000","last_peered":"2023-10-08T06:57:18.952345+0000","last_clean":"2023-10-08T06:57:18.952345+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:18.952345+0000","last_undegraded":"2023-10-08T06:57:18.952345+0000","last_fullsized":"2023-10-08T06:57:18.952345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199708+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:19.199708+0000","last_peered":"2023-10-08T06:57:19.199708+0000","last_clean":"2023-10-08T06:57:19.199708+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:19.199708+0000","last_undegraded":"2023-10-08T06:57:19.199708+0000","last_fullsized":"2023-10-08T06:57:19.199708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955224+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:18.955224+0000","last_peered":"2023-10-08T06:57:18.955224+0000","last_clean":"2023-10-08T06:57:18.955224+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:18.955224+0000","last_undegraded":"2023-10-08T06:57:18.955224+0000","last_fullsized":"2023-10-08T06:57:18.955224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200258+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:19.200258+0000","last_peered":"2023-10-08T06:57:19.200258+0000","last_clean":"2023-10-08T06:57:19.200258+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:19.200258+0000","last_undegraded":"2023-10-08T06:57:19.200258+0000","last_fullsized":"2023-10-08T06:57:19.200258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334243+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.334243+0000","last_peered":"2023-10-08T06:57:18.334243+0000","last_clean":"2023-10-08T06:57:18.334243+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.334243+0000","last_undegraded":"2023-10-08T06:57:18.334243+0000","last_fullsized":"2023-10-08T06:57:18.334243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334062+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.334062+0000","last_peered":"2023-10-08T06:57:18.334062+0000","last_clean":"2023-10-08T06:57:18.334062+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.334062+0000","last_undegraded":"2023-10-08T06:57:18.334062+0000","last_fullsized":"2023-10-08T06:57:18.334062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955330+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:18.955330+0000","last_peered":"2023-10-08T06:57:18.955330+0000","last_clean":"2023-10-08T06:57:18.955330+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:18.955330+0000","last_undegraded":"2023-10-08T06:57:18.955330+0000","last_fullsized":"2023-10-08T06:57:18.955330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333951+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.333951+0000","last_peered":"2023-10-08T06:57:18.333951+0000","last_clean":"2023-10-08T06:57:18.333951+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.333951+0000","last_undegraded":"2023-10-08T06:57:18.333951+0000","last_fullsized":"2023-10-08T06:57:18.333951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332288+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.332288+0000","last_peered":"2023-10-08T06:57:18.332288+0000","last_clean":"2023-10-08T06:57:18.332288+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.332288+0000","last_undegraded":"2023-10-08T06:57:18.332288+0000","last_fullsized":"2023-10-08T06:57:18.332288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199990+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:19.199990+0000","last_peered":"2023-10-08T06:57:19.199990+0000","last_clean":"2023-10-08T06:57:19.199990+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:19.199990+0000","last_undegraded":"2023-10-08T06:57:19.199990+0000","last_fullsized":"2023-10-08T06:57:19.199990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332218+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.332218+0000","last_peered":"2023-10-08T06:57:18.332218+0000","last_clean":"2023-10-08T06:57:18.332218+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.332218+0000","last_undegraded":"2023-10-08T06:57:18.332218+0000","last_fullsized":"2023-10-08T06:57:18.332218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334155+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.334155+0000","last_peered":"2023-10-08T06:57:18.334155+0000","last_clean":"2023-10-08T06:57:18.334155+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.334155+0000","last_undegraded":"2023-10-08T06:57:18.334155+0000","last_fullsized":"2023-10-08T06:57:18.334155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333744+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.333744+0000","last_peered":"2023-10-08T06:57:18.333744+0000","last_clean":"2023-10-08T06:57:18.333744+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.333744+0000","last_undegraded":"2023-10-08T06:57:18.333744+0000","last_fullsized":"2023-10-08T06:57:18.333744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331439+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.331439+0000","last_peered":"2023-10-08T06:57:18.331439+0000","last_clean":"2023-10-08T06:57:18.331439+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.331439+0000","last_undegraded":"2023-10-08T06:57:18.331439+0000","last_fullsized":"2023-10-08T06:57:18.331439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199961+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:19.199961+0000","last_peered":"2023-10-08T06:57:19.199961+0000","last_clean":"2023-10-08T06:57:19.199961+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:19.199961+0000","last_undegraded":"2023-10-08T06:57:19.199961+0000","last_fullsized":"2023-10-08T06:57:19.199961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331729+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.331729+0000","last_peered":"2023-10-08T06:57:18.331729+0000","last_clean":"2023-10-08T06:57:18.331729+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.331729+0000","last_undegraded":"2023-10-08T06:57:18.331729+0000","last_fullsized":"2023-10-08T06:57:18.331729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200274+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:19.200274+0000","last_peered":"2023-10-08T06:57:19.200274+0000","last_clean":"2023-10-08T06:57:19.200274+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:19.200274+0000","last_undegraded":"2023-10-08T06:57:19.200274+0000","last_fullsized":"2023-10-08T06:57:19.200274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":650475,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":649859,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:27.171 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T06:57:27.171 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T06:57:27.171 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T06:57:27.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T06:57:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:27.590 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T06:57:27.604 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T06:57:27.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:27.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:18.323568+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:27.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:57:14.549981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:57:15.701169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:57:27.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:57:28.292 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-08T06:57:28.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T06:57:28.643 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-08T06:57:28.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:57:28.995 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-08T06:57:29.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:57:29.349 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-08T06:57:29.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:57:29.746 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:29.770 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:57:16.721133+0000","modified":"2023-10-08T06:57:19.748631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6803/3692271632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3692271632},{"type":"v1","addr":"172.21.15.37:6803","nonce":3692271632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:57:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-08T06:57:29.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:30.110 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:30.110 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:18.323568+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:30.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:57:14.549981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:57:15.701169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:57:30.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:57:30.462 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-08T06:57:30.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T06:57:30.813 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-08T06:57:30.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:57:31.164 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-08T06:57:31.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:57:31.521 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-08T06:57:31.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:57:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:31.913 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:57:16.721133+0000","modified":"2023-10-08T06:57:19.748631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6803/3692271632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3692271632},{"type":"v1","addr":"172.21.15.37:6803","nonce":3692271632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:57:31.916 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-08T06:57:31.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:57:32.265 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:32.265 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T06:57:18.323568+0000","last_up_change":"2023-10-08T06:57:03.011095+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6801","nonce":1488347209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6803","nonce":1488347209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6807","nonce":1488347209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1488347209},{"type":"v1","addr":"172.21.15.183:6805","nonce":1488347209}]},"public_addr":"172.21.15.183:6801/1488347209","cluster_addr":"172.21.15.183:6803/1488347209","heartbeat_back_addr":"172.21.15.183:6807/1488347209","heartbeat_front_addr":"172.21.15.183:6805/1488347209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:57:32.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:57:32.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:57:16.721133+0000","modified":"2023-10-08T06:57:19.748631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6803/3692271632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3692271632},{"type":"v1","addr":"172.21.15.37:6803","nonce":3692271632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:57:32.667 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-08T06:57:32.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T06:57:16.721133+0000', 'modified': '2023-10-08T06:57:19.748631+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6803/3692271632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6802', 'nonce': 3692271632}, {'type': 'v1', 'addr': '172.21.15.37:6803', 'nonce': 3692271632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T06:57:32.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T06:57:32.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T06:57:32.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-08T06:57:32.917+0000 7f70ee7fc700 0 client.4478 ms_handle_reset on v2:172.21.15.37:6802/3692271632 2023-10-08T06:57:32.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-08T06:57:32.939+0000 7f70ee7fc700 0 client.4484 ms_handle_reset on v2:172.21.15.37:6802/3692271632 2023-10-08T06:57:32.941 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T06:57:32.941 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "a28386aa-6313-4530-b2e8-fd7736a43dc5", 2023-10-08T06:57:32.941 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-08T06:57:32.941 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4239, 2023-10-08T06:57:32.941 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-08T06:57:32.941 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-08T06:57:32.942 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-08T06:57:32.942 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 15.617095917, 2023-10-08T06:57:32.942 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 6, 2023-10-08T06:57:32.942 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 19, 2023-10-08T06:57:32.942 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 19, 2023-10-08T06:57:32.942 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 21.541304195999999 2023-10-08T06:57:32.942 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T06:57:32.953 INFO:teuthology.run_tasks:Running task thrashosds... 2023-10-08T06:57:32.965 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-10-08T06:57:32.965 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}} 2023-10-08T06:57:32.965 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-10-08T06:57:32.965 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2023-10-08T06:57:32.966 DEBUG:teuthology.orchestra.run.smithi037:> sync 2023-10-08T06:57:33.182 DEBUG:teuthology.orchestra.run.smithi163:> sync 2023-10-08T06:57:33.261 DEBUG:teuthology.orchestra.run.smithi169:> sync 2023-10-08T06:57:33.411 DEBUG:teuthology.orchestra.run.smithi183:> sync 2023-10-08T06:57:33.510 DEBUG:tasks.thrashosds:checking console status of smithi037 2023-10-08T06:57:33.510 DEBUG:teuthology.orchestra.console.smithi037:Waiting for login prompt 2023-10-08T06:57:33.510 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi037 2023-10-08T06:57:33.679 DEBUG:teuthology.orchestra.console.smithi037:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T06:57:33.679 DEBUG:teuthology.orchestra.console.smithi037:expect after: smithi037 login: 2023-10-08T06:57:33.732 DEBUG:teuthology.orchestra.console.smithi037:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi037 login: [disconnect] 2023-10-08T06:57:33.832 DEBUG:tasks.thrashosds:checking console status of smithi163 2023-10-08T06:57:33.833 DEBUG:teuthology.orchestra.console.smithi163:Waiting for login prompt 2023-10-08T06:57:33.833 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi163 2023-10-08T06:57:33.991 DEBUG:teuthology.orchestra.console.smithi163:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T06:57:33.991 DEBUG:teuthology.orchestra.console.smithi163:expect after: smithi163 login: 2023-10-08T06:57:34.043 DEBUG:teuthology.orchestra.console.smithi163:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi163 login: [disconnect] 2023-10-08T06:57:34.143 DEBUG:tasks.thrashosds:checking console status of smithi169 2023-10-08T06:57:34.144 DEBUG:teuthology.orchestra.console.smithi169:Waiting for login prompt 2023-10-08T06:57:34.144 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi169 2023-10-08T06:57:34.307 DEBUG:teuthology.orchestra.console.smithi169:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T06:57:34.307 DEBUG:teuthology.orchestra.console.smithi169:expect after: smithi169 login: 2023-10-08T06:57:34.359 DEBUG:teuthology.orchestra.console.smithi169:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi169 login: [disconnect] 2023-10-08T06:57:34.461 DEBUG:tasks.thrashosds:checking console status of smithi183 2023-10-08T06:57:34.461 DEBUG:teuthology.orchestra.console.smithi183:Waiting for login prompt 2023-10-08T06:57:34.461 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi183 2023-10-08T06:57:34.617 DEBUG:teuthology.orchestra.console.smithi183:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T06:57:34.617 DEBUG:teuthology.orchestra.console.smithi183:expect after: smithi183 login: 2023-10-08T06:57:34.669 DEBUG:teuthology.orchestra.console.smithi183:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi183 login: [disconnect] 2023-10-08T06:57:34.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-10-08T06:57:35.151 INFO:tasks.thrashosds:Beginning thrashosds... 2023-10-08T06:57:35.151 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T06:57:35.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:35.497 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:35.508 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-08T06:57:34.945904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81728,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033792,"statfs":{"total":289910292480,"available":289826603008,"internally_reserved":0,"allocated":671744,"data_stored":1358647,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002249"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200953+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:19.200953+0000","last_peered":"2023-10-08T06:57:19.200953+0000","last_clean":"2023-10-08T06:57:19.200953+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:19.200953+0000","last_undegraded":"2023-10-08T06:57:19.200953+0000","last_fullsized":"2023-10-08T06:57:19.200953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200608+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:19.200608+0000","last_peered":"2023-10-08T06:57:19.200608+0000","last_clean":"2023-10-08T06:57:19.200608+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:19.200608+0000","last_undegraded":"2023-10-08T06:57:19.200608+0000","last_fullsized":"2023-10-08T06:57:19.200608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334697+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.334697+0000","last_peered":"2023-10-08T06:57:18.334697+0000","last_clean":"2023-10-08T06:57:18.334697+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.334697+0000","last_undegraded":"2023-10-08T06:57:18.334697+0000","last_fullsized":"2023-10-08T06:57:18.334697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334477+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.334477+0000","last_peered":"2023-10-08T06:57:18.334477+0000","last_clean":"2023-10-08T06:57:18.334477+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.334477+0000","last_undegraded":"2023-10-08T06:57:18.334477+0000","last_fullsized":"2023-10-08T06:57:18.334477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200220+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:19.200220+0000","last_peered":"2023-10-08T06:57:19.200220+0000","last_clean":"2023-10-08T06:57:19.200220+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:19.200220+0000","last_undegraded":"2023-10-08T06:57:19.200220+0000","last_fullsized":"2023-10-08T06:57:19.200220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333757+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.333757+0000","last_peered":"2023-10-08T06:57:18.333757+0000","last_clean":"2023-10-08T06:57:18.333757+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.333757+0000","last_undegraded":"2023-10-08T06:57:18.333757+0000","last_fullsized":"2023-10-08T06:57:18.333757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333585+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.333585+0000","last_peered":"2023-10-08T06:57:18.333585+0000","last_clean":"2023-10-08T06:57:18.333585+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.333585+0000","last_undegraded":"2023-10-08T06:57:18.333585+0000","last_fullsized":"2023-10-08T06:57:18.333585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333429+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.333429+0000","last_peered":"2023-10-08T06:57:18.333429+0000","last_clean":"2023-10-08T06:57:18.333429+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.333429+0000","last_undegraded":"2023-10-08T06:57:18.333429+0000","last_fullsized":"2023-10-08T06:57:18.333429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331881+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.331881+0000","last_peered":"2023-10-08T06:57:18.331881+0000","last_clean":"2023-10-08T06:57:18.331881+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.331881+0000","last_undegraded":"2023-10-08T06:57:18.331881+0000","last_fullsized":"2023-10-08T06:57:18.331881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200786+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:19.200786+0000","last_peered":"2023-10-08T06:57:19.200786+0000","last_clean":"2023-10-08T06:57:19.200786+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:19.200786+0000","last_undegraded":"2023-10-08T06:57:19.200786+0000","last_fullsized":"2023-10-08T06:57:19.200786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334400+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.334400+0000","last_peered":"2023-10-08T06:57:18.334400+0000","last_clean":"2023-10-08T06:57:18.334400+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.334400+0000","last_undegraded":"2023-10-08T06:57:18.334400+0000","last_fullsized":"2023-10-08T06:57:18.334400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199983+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:19.199983+0000","last_peered":"2023-10-08T06:57:19.199983+0000","last_clean":"2023-10-08T06:57:19.199983+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:19.199983+0000","last_undegraded":"2023-10-08T06:57:19.199983+0000","last_fullsized":"2023-10-08T06:57:19.199983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200029+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:19.200029+0000","last_peered":"2023-10-08T06:57:19.200029+0000","last_clean":"2023-10-08T06:57:19.200029+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:19.200029+0000","last_undegraded":"2023-10-08T06:57:19.200029+0000","last_fullsized":"2023-10-08T06:57:19.200029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334425+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.334425+0000","last_peered":"2023-10-08T06:57:18.334425+0000","last_clean":"2023-10-08T06:57:18.334425+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.334425+0000","last_undegraded":"2023-10-08T06:57:18.334425+0000","last_fullsized":"2023-10-08T06:57:18.334425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333883+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.333883+0000","last_peered":"2023-10-08T06:57:18.333883+0000","last_clean":"2023-10-08T06:57:18.333883+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.333883+0000","last_undegraded":"2023-10-08T06:57:18.333883+0000","last_fullsized":"2023-10-08T06:57:18.333883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333504+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.333504+0000","last_peered":"2023-10-08T06:57:18.333504+0000","last_clean":"2023-10-08T06:57:18.333504+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.333504+0000","last_undegraded":"2023-10-08T06:57:18.333504+0000","last_fullsized":"2023-10-08T06:57:18.333504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331981+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.331981+0000","last_peered":"2023-10-08T06:57:18.331981+0000","last_clean":"2023-10-08T06:57:18.331981+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.331981+0000","last_undegraded":"2023-10-08T06:57:18.331981+0000","last_fullsized":"2023-10-08T06:57:18.331981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200897+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:19.200897+0000","last_peered":"2023-10-08T06:57:19.200897+0000","last_clean":"2023-10-08T06:57:19.200897+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:19.200897+0000","last_undegraded":"2023-10-08T06:57:19.200897+0000","last_fullsized":"2023-10-08T06:57:19.200897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331998+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.331998+0000","last_peered":"2023-10-08T06:57:18.331998+0000","last_clean":"2023-10-08T06:57:18.331998+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.331998+0000","last_undegraded":"2023-10-08T06:57:18.331998+0000","last_fullsized":"2023-10-08T06:57:18.331998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334495+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.334495+0000","last_peered":"2023-10-08T06:57:18.334495+0000","last_clean":"2023-10-08T06:57:18.334495+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.334495+0000","last_undegraded":"2023-10-08T06:57:18.334495+0000","last_fullsized":"2023-10-08T06:57:18.334495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333990+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.333990+0000","last_peered":"2023-10-08T06:57:18.333990+0000","last_clean":"2023-10-08T06:57:18.333990+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.333990+0000","last_undegraded":"2023-10-08T06:57:18.333990+0000","last_fullsized":"2023-10-08T06:57:18.333990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199761+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:19.199761+0000","last_peered":"2023-10-08T06:57:19.199761+0000","last_clean":"2023-10-08T06:57:19.199761+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:19.199761+0000","last_undegraded":"2023-10-08T06:57:19.199761+0000","last_fullsized":"2023-10-08T06:57:19.199761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:15.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331586+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.331586+0000","last_peered":"2023-10-08T06:57:18.331586+0000","last_clean":"2023-10-08T06:57:18.331586+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.331586+0000","last_undegraded":"2023-10-08T06:57:18.331586+0000","last_fullsized":"2023-10-08T06:57:18.331586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199836+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:19.199836+0000","last_peered":"2023-10-08T06:57:19.199836+0000","last_clean":"2023-10-08T06:57:19.199836+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:19.199836+0000","last_undegraded":"2023-10-08T06:57:19.199836+0000","last_fullsized":"2023-10-08T06:57:19.199836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200845+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:19.200845+0000","last_peered":"2023-10-08T06:57:19.200845+0000","last_clean":"2023-10-08T06:57:19.200845+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:19.200845+0000","last_undegraded":"2023-10-08T06:57:19.200845+0000","last_fullsized":"2023-10-08T06:57:19.200845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331941+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.331941+0000","last_peered":"2023-10-08T06:57:18.331941+0000","last_clean":"2023-10-08T06:57:18.331941+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.331941+0000","last_undegraded":"2023-10-08T06:57:18.331941+0000","last_fullsized":"2023-10-08T06:57:18.331941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334529+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.334529+0000","last_peered":"2023-10-08T06:57:18.334529+0000","last_clean":"2023-10-08T06:57:18.334529+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.334529+0000","last_undegraded":"2023-10-08T06:57:18.334529+0000","last_fullsized":"2023-10-08T06:57:18.334529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955164+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:18.955164+0000","last_peered":"2023-10-08T06:57:18.955164+0000","last_clean":"2023-10-08T06:57:18.955164+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:18.955164+0000","last_undegraded":"2023-10-08T06:57:18.955164+0000","last_fullsized":"2023-10-08T06:57:18.955164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200640+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:19.200640+0000","last_peered":"2023-10-08T06:57:19.200640+0000","last_clean":"2023-10-08T06:57:19.200640+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:19.200640+0000","last_undegraded":"2023-10-08T06:57:19.200640+0000","last_fullsized":"2023-10-08T06:57:19.200640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331590+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.331590+0000","last_peered":"2023-10-08T06:57:18.331590+0000","last_clean":"2023-10-08T06:57:18.331590+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.331590+0000","last_undegraded":"2023-10-08T06:57:18.331590+0000","last_fullsized":"2023-10-08T06:57:18.331590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332180+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.332180+0000","last_peered":"2023-10-08T06:57:18.332180+0000","last_clean":"2023-10-08T06:57:18.332180+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.332180+0000","last_undegraded":"2023-10-08T06:57:18.332180+0000","last_fullsized":"2023-10-08T06:57:18.332180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331115+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.331115+0000","last_peered":"2023-10-08T06:57:18.331115+0000","last_clean":"2023-10-08T06:57:18.331115+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.331115+0000","last_undegraded":"2023-10-08T06:57:18.331115+0000","last_fullsized":"2023-10-08T06:57:18.331115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200839+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:19.200839+0000","last_peered":"2023-10-08T06:57:19.200839+0000","last_clean":"2023-10-08T06:57:19.200839+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:19.200839+0000","last_undegraded":"2023-10-08T06:57:19.200839+0000","last_fullsized":"2023-10-08T06:57:19.200839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332324+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.332324+0000","last_peered":"2023-10-08T06:57:18.332324+0000","last_clean":"2023-10-08T06:57:18.332324+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.332324+0000","last_undegraded":"2023-10-08T06:57:18.332324+0000","last_fullsized":"2023-10-08T06:57:18.332324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331371+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.331371+0000","last_peered":"2023-10-08T06:57:18.331371+0000","last_clean":"2023-10-08T06:57:18.331371+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.331371+0000","last_undegraded":"2023-10-08T06:57:18.331371+0000","last_fullsized":"2023-10-08T06:57:18.331371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334291+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.334291+0000","last_peered":"2023-10-08T06:57:18.334291+0000","last_clean":"2023-10-08T06:57:18.334291+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.334291+0000","last_undegraded":"2023-10-08T06:57:18.334291+0000","last_fullsized":"2023-10-08T06:57:18.334291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331763+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.331763+0000","last_peered":"2023-10-08T06:57:18.331763+0000","last_clean":"2023-10-08T06:57:18.331763+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.331763+0000","last_undegraded":"2023-10-08T06:57:18.331763+0000","last_fullsized":"2023-10-08T06:57:18.331763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955311+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:18.955311+0000","last_peered":"2023-10-08T06:57:18.955311+0000","last_clean":"2023-10-08T06:57:18.955311+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:18.955311+0000","last_undegraded":"2023-10-08T06:57:18.955311+0000","last_fullsized":"2023-10-08T06:57:18.955311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331669+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.331669+0000","last_peered":"2023-10-08T06:57:18.331669+0000","last_clean":"2023-10-08T06:57:18.331669+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.331669+0000","last_undegraded":"2023-10-08T06:57:18.331669+0000","last_fullsized":"2023-10-08T06:57:18.331669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334290+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.334290+0000","last_peered":"2023-10-08T06:57:18.334290+0000","last_clean":"2023-10-08T06:57:18.334290+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.334290+0000","last_undegraded":"2023-10-08T06:57:18.334290+0000","last_fullsized":"2023-10-08T06:57:18.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334365+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.334365+0000","last_peered":"2023-10-08T06:57:18.334365+0000","last_clean":"2023-10-08T06:57:18.334365+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.334365+0000","last_undegraded":"2023-10-08T06:57:18.334365+0000","last_fullsized":"2023-10-08T06:57:18.334365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334237+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.334237+0000","last_peered":"2023-10-08T06:57:18.334237+0000","last_clean":"2023-10-08T06:57:18.334237+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.334237+0000","last_undegraded":"2023-10-08T06:57:18.334237+0000","last_fullsized":"2023-10-08T06:57:18.334237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200115+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:19.200115+0000","last_peered":"2023-10-08T06:57:19.200115+0000","last_clean":"2023-10-08T06:57:19.200115+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:19.200115+0000","last_undegraded":"2023-10-08T06:57:19.200115+0000","last_fullsized":"2023-10-08T06:57:19.200115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331687+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.331687+0000","last_peered":"2023-10-08T06:57:18.331687+0000","last_clean":"2023-10-08T06:57:18.331687+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.331687+0000","last_undegraded":"2023-10-08T06:57:18.331687+0000","last_fullsized":"2023-10-08T06:57:18.331687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200606+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:19.200606+0000","last_peered":"2023-10-08T06:57:19.200606+0000","last_clean":"2023-10-08T06:57:19.200606+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:19.200606+0000","last_undegraded":"2023-10-08T06:57:19.200606+0000","last_fullsized":"2023-10-08T06:57:19.200606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955092+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:18.955092+0000","last_peered":"2023-10-08T06:57:18.955092+0000","last_clean":"2023-10-08T06:57:18.955092+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:18.955092+0000","last_undegraded":"2023-10-08T06:57:18.955092+0000","last_fullsized":"2023-10-08T06:57:18.955092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332284+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.332284+0000","last_peered":"2023-10-08T06:57:18.332284+0000","last_clean":"2023-10-08T06:57:18.332284+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.332284+0000","last_undegraded":"2023-10-08T06:57:18.332284+0000","last_fullsized":"2023-10-08T06:57:18.332284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333778+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.333778+0000","last_peered":"2023-10-08T06:57:18.333778+0000","last_clean":"2023-10-08T06:57:18.333778+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.333778+0000","last_undegraded":"2023-10-08T06:57:18.333778+0000","last_fullsized":"2023-10-08T06:57:18.333778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332441+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.332441+0000","last_peered":"2023-10-08T06:57:18.332441+0000","last_clean":"2023-10-08T06:57:18.332441+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.332441+0000","last_undegraded":"2023-10-08T06:57:18.332441+0000","last_fullsized":"2023-10-08T06:57:18.332441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334724+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.334724+0000","last_peered":"2023-10-08T06:57:18.334724+0000","last_clean":"2023-10-08T06:57:18.334724+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.334724+0000","last_undegraded":"2023-10-08T06:57:18.334724+0000","last_fullsized":"2023-10-08T06:57:18.334724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199355+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:19.199355+0000","last_peered":"2023-10-08T06:57:19.199355+0000","last_clean":"2023-10-08T06:57:19.199355+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:19.199355+0000","last_undegraded":"2023-10-08T06:57:19.199355+0000","last_fullsized":"2023-10-08T06:57:19.199355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955383+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:18.955383+0000","last_peered":"2023-10-08T06:57:18.955383+0000","last_clean":"2023-10-08T06:57:18.955383+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:18.955383+0000","last_undegraded":"2023-10-08T06:57:18.955383+0000","last_fullsized":"2023-10-08T06:57:18.955383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199953+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:19.199953+0000","last_peered":"2023-10-08T06:57:19.199953+0000","last_clean":"2023-10-08T06:57:19.199953+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:19.199953+0000","last_undegraded":"2023-10-08T06:57:19.199953+0000","last_fullsized":"2023-10-08T06:57:19.199953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334506+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.334506+0000","last_peered":"2023-10-08T06:57:18.334506+0000","last_clean":"2023-10-08T06:57:18.334506+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.334506+0000","last_undegraded":"2023-10-08T06:57:18.334506+0000","last_fullsized":"2023-10-08T06:57:18.334506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334249+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.334249+0000","last_peered":"2023-10-08T06:57:18.334249+0000","last_clean":"2023-10-08T06:57:18.334249+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.334249+0000","last_undegraded":"2023-10-08T06:57:18.334249+0000","last_fullsized":"2023-10-08T06:57:18.334249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333896+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.333896+0000","last_peered":"2023-10-08T06:57:18.333896+0000","last_clean":"2023-10-08T06:57:18.333896+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.333896+0000","last_undegraded":"2023-10-08T06:57:18.333896+0000","last_fullsized":"2023-10-08T06:57:18.333896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332051+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.332051+0000","last_peered":"2023-10-08T06:57:18.332051+0000","last_clean":"2023-10-08T06:57:18.332051+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.332051+0000","last_undegraded":"2023-10-08T06:57:18.332051+0000","last_fullsized":"2023-10-08T06:57:18.332051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331427+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.331427+0000","last_peered":"2023-10-08T06:57:18.331427+0000","last_clean":"2023-10-08T06:57:18.331427+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.331427+0000","last_undegraded":"2023-10-08T06:57:18.331427+0000","last_fullsized":"2023-10-08T06:57:18.331427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334184+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.334184+0000","last_peered":"2023-10-08T06:57:18.334184+0000","last_clean":"2023-10-08T06:57:18.334184+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.334184+0000","last_undegraded":"2023-10-08T06:57:18.334184+0000","last_fullsized":"2023-10-08T06:57:18.334184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333798+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.333798+0000","last_peered":"2023-10-08T06:57:18.333798+0000","last_clean":"2023-10-08T06:57:18.333798+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.333798+0000","last_undegraded":"2023-10-08T06:57:18.333798+0000","last_fullsized":"2023-10-08T06:57:18.333798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334844+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.334844+0000","last_peered":"2023-10-08T06:57:18.334844+0000","last_clean":"2023-10-08T06:57:18.334844+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.334844+0000","last_undegraded":"2023-10-08T06:57:18.334844+0000","last_fullsized":"2023-10-08T06:57:18.334844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955080+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:18.955080+0000","last_peered":"2023-10-08T06:57:18.955080+0000","last_clean":"2023-10-08T06:57:18.955080+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:18.955080+0000","last_undegraded":"2023-10-08T06:57:18.955080+0000","last_fullsized":"2023-10-08T06:57:18.955080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334527+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.334527+0000","last_peered":"2023-10-08T06:57:18.334527+0000","last_clean":"2023-10-08T06:57:18.334527+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.334527+0000","last_undegraded":"2023-10-08T06:57:18.334527+0000","last_fullsized":"2023-10-08T06:57:18.334527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955052+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:18.955052+0000","last_peered":"2023-10-08T06:57:18.955052+0000","last_clean":"2023-10-08T06:57:18.955052+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:18.955052+0000","last_undegraded":"2023-10-08T06:57:18.955052+0000","last_fullsized":"2023-10-08T06:57:18.955052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332280+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.332280+0000","last_peered":"2023-10-08T06:57:18.332280+0000","last_clean":"2023-10-08T06:57:18.332280+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.332280+0000","last_undegraded":"2023-10-08T06:57:18.332280+0000","last_fullsized":"2023-10-08T06:57:18.332280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322034+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:17.322034+0000","last_peered":"2023-10-08T06:57:17.322034+0000","last_clean":"2023-10-08T06:57:17.322034+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:17.322034+0000","last_undegraded":"2023-10-08T06:57:17.322034+0000","last_fullsized":"2023-10-08T06:57:17.322034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334630+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.334630+0000","last_peered":"2023-10-08T06:57:18.334630+0000","last_clean":"2023-10-08T06:57:18.334630+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.334630+0000","last_undegraded":"2023-10-08T06:57:18.334630+0000","last_fullsized":"2023-10-08T06:57:18.334630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199918+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:19.199918+0000","last_peered":"2023-10-08T06:57:19.199918+0000","last_clean":"2023-10-08T06:57:19.199918+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:19.199918+0000","last_undegraded":"2023-10-08T06:57:19.199918+0000","last_fullsized":"2023-10-08T06:57:19.199918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329398+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:17.329398+0000","last_peered":"2023-10-08T06:57:17.329398+0000","last_clean":"2023-10-08T06:57:17.329398+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:17.329398+0000","last_undegraded":"2023-10-08T06:57:17.329398+0000","last_fullsized":"2023-10-08T06:57:17.329398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334137+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.334137+0000","last_peered":"2023-10-08T06:57:18.334137+0000","last_clean":"2023-10-08T06:57:18.334137+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.334137+0000","last_undegraded":"2023-10-08T06:57:18.334137+0000","last_fullsized":"2023-10-08T06:57:18.334137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332274+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.332274+0000","last_peered":"2023-10-08T06:57:18.332274+0000","last_clean":"2023-10-08T06:57:18.332274+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.332274+0000","last_undegraded":"2023-10-08T06:57:18.332274+0000","last_fullsized":"2023-10-08T06:57:18.332274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.321071+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:17.321071+0000","last_peered":"2023-10-08T06:57:17.321071+0000","last_clean":"2023-10-08T06:57:17.321071+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:17.321071+0000","last_undegraded":"2023-10-08T06:57:17.321071+0000","last_fullsized":"2023-10-08T06:57:17.321071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955037+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:18.955037+0000","last_peered":"2023-10-08T06:57:18.955037+0000","last_clean":"2023-10-08T06:57:18.955037+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:18.955037+0000","last_undegraded":"2023-10-08T06:57:18.955037+0000","last_fullsized":"2023-10-08T06:57:18.955037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332451+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.332451+0000","last_peered":"2023-10-08T06:57:18.332451+0000","last_clean":"2023-10-08T06:57:18.332451+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.332451+0000","last_undegraded":"2023-10-08T06:57:18.332451+0000","last_fullsized":"2023-10-08T06:57:18.332451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330319+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:17.330319+0000","last_peered":"2023-10-08T06:57:17.330319+0000","last_clean":"2023-10-08T06:57:17.330319+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:17.330319+0000","last_undegraded":"2023-10-08T06:57:17.330319+0000","last_fullsized":"2023-10-08T06:57:17.330319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329262+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:17.329262+0000","last_peered":"2023-10-08T06:57:17.329262+0000","last_clean":"2023-10-08T06:57:17.329262+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:17.329262+0000","last_undegraded":"2023-10-08T06:57:17.329262+0000","last_fullsized":"2023-10-08T06:57:17.329262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331430+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.331430+0000","last_peered":"2023-10-08T06:57:18.331430+0000","last_clean":"2023-10-08T06:57:18.331430+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.331430+0000","last_undegraded":"2023-10-08T06:57:18.331430+0000","last_fullsized":"2023-10-08T06:57:18.331430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334793+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.334793+0000","last_peered":"2023-10-08T06:57:18.334793+0000","last_clean":"2023-10-08T06:57:18.334793+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.334793+0000","last_undegraded":"2023-10-08T06:57:18.334793+0000","last_fullsized":"2023-10-08T06:57:18.334793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330138+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:17.330138+0000","last_peered":"2023-10-08T06:57:17.330138+0000","last_clean":"2023-10-08T06:57:17.330138+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:17.330138+0000","last_undegraded":"2023-10-08T06:57:17.330138+0000","last_fullsized":"2023-10-08T06:57:17.330138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331051+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.331051+0000","last_peered":"2023-10-08T06:57:18.331051+0000","last_clean":"2023-10-08T06:57:18.331051+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.331051+0000","last_undegraded":"2023-10-08T06:57:18.331051+0000","last_fullsized":"2023-10-08T06:57:18.331051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200820+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:19.200820+0000","last_peered":"2023-10-08T06:57:19.200820+0000","last_clean":"2023-10-08T06:57:19.200820+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:19.200820+0000","last_undegraded":"2023-10-08T06:57:19.200820+0000","last_fullsized":"2023-10-08T06:57:19.200820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.325509+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:17.325509+0000","last_peered":"2023-10-08T06:57:17.325509+0000","last_clean":"2023-10-08T06:57:17.325509+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:17.325509+0000","last_undegraded":"2023-10-08T06:57:17.325509+0000","last_fullsized":"2023-10-08T06:57:17.325509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332015+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.332015+0000","last_peered":"2023-10-08T06:57:18.332015+0000","last_clean":"2023-10-08T06:57:18.332015+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.332015+0000","last_undegraded":"2023-10-08T06:57:18.332015+0000","last_fullsized":"2023-10-08T06:57:18.332015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200292+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:19.200292+0000","last_peered":"2023-10-08T06:57:19.200292+0000","last_clean":"2023-10-08T06:57:19.200292+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:19.200292+0000","last_undegraded":"2023-10-08T06:57:19.200292+0000","last_fullsized":"2023-10-08T06:57:19.200292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332004+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.332004+0000","last_peered":"2023-10-08T06:57:18.332004+0000","last_clean":"2023-10-08T06:57:18.332004+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.332004+0000","last_undegraded":"2023-10-08T06:57:18.332004+0000","last_fullsized":"2023-10-08T06:57:18.332004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.323142+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:17.323142+0000","last_peered":"2023-10-08T06:57:17.323142+0000","last_clean":"2023-10-08T06:57:17.323142+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:17.323142+0000","last_undegraded":"2023-10-08T06:57:17.323142+0000","last_fullsized":"2023-10-08T06:57:17.323142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.330989+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.330989+0000","last_peered":"2023-10-08T06:57:18.330989+0000","last_clean":"2023-10-08T06:57:18.330989+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.330989+0000","last_undegraded":"2023-10-08T06:57:18.330989+0000","last_fullsized":"2023-10-08T06:57:18.330989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.331023+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:17.331023+0000","last_peered":"2023-10-08T06:57:17.331023+0000","last_clean":"2023-10-08T06:57:17.331023+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:17.331023+0000","last_undegraded":"2023-10-08T06:57:17.331023+0000","last_fullsized":"2023-10-08T06:57:17.331023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952345+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:18.952345+0000","last_peered":"2023-10-08T06:57:18.952345+0000","last_clean":"2023-10-08T06:57:18.952345+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:18.952345+0000","last_undegraded":"2023-10-08T06:57:18.952345+0000","last_fullsized":"2023-10-08T06:57:18.952345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199708+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:19.199708+0000","last_peered":"2023-10-08T06:57:19.199708+0000","last_clean":"2023-10-08T06:57:19.199708+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:19.199708+0000","last_undegraded":"2023-10-08T06:57:19.199708+0000","last_fullsized":"2023-10-08T06:57:19.199708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955224+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:18.955224+0000","last_peered":"2023-10-08T06:57:18.955224+0000","last_clean":"2023-10-08T06:57:18.955224+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:18.955224+0000","last_undegraded":"2023-10-08T06:57:18.955224+0000","last_fullsized":"2023-10-08T06:57:18.955224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200258+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:19.200258+0000","last_peered":"2023-10-08T06:57:19.200258+0000","last_clean":"2023-10-08T06:57:19.200258+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:19.200258+0000","last_undegraded":"2023-10-08T06:57:19.200258+0000","last_fullsized":"2023-10-08T06:57:19.200258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334243+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.334243+0000","last_peered":"2023-10-08T06:57:18.334243+0000","last_clean":"2023-10-08T06:57:18.334243+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.334243+0000","last_undegraded":"2023-10-08T06:57:18.334243+0000","last_fullsized":"2023-10-08T06:57:18.334243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334062+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.334062+0000","last_peered":"2023-10-08T06:57:18.334062+0000","last_clean":"2023-10-08T06:57:18.334062+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.334062+0000","last_undegraded":"2023-10-08T06:57:18.334062+0000","last_fullsized":"2023-10-08T06:57:18.334062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955330+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:18.955330+0000","last_peered":"2023-10-08T06:57:18.955330+0000","last_clean":"2023-10-08T06:57:18.955330+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:18.955330+0000","last_undegraded":"2023-10-08T06:57:18.955330+0000","last_fullsized":"2023-10-08T06:57:18.955330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333951+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.333951+0000","last_peered":"2023-10-08T06:57:18.333951+0000","last_clean":"2023-10-08T06:57:18.333951+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.333951+0000","last_undegraded":"2023-10-08T06:57:18.333951+0000","last_fullsized":"2023-10-08T06:57:18.333951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332288+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.332288+0000","last_peered":"2023-10-08T06:57:18.332288+0000","last_clean":"2023-10-08T06:57:18.332288+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.332288+0000","last_undegraded":"2023-10-08T06:57:18.332288+0000","last_fullsized":"2023-10-08T06:57:18.332288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199990+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:19.199990+0000","last_peered":"2023-10-08T06:57:19.199990+0000","last_clean":"2023-10-08T06:57:19.199990+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:19.199990+0000","last_undegraded":"2023-10-08T06:57:19.199990+0000","last_fullsized":"2023-10-08T06:57:19.199990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332218+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.332218+0000","last_peered":"2023-10-08T06:57:18.332218+0000","last_clean":"2023-10-08T06:57:18.332218+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.332218+0000","last_undegraded":"2023-10-08T06:57:18.332218+0000","last_fullsized":"2023-10-08T06:57:18.332218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334155+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.334155+0000","last_peered":"2023-10-08T06:57:18.334155+0000","last_clean":"2023-10-08T06:57:18.334155+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.334155+0000","last_undegraded":"2023-10-08T06:57:18.334155+0000","last_fullsized":"2023-10-08T06:57:18.334155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333744+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.333744+0000","last_peered":"2023-10-08T06:57:18.333744+0000","last_clean":"2023-10-08T06:57:18.333744+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.333744+0000","last_undegraded":"2023-10-08T06:57:18.333744+0000","last_fullsized":"2023-10-08T06:57:18.333744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331439+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.331439+0000","last_peered":"2023-10-08T06:57:18.331439+0000","last_clean":"2023-10-08T06:57:18.331439+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.331439+0000","last_undegraded":"2023-10-08T06:57:18.331439+0000","last_fullsized":"2023-10-08T06:57:18.331439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199961+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:19.199961+0000","last_peered":"2023-10-08T06:57:19.199961+0000","last_clean":"2023-10-08T06:57:19.199961+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:19.199961+0000","last_undegraded":"2023-10-08T06:57:19.199961+0000","last_fullsized":"2023-10-08T06:57:19.199961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331729+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.331729+0000","last_peered":"2023-10-08T06:57:18.331729+0000","last_clean":"2023-10-08T06:57:18.331729+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.331729+0000","last_undegraded":"2023-10-08T06:57:18.331729+0000","last_fullsized":"2023-10-08T06:57:18.331729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200274+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:19.200274+0000","last_peered":"2023-10-08T06:57:19.200274+0000","last_clean":"2023-10-08T06:57:19.200274+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:19.200274+0000","last_undegraded":"2023-10-08T06:57:19.200274+0000","last_fullsized":"2023-10-08T06:57:19.200274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":650475,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":649859,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:35.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:35.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:35.890 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:35.901 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-08T06:57:34.945904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81728,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033792,"statfs":{"total":289910292480,"available":289826603008,"internally_reserved":0,"allocated":671744,"data_stored":1358647,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002249"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200953+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:19.200953+0000","last_peered":"2023-10-08T06:57:19.200953+0000","last_clean":"2023-10-08T06:57:19.200953+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:19.200953+0000","last_undegraded":"2023-10-08T06:57:19.200953+0000","last_fullsized":"2023-10-08T06:57:19.200953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200608+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:19.200608+0000","last_peered":"2023-10-08T06:57:19.200608+0000","last_clean":"2023-10-08T06:57:19.200608+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:19.200608+0000","last_undegraded":"2023-10-08T06:57:19.200608+0000","last_fullsized":"2023-10-08T06:57:19.200608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334697+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.334697+0000","last_peered":"2023-10-08T06:57:18.334697+0000","last_clean":"2023-10-08T06:57:18.334697+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.334697+0000","last_undegraded":"2023-10-08T06:57:18.334697+0000","last_fullsized":"2023-10-08T06:57:18.334697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334477+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.334477+0000","last_peered":"2023-10-08T06:57:18.334477+0000","last_clean":"2023-10-08T06:57:18.334477+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.334477+0000","last_undegraded":"2023-10-08T06:57:18.334477+0000","last_fullsized":"2023-10-08T06:57:18.334477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200220+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:19.200220+0000","last_peered":"2023-10-08T06:57:19.200220+0000","last_clean":"2023-10-08T06:57:19.200220+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:19.200220+0000","last_undegraded":"2023-10-08T06:57:19.200220+0000","last_fullsized":"2023-10-08T06:57:19.200220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333757+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.333757+0000","last_peered":"2023-10-08T06:57:18.333757+0000","last_clean":"2023-10-08T06:57:18.333757+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.333757+0000","last_undegraded":"2023-10-08T06:57:18.333757+0000","last_fullsized":"2023-10-08T06:57:18.333757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333585+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.333585+0000","last_peered":"2023-10-08T06:57:18.333585+0000","last_clean":"2023-10-08T06:57:18.333585+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.333585+0000","last_undegraded":"2023-10-08T06:57:18.333585+0000","last_fullsized":"2023-10-08T06:57:18.333585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333429+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.333429+0000","last_peered":"2023-10-08T06:57:18.333429+0000","last_clean":"2023-10-08T06:57:18.333429+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.333429+0000","last_undegraded":"2023-10-08T06:57:18.333429+0000","last_fullsized":"2023-10-08T06:57:18.333429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331881+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.331881+0000","last_peered":"2023-10-08T06:57:18.331881+0000","last_clean":"2023-10-08T06:57:18.331881+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.331881+0000","last_undegraded":"2023-10-08T06:57:18.331881+0000","last_fullsized":"2023-10-08T06:57:18.331881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200786+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:19.200786+0000","last_peered":"2023-10-08T06:57:19.200786+0000","last_clean":"2023-10-08T06:57:19.200786+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:19.200786+0000","last_undegraded":"2023-10-08T06:57:19.200786+0000","last_fullsized":"2023-10-08T06:57:19.200786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334400+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.334400+0000","last_peered":"2023-10-08T06:57:18.334400+0000","last_clean":"2023-10-08T06:57:18.334400+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.334400+0000","last_undegraded":"2023-10-08T06:57:18.334400+0000","last_fullsized":"2023-10-08T06:57:18.334400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199983+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:19.199983+0000","last_peered":"2023-10-08T06:57:19.199983+0000","last_clean":"2023-10-08T06:57:19.199983+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:19.199983+0000","last_undegraded":"2023-10-08T06:57:19.199983+0000","last_fullsized":"2023-10-08T06:57:19.199983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200029+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:19.200029+0000","last_peered":"2023-10-08T06:57:19.200029+0000","last_clean":"2023-10-08T06:57:19.200029+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:19.200029+0000","last_undegraded":"2023-10-08T06:57:19.200029+0000","last_fullsized":"2023-10-08T06:57:19.200029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334425+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.334425+0000","last_peered":"2023-10-08T06:57:18.334425+0000","last_clean":"2023-10-08T06:57:18.334425+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.334425+0000","last_undegraded":"2023-10-08T06:57:18.334425+0000","last_fullsized":"2023-10-08T06:57:18.334425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333883+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.333883+0000","last_peered":"2023-10-08T06:57:18.333883+0000","last_clean":"2023-10-08T06:57:18.333883+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.333883+0000","last_undegraded":"2023-10-08T06:57:18.333883+0000","last_fullsized":"2023-10-08T06:57:18.333883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333504+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.333504+0000","last_peered":"2023-10-08T06:57:18.333504+0000","last_clean":"2023-10-08T06:57:18.333504+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.333504+0000","last_undegraded":"2023-10-08T06:57:18.333504+0000","last_fullsized":"2023-10-08T06:57:18.333504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331981+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.331981+0000","last_peered":"2023-10-08T06:57:18.331981+0000","last_clean":"2023-10-08T06:57:18.331981+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.331981+0000","last_undegraded":"2023-10-08T06:57:18.331981+0000","last_fullsized":"2023-10-08T06:57:18.331981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200897+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:19.200897+0000","last_peered":"2023-10-08T06:57:19.200897+0000","last_clean":"2023-10-08T06:57:19.200897+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:19.200897+0000","last_undegraded":"2023-10-08T06:57:19.200897+0000","last_fullsized":"2023-10-08T06:57:19.200897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331998+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.331998+0000","last_peered":"2023-10-08T06:57:18.331998+0000","last_clean":"2023-10-08T06:57:18.331998+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.331998+0000","last_undegraded":"2023-10-08T06:57:18.331998+0000","last_fullsized":"2023-10-08T06:57:18.331998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334495+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.334495+0000","last_peered":"2023-10-08T06:57:18.334495+0000","last_clean":"2023-10-08T06:57:18.334495+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.334495+0000","last_undegraded":"2023-10-08T06:57:18.334495+0000","last_fullsized":"2023-10-08T06:57:18.334495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333990+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.333990+0000","last_peered":"2023-10-08T06:57:18.333990+0000","last_clean":"2023-10-08T06:57:18.333990+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.333990+0000","last_undegraded":"2023-10-08T06:57:18.333990+0000","last_fullsized":"2023-10-08T06:57:18.333990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199761+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:19.199761+0000","last_peered":"2023-10-08T06:57:19.199761+0000","last_clean":"2023-10-08T06:57:19.199761+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:19.199761+0000","last_undegraded":"2023-10-08T06:57:19.199761+0000","last_fullsized":"2023-10-08T06:57:19.199761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:15.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331586+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.331586+0000","last_peered":"2023-10-08T06:57:18.331586+0000","last_clean":"2023-10-08T06:57:18.331586+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.331586+0000","last_undegraded":"2023-10-08T06:57:18.331586+0000","last_fullsized":"2023-10-08T06:57:18.331586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199836+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:19.199836+0000","last_peered":"2023-10-08T06:57:19.199836+0000","last_clean":"2023-10-08T06:57:19.199836+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:19.199836+0000","last_undegraded":"2023-10-08T06:57:19.199836+0000","last_fullsized":"2023-10-08T06:57:19.199836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200845+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:19.200845+0000","last_peered":"2023-10-08T06:57:19.200845+0000","last_clean":"2023-10-08T06:57:19.200845+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:19.200845+0000","last_undegraded":"2023-10-08T06:57:19.200845+0000","last_fullsized":"2023-10-08T06:57:19.200845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331941+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.331941+0000","last_peered":"2023-10-08T06:57:18.331941+0000","last_clean":"2023-10-08T06:57:18.331941+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.331941+0000","last_undegraded":"2023-10-08T06:57:18.331941+0000","last_fullsized":"2023-10-08T06:57:18.331941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334529+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.334529+0000","last_peered":"2023-10-08T06:57:18.334529+0000","last_clean":"2023-10-08T06:57:18.334529+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.334529+0000","last_undegraded":"2023-10-08T06:57:18.334529+0000","last_fullsized":"2023-10-08T06:57:18.334529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955164+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:18.955164+0000","last_peered":"2023-10-08T06:57:18.955164+0000","last_clean":"2023-10-08T06:57:18.955164+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:18.955164+0000","last_undegraded":"2023-10-08T06:57:18.955164+0000","last_fullsized":"2023-10-08T06:57:18.955164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200640+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:19.200640+0000","last_peered":"2023-10-08T06:57:19.200640+0000","last_clean":"2023-10-08T06:57:19.200640+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:19.200640+0000","last_undegraded":"2023-10-08T06:57:19.200640+0000","last_fullsized":"2023-10-08T06:57:19.200640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331590+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.331590+0000","last_peered":"2023-10-08T06:57:18.331590+0000","last_clean":"2023-10-08T06:57:18.331590+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.331590+0000","last_undegraded":"2023-10-08T06:57:18.331590+0000","last_fullsized":"2023-10-08T06:57:18.331590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332180+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.332180+0000","last_peered":"2023-10-08T06:57:18.332180+0000","last_clean":"2023-10-08T06:57:18.332180+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.332180+0000","last_undegraded":"2023-10-08T06:57:18.332180+0000","last_fullsized":"2023-10-08T06:57:18.332180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331115+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.331115+0000","last_peered":"2023-10-08T06:57:18.331115+0000","last_clean":"2023-10-08T06:57:18.331115+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.331115+0000","last_undegraded":"2023-10-08T06:57:18.331115+0000","last_fullsized":"2023-10-08T06:57:18.331115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200839+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:19.200839+0000","last_peered":"2023-10-08T06:57:19.200839+0000","last_clean":"2023-10-08T06:57:19.200839+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:19.200839+0000","last_undegraded":"2023-10-08T06:57:19.200839+0000","last_fullsized":"2023-10-08T06:57:19.200839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332324+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.332324+0000","last_peered":"2023-10-08T06:57:18.332324+0000","last_clean":"2023-10-08T06:57:18.332324+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.332324+0000","last_undegraded":"2023-10-08T06:57:18.332324+0000","last_fullsized":"2023-10-08T06:57:18.332324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331371+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.331371+0000","last_peered":"2023-10-08T06:57:18.331371+0000","last_clean":"2023-10-08T06:57:18.331371+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.331371+0000","last_undegraded":"2023-10-08T06:57:18.331371+0000","last_fullsized":"2023-10-08T06:57:18.331371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334291+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.334291+0000","last_peered":"2023-10-08T06:57:18.334291+0000","last_clean":"2023-10-08T06:57:18.334291+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.334291+0000","last_undegraded":"2023-10-08T06:57:18.334291+0000","last_fullsized":"2023-10-08T06:57:18.334291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331763+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.331763+0000","last_peered":"2023-10-08T06:57:18.331763+0000","last_clean":"2023-10-08T06:57:18.331763+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.331763+0000","last_undegraded":"2023-10-08T06:57:18.331763+0000","last_fullsized":"2023-10-08T06:57:18.331763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955311+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:18.955311+0000","last_peered":"2023-10-08T06:57:18.955311+0000","last_clean":"2023-10-08T06:57:18.955311+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:18.955311+0000","last_undegraded":"2023-10-08T06:57:18.955311+0000","last_fullsized":"2023-10-08T06:57:18.955311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331669+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.331669+0000","last_peered":"2023-10-08T06:57:18.331669+0000","last_clean":"2023-10-08T06:57:18.331669+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.331669+0000","last_undegraded":"2023-10-08T06:57:18.331669+0000","last_fullsized":"2023-10-08T06:57:18.331669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334290+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.334290+0000","last_peered":"2023-10-08T06:57:18.334290+0000","last_clean":"2023-10-08T06:57:18.334290+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.334290+0000","last_undegraded":"2023-10-08T06:57:18.334290+0000","last_fullsized":"2023-10-08T06:57:18.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334365+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.334365+0000","last_peered":"2023-10-08T06:57:18.334365+0000","last_clean":"2023-10-08T06:57:18.334365+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.334365+0000","last_undegraded":"2023-10-08T06:57:18.334365+0000","last_fullsized":"2023-10-08T06:57:18.334365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334237+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.334237+0000","last_peered":"2023-10-08T06:57:18.334237+0000","last_clean":"2023-10-08T06:57:18.334237+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.334237+0000","last_undegraded":"2023-10-08T06:57:18.334237+0000","last_fullsized":"2023-10-08T06:57:18.334237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200115+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:19.200115+0000","last_peered":"2023-10-08T06:57:19.200115+0000","last_clean":"2023-10-08T06:57:19.200115+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:19.200115+0000","last_undegraded":"2023-10-08T06:57:19.200115+0000","last_fullsized":"2023-10-08T06:57:19.200115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331687+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.331687+0000","last_peered":"2023-10-08T06:57:18.331687+0000","last_clean":"2023-10-08T06:57:18.331687+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.331687+0000","last_undegraded":"2023-10-08T06:57:18.331687+0000","last_fullsized":"2023-10-08T06:57:18.331687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200606+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:19.200606+0000","last_peered":"2023-10-08T06:57:19.200606+0000","last_clean":"2023-10-08T06:57:19.200606+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:19.200606+0000","last_undegraded":"2023-10-08T06:57:19.200606+0000","last_fullsized":"2023-10-08T06:57:19.200606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955092+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:18.955092+0000","last_peered":"2023-10-08T06:57:18.955092+0000","last_clean":"2023-10-08T06:57:18.955092+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:18.955092+0000","last_undegraded":"2023-10-08T06:57:18.955092+0000","last_fullsized":"2023-10-08T06:57:18.955092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332284+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.332284+0000","last_peered":"2023-10-08T06:57:18.332284+0000","last_clean":"2023-10-08T06:57:18.332284+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.332284+0000","last_undegraded":"2023-10-08T06:57:18.332284+0000","last_fullsized":"2023-10-08T06:57:18.332284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333778+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.333778+0000","last_peered":"2023-10-08T06:57:18.333778+0000","last_clean":"2023-10-08T06:57:18.333778+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.333778+0000","last_undegraded":"2023-10-08T06:57:18.333778+0000","last_fullsized":"2023-10-08T06:57:18.333778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332441+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.332441+0000","last_peered":"2023-10-08T06:57:18.332441+0000","last_clean":"2023-10-08T06:57:18.332441+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.332441+0000","last_undegraded":"2023-10-08T06:57:18.332441+0000","last_fullsized":"2023-10-08T06:57:18.332441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334724+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.334724+0000","last_peered":"2023-10-08T06:57:18.334724+0000","last_clean":"2023-10-08T06:57:18.334724+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.334724+0000","last_undegraded":"2023-10-08T06:57:18.334724+0000","last_fullsized":"2023-10-08T06:57:18.334724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199355+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:19.199355+0000","last_peered":"2023-10-08T06:57:19.199355+0000","last_clean":"2023-10-08T06:57:19.199355+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:19.199355+0000","last_undegraded":"2023-10-08T06:57:19.199355+0000","last_fullsized":"2023-10-08T06:57:19.199355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955383+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:18.955383+0000","last_peered":"2023-10-08T06:57:18.955383+0000","last_clean":"2023-10-08T06:57:18.955383+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:18.955383+0000","last_undegraded":"2023-10-08T06:57:18.955383+0000","last_fullsized":"2023-10-08T06:57:18.955383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199953+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:19.199953+0000","last_peered":"2023-10-08T06:57:19.199953+0000","last_clean":"2023-10-08T06:57:19.199953+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:19.199953+0000","last_undegraded":"2023-10-08T06:57:19.199953+0000","last_fullsized":"2023-10-08T06:57:19.199953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334506+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.334506+0000","last_peered":"2023-10-08T06:57:18.334506+0000","last_clean":"2023-10-08T06:57:18.334506+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.334506+0000","last_undegraded":"2023-10-08T06:57:18.334506+0000","last_fullsized":"2023-10-08T06:57:18.334506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334249+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.334249+0000","last_peered":"2023-10-08T06:57:18.334249+0000","last_clean":"2023-10-08T06:57:18.334249+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.334249+0000","last_undegraded":"2023-10-08T06:57:18.334249+0000","last_fullsized":"2023-10-08T06:57:18.334249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333896+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.333896+0000","last_peered":"2023-10-08T06:57:18.333896+0000","last_clean":"2023-10-08T06:57:18.333896+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.333896+0000","last_undegraded":"2023-10-08T06:57:18.333896+0000","last_fullsized":"2023-10-08T06:57:18.333896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332051+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.332051+0000","last_peered":"2023-10-08T06:57:18.332051+0000","last_clean":"2023-10-08T06:57:18.332051+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.332051+0000","last_undegraded":"2023-10-08T06:57:18.332051+0000","last_fullsized":"2023-10-08T06:57:18.332051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331427+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.331427+0000","last_peered":"2023-10-08T06:57:18.331427+0000","last_clean":"2023-10-08T06:57:18.331427+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.331427+0000","last_undegraded":"2023-10-08T06:57:18.331427+0000","last_fullsized":"2023-10-08T06:57:18.331427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334184+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.334184+0000","last_peered":"2023-10-08T06:57:18.334184+0000","last_clean":"2023-10-08T06:57:18.334184+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.334184+0000","last_undegraded":"2023-10-08T06:57:18.334184+0000","last_fullsized":"2023-10-08T06:57:18.334184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333798+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.333798+0000","last_peered":"2023-10-08T06:57:18.333798+0000","last_clean":"2023-10-08T06:57:18.333798+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.333798+0000","last_undegraded":"2023-10-08T06:57:18.333798+0000","last_fullsized":"2023-10-08T06:57:18.333798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334844+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.334844+0000","last_peered":"2023-10-08T06:57:18.334844+0000","last_clean":"2023-10-08T06:57:18.334844+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.334844+0000","last_undegraded":"2023-10-08T06:57:18.334844+0000","last_fullsized":"2023-10-08T06:57:18.334844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955080+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:18.955080+0000","last_peered":"2023-10-08T06:57:18.955080+0000","last_clean":"2023-10-08T06:57:18.955080+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:18.955080+0000","last_undegraded":"2023-10-08T06:57:18.955080+0000","last_fullsized":"2023-10-08T06:57:18.955080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334527+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.334527+0000","last_peered":"2023-10-08T06:57:18.334527+0000","last_clean":"2023-10-08T06:57:18.334527+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.334527+0000","last_undegraded":"2023-10-08T06:57:18.334527+0000","last_fullsized":"2023-10-08T06:57:18.334527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955052+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:18.955052+0000","last_peered":"2023-10-08T06:57:18.955052+0000","last_clean":"2023-10-08T06:57:18.955052+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:18.955052+0000","last_undegraded":"2023-10-08T06:57:18.955052+0000","last_fullsized":"2023-10-08T06:57:18.955052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332280+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.332280+0000","last_peered":"2023-10-08T06:57:18.332280+0000","last_clean":"2023-10-08T06:57:18.332280+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.332280+0000","last_undegraded":"2023-10-08T06:57:18.332280+0000","last_fullsized":"2023-10-08T06:57:18.332280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322034+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:17.322034+0000","last_peered":"2023-10-08T06:57:17.322034+0000","last_clean":"2023-10-08T06:57:17.322034+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:17.322034+0000","last_undegraded":"2023-10-08T06:57:17.322034+0000","last_fullsized":"2023-10-08T06:57:17.322034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334630+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.334630+0000","last_peered":"2023-10-08T06:57:18.334630+0000","last_clean":"2023-10-08T06:57:18.334630+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.334630+0000","last_undegraded":"2023-10-08T06:57:18.334630+0000","last_fullsized":"2023-10-08T06:57:18.334630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199918+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:19.199918+0000","last_peered":"2023-10-08T06:57:19.199918+0000","last_clean":"2023-10-08T06:57:19.199918+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:19.199918+0000","last_undegraded":"2023-10-08T06:57:19.199918+0000","last_fullsized":"2023-10-08T06:57:19.199918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329398+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:17.329398+0000","last_peered":"2023-10-08T06:57:17.329398+0000","last_clean":"2023-10-08T06:57:17.329398+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:17.329398+0000","last_undegraded":"2023-10-08T06:57:17.329398+0000","last_fullsized":"2023-10-08T06:57:17.329398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334137+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.334137+0000","last_peered":"2023-10-08T06:57:18.334137+0000","last_clean":"2023-10-08T06:57:18.334137+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.334137+0000","last_undegraded":"2023-10-08T06:57:18.334137+0000","last_fullsized":"2023-10-08T06:57:18.334137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332274+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.332274+0000","last_peered":"2023-10-08T06:57:18.332274+0000","last_clean":"2023-10-08T06:57:18.332274+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.332274+0000","last_undegraded":"2023-10-08T06:57:18.332274+0000","last_fullsized":"2023-10-08T06:57:18.332274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.321071+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:17.321071+0000","last_peered":"2023-10-08T06:57:17.321071+0000","last_clean":"2023-10-08T06:57:17.321071+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:17.321071+0000","last_undegraded":"2023-10-08T06:57:17.321071+0000","last_fullsized":"2023-10-08T06:57:17.321071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955037+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:18.955037+0000","last_peered":"2023-10-08T06:57:18.955037+0000","last_clean":"2023-10-08T06:57:18.955037+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:18.955037+0000","last_undegraded":"2023-10-08T06:57:18.955037+0000","last_fullsized":"2023-10-08T06:57:18.955037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332451+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.332451+0000","last_peered":"2023-10-08T06:57:18.332451+0000","last_clean":"2023-10-08T06:57:18.332451+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.332451+0000","last_undegraded":"2023-10-08T06:57:18.332451+0000","last_fullsized":"2023-10-08T06:57:18.332451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330319+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:17.330319+0000","last_peered":"2023-10-08T06:57:17.330319+0000","last_clean":"2023-10-08T06:57:17.330319+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:17.330319+0000","last_undegraded":"2023-10-08T06:57:17.330319+0000","last_fullsized":"2023-10-08T06:57:17.330319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329262+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:17.329262+0000","last_peered":"2023-10-08T06:57:17.329262+0000","last_clean":"2023-10-08T06:57:17.329262+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:17.329262+0000","last_undegraded":"2023-10-08T06:57:17.329262+0000","last_fullsized":"2023-10-08T06:57:17.329262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331430+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.331430+0000","last_peered":"2023-10-08T06:57:18.331430+0000","last_clean":"2023-10-08T06:57:18.331430+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.331430+0000","last_undegraded":"2023-10-08T06:57:18.331430+0000","last_fullsized":"2023-10-08T06:57:18.331430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334793+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.334793+0000","last_peered":"2023-10-08T06:57:18.334793+0000","last_clean":"2023-10-08T06:57:18.334793+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.334793+0000","last_undegraded":"2023-10-08T06:57:18.334793+0000","last_fullsized":"2023-10-08T06:57:18.334793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330138+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:17.330138+0000","last_peered":"2023-10-08T06:57:17.330138+0000","last_clean":"2023-10-08T06:57:17.330138+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:17.330138+0000","last_undegraded":"2023-10-08T06:57:17.330138+0000","last_fullsized":"2023-10-08T06:57:17.330138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331051+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.331051+0000","last_peered":"2023-10-08T06:57:18.331051+0000","last_clean":"2023-10-08T06:57:18.331051+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.331051+0000","last_undegraded":"2023-10-08T06:57:18.331051+0000","last_fullsized":"2023-10-08T06:57:18.331051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200820+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:19.200820+0000","last_peered":"2023-10-08T06:57:19.200820+0000","last_clean":"2023-10-08T06:57:19.200820+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:19.200820+0000","last_undegraded":"2023-10-08T06:57:19.200820+0000","last_fullsized":"2023-10-08T06:57:19.200820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.325509+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:17.325509+0000","last_peered":"2023-10-08T06:57:17.325509+0000","last_clean":"2023-10-08T06:57:17.325509+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:17.325509+0000","last_undegraded":"2023-10-08T06:57:17.325509+0000","last_fullsized":"2023-10-08T06:57:17.325509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332015+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.332015+0000","last_peered":"2023-10-08T06:57:18.332015+0000","last_clean":"2023-10-08T06:57:18.332015+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.332015+0000","last_undegraded":"2023-10-08T06:57:18.332015+0000","last_fullsized":"2023-10-08T06:57:18.332015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200292+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:19.200292+0000","last_peered":"2023-10-08T06:57:19.200292+0000","last_clean":"2023-10-08T06:57:19.200292+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:19.200292+0000","last_undegraded":"2023-10-08T06:57:19.200292+0000","last_fullsized":"2023-10-08T06:57:19.200292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332004+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.332004+0000","last_peered":"2023-10-08T06:57:18.332004+0000","last_clean":"2023-10-08T06:57:18.332004+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.332004+0000","last_undegraded":"2023-10-08T06:57:18.332004+0000","last_fullsized":"2023-10-08T06:57:18.332004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.323142+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:17.323142+0000","last_peered":"2023-10-08T06:57:17.323142+0000","last_clean":"2023-10-08T06:57:17.323142+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:17.323142+0000","last_undegraded":"2023-10-08T06:57:17.323142+0000","last_fullsized":"2023-10-08T06:57:17.323142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.330989+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.330989+0000","last_peered":"2023-10-08T06:57:18.330989+0000","last_clean":"2023-10-08T06:57:18.330989+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.330989+0000","last_undegraded":"2023-10-08T06:57:18.330989+0000","last_fullsized":"2023-10-08T06:57:18.330989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.331023+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:17.331023+0000","last_peered":"2023-10-08T06:57:17.331023+0000","last_clean":"2023-10-08T06:57:17.331023+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:17.331023+0000","last_undegraded":"2023-10-08T06:57:17.331023+0000","last_fullsized":"2023-10-08T06:57:17.331023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952345+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:18.952345+0000","last_peered":"2023-10-08T06:57:18.952345+0000","last_clean":"2023-10-08T06:57:18.952345+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:18.952345+0000","last_undegraded":"2023-10-08T06:57:18.952345+0000","last_fullsized":"2023-10-08T06:57:18.952345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199708+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:19.199708+0000","last_peered":"2023-10-08T06:57:19.199708+0000","last_clean":"2023-10-08T06:57:19.199708+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:19.199708+0000","last_undegraded":"2023-10-08T06:57:19.199708+0000","last_fullsized":"2023-10-08T06:57:19.199708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955224+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:18.955224+0000","last_peered":"2023-10-08T06:57:18.955224+0000","last_clean":"2023-10-08T06:57:18.955224+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:18.955224+0000","last_undegraded":"2023-10-08T06:57:18.955224+0000","last_fullsized":"2023-10-08T06:57:18.955224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200258+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:19.200258+0000","last_peered":"2023-10-08T06:57:19.200258+0000","last_clean":"2023-10-08T06:57:19.200258+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:19.200258+0000","last_undegraded":"2023-10-08T06:57:19.200258+0000","last_fullsized":"2023-10-08T06:57:19.200258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334243+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.334243+0000","last_peered":"2023-10-08T06:57:18.334243+0000","last_clean":"2023-10-08T06:57:18.334243+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.334243+0000","last_undegraded":"2023-10-08T06:57:18.334243+0000","last_fullsized":"2023-10-08T06:57:18.334243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334062+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.334062+0000","last_peered":"2023-10-08T06:57:18.334062+0000","last_clean":"2023-10-08T06:57:18.334062+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.334062+0000","last_undegraded":"2023-10-08T06:57:18.334062+0000","last_fullsized":"2023-10-08T06:57:18.334062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955330+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:18.955330+0000","last_peered":"2023-10-08T06:57:18.955330+0000","last_clean":"2023-10-08T06:57:18.955330+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:18.955330+0000","last_undegraded":"2023-10-08T06:57:18.955330+0000","last_fullsized":"2023-10-08T06:57:18.955330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333951+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.333951+0000","last_peered":"2023-10-08T06:57:18.333951+0000","last_clean":"2023-10-08T06:57:18.333951+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.333951+0000","last_undegraded":"2023-10-08T06:57:18.333951+0000","last_fullsized":"2023-10-08T06:57:18.333951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332288+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.332288+0000","last_peered":"2023-10-08T06:57:18.332288+0000","last_clean":"2023-10-08T06:57:18.332288+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.332288+0000","last_undegraded":"2023-10-08T06:57:18.332288+0000","last_fullsized":"2023-10-08T06:57:18.332288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199990+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:19.199990+0000","last_peered":"2023-10-08T06:57:19.199990+0000","last_clean":"2023-10-08T06:57:19.199990+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:19.199990+0000","last_undegraded":"2023-10-08T06:57:19.199990+0000","last_fullsized":"2023-10-08T06:57:19.199990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332218+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.332218+0000","last_peered":"2023-10-08T06:57:18.332218+0000","last_clean":"2023-10-08T06:57:18.332218+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.332218+0000","last_undegraded":"2023-10-08T06:57:18.332218+0000","last_fullsized":"2023-10-08T06:57:18.332218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334155+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.334155+0000","last_peered":"2023-10-08T06:57:18.334155+0000","last_clean":"2023-10-08T06:57:18.334155+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.334155+0000","last_undegraded":"2023-10-08T06:57:18.334155+0000","last_fullsized":"2023-10-08T06:57:18.334155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333744+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.333744+0000","last_peered":"2023-10-08T06:57:18.333744+0000","last_clean":"2023-10-08T06:57:18.333744+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.333744+0000","last_undegraded":"2023-10-08T06:57:18.333744+0000","last_fullsized":"2023-10-08T06:57:18.333744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331439+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.331439+0000","last_peered":"2023-10-08T06:57:18.331439+0000","last_clean":"2023-10-08T06:57:18.331439+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.331439+0000","last_undegraded":"2023-10-08T06:57:18.331439+0000","last_fullsized":"2023-10-08T06:57:18.331439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199961+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:19.199961+0000","last_peered":"2023-10-08T06:57:19.199961+0000","last_clean":"2023-10-08T06:57:19.199961+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:19.199961+0000","last_undegraded":"2023-10-08T06:57:19.199961+0000","last_fullsized":"2023-10-08T06:57:19.199961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331729+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.331729+0000","last_peered":"2023-10-08T06:57:18.331729+0000","last_clean":"2023-10-08T06:57:18.331729+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.331729+0000","last_undegraded":"2023-10-08T06:57:18.331729+0000","last_fullsized":"2023-10-08T06:57:18.331729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200274+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:19.200274+0000","last_peered":"2023-10-08T06:57:19.200274+0000","last_clean":"2023-10-08T06:57:19.200274+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:19.200274+0000","last_undegraded":"2023-10-08T06:57:19.200274+0000","last_fullsized":"2023-10-08T06:57:19.200274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":650475,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":649859,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:35.909 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T06:57:35.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-10-08T06:57:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 19 2023-10-08T06:57:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:fsid a28386aa-6313-4530-b2e8-fd7736a43dc5 2023-10-08T06:57:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-10-08T06:56:54.481679+0000 2023-10-08T06:57:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2023-10-08T06:57:18.323568+0000 2023-10-08T06:57:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-08T06:57:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 4 2023-10-08T06:57:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client jewel 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release reef 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2023-10-08T06:57:36.280 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 3 2023-10-08T06:57:36.281 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6800/2190327034,v1:172.21.15.163:6801/2190327034] [v2:172.21.15.163:6802/2190327034,v1:172.21.15.163:6803/2190327034] exists,up a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06 2023-10-08T06:57:36.281 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/3772527464,v1:172.21.15.169:6801/3772527464] [v2:172.21.15.169:6802/3772527464,v1:172.21.15.169:6803/3772527464] exists,up da732e65-55c2-489e-bec4-ce4124704896 2023-10-08T06:57:36.281 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6800/1488347209,v1:172.21.15.183:6801/1488347209] [v2:172.21.15.183:6802/1488347209,v1:172.21.15.183:6803/1488347209] exists,up ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1 2023-10-08T06:57:36.293 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6800/2190327034,v1:172.21.15.163:6801/2190327034] [v2:172.21.15.163:6802/2190327034,v1:172.21.15.163:6803/2190327034] exists,up a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/3772527464,v1:172.21.15.169:6801/3772527464] [v2:172.21.15.169:6802/3772527464,v1:172.21.15.169:6803/3772527464] exists,up da732e65-55c2-489e-bec4-ce4124704896', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6800/1488347209,v1:172.21.15.183:6801/1488347209] [v2:172.21.15.183:6802/1488347209,v1:172.21.15.183:6803/1488347209] exists,up ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1'] 2023-10-08T06:57:36.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-10-08T06:57:36.419 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mon.a", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster": "ceph", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "admin_socket_mode": "", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_client_required": "cephx, none", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_cluster_required": "cephx", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_debug": "true", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-10-08T06:57:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_service_required": "cephx", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_service_ticket_ttl": "240.000000", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_supported": "cephx", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio": "true", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_max_queue_depth": "1024", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_poll_ms": "250", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_reap_max": "16", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_async_discard": "false", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_block_size": "4096", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio": "false", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-10-08T06:57:36.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_inflight_ios": "false", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_enable_discard": "false", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_flock_retry": "3", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_flock_retry_interval": "0.100000", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_inject_crash": "0", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_inject_crash_flush_delay": "2", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_ioring": "false", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_ioring_hipri": "false", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_ioring_sqthread_poll": "false", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_read_buffer_alignment": "4096", 2023-10-08T06:57:36.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_type": "", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_alloc_size": "1048576", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_allocator": "hybrid", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_buffered_io": "true", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_check_for_zeros": "false", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_check_volume_selector_often": "false", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_compact_log_sync": "false", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_compact_min_size": "16777216", 2023-10-08T06:57:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_replay_check_allocations": "true", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_max_log_runway": "4194304", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_max_prefetch": "1048576", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_min_flush_size": "524288", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_min_log_runway": "1048576", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_replay_recovery": "false", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_shared_alloc_size": "65536", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_sync_write": "false", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-10-08T06:57:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_allocation_from_file": "true", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_allocator": "hybrid", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blobid_prealloc": "10240", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_create": "true", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_create": "false", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_path": "", 2023-10-08T06:57:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_size": "0", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_path": "", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_preallocate_file": "false", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_size": "107374182400", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_create": "false", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_path": "", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_size": "100663296", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs": "true", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_env_mirror": "false", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-10-08T06:57:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_autotune": "true", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size": "0", 2023-10-08T06:57:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_type": "2q", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_clone_cow": "true", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_algorithm": "snappy", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size": "0", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size": "0", 2023-10-08T06:57:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_mode": "none", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_csum_type": "crc32c", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_enforce_settings": "default", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_freelist": "false", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_fsck_abort": "false", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_read_err": "false", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_legacy_omap": "false", 2023-10-08T06:57:36.429 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_prefill": "0.000000", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_small_allocations": "0", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_default_buffered_read": "true", 2023-10-08T06:57:36.430 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_default_buffered_write": "false", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops": "0", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_elastic_shared_blobs": "true", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fail_eio": "false", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-10-08T06:57:36.431 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mkfs": "true", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mount": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_umount": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-10-08T06:57:36.432 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_ignore_data_csum": "false", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_kvbackend": "rocksdb", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_op_age": "5.000000", 2023-10-08T06:57:36.433 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_alloc_size": "0", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size": "0", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_defer_interval": "3.000000", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_deferred_txc": "32", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size": "0", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_nid_prealloc": "1024", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size": "0", 2023-10-08T06:57:36.434 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_qfsck_on_mount": "true", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_retry_disk_reads": "3", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_cf": "true", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_options_annex": "", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_coremask": "0x1", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_io_sleep": "5", 2023-10-08T06:57:36.435 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_max_io_completion": "0", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_mem": "512", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_sync_submit_transaction": "false", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_bytes": "67108864", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io": "0", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_tracing": "false", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-10-08T06:57:36.436 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_reserved": "0", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_zero_block_detection": "false", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_action_update_interval": "2", 2023-10-08T06:57:36.437 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_mount_timeout": "10", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-10-08T06:57:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_cluster_require_signatures": "false", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_cluster_require_version": "2", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_require_signatures": "false", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_require_version": "2", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_service_require_signatures": "false", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_service_require_version": "2", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_sign_messages": "true", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "chdir": "", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "client_acl_type": "", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "client_asio_thread_count": "2", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "client_cache_mid": "0.750000", 2023-10-08T06:57:36.439 INFO:teuthology.orchestra.run.smithi037.stdout: "client_cache_size": "16384", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_caps_release_delay": "5", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_check_pool_perm": "true", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_collect_and_send_global_metrics": "false", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_force_sync_read": "false", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_getattr_caps": "false", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_inject_tick_delay": "0", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_die_on_failed_remount": "false", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_dirsize_rbytes": "true", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_force_lazyio": "false", 2023-10-08T06:57:36.440 INFO:teuthology.orchestra.run.smithi037.stdout: "client_fs": "", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_inject_fixed_oldest_tid": "false", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_inject_release_failure": "false", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_max_inline_size": "4096", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_max_retries_on_remount_failure": "5", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mds_namespace": "", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_metadata": "", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_gid": "-1", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_timeout": "300", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_uid": "-1", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mountpoint": "/", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_notify_timeout": "10", 2023-10-08T06:57:36.441 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc": "true", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_dirty": "104857600", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_dirty_age": "5.000000", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_objects": "1000", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_size": "209715200", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_target_dirty": "8388608", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_permissions": "true", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_quota": "true", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_quota_df": "true", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_max_bytes": "0", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_max_periods": "4", 2023-10-08T06:57:36.442 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_min": "131072", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_reconnect_stale": "false", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_shutdown_timeout": "30", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_snapdir": ".snap", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_tick_interval": "1", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_trace": "", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_try_dentry_invalidate": "false", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_use_faked_inos": "false", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "client_use_random_mds": "false", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog": "false", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-10-08T06:57:36.443 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog_port": "12201", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_monitors": "default=true", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog": "false", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog_level": "info", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "-", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_network": "", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_network_interface": "", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_isal": "false", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_level": "5", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_winsize": "-15", 2023-10-08T06:57:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zstd_level": "1", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_alien_op_num_threads": "6", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_alien_thread_cpu_cores": "", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_osd_obc_lru_size": "10", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_seastar_smp": "1", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location": "", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location_hook": "", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location_hook_timeout": "10", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "daemonize": "false", 2023-10-08T06:57:36.445 INFO:teuthology.orchestra.run.smithi037.stdout: "daos_pool": "tank", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "dbstore_db_name_prefix": "dbstore", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_alienstore": "0/5", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_allow_any_pool_priority": "false", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asok": "1/5", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asok_assert_abort": "false", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asserts_on_shutdown": "true", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_auth": "20/20", 2023-10-08T06:57:36.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bdev": "1/3", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bluefs": "1/5", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bluestore": "1/5", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_buffer": "0/1", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_ceph_exporter": "1/5", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_cephfs_mirror": "0/5", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_cephsqlite": "0/5", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_client": "0/5", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_compressor": "1/5", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_context": "0/1", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_crush": "1/1", 2023-10-08T06:57:36.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_crypto": "1/5", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_cyanstore": "0/5", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_deliberately_leak_memory": "false", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_disable_randomized_ping": "false", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_dpdk": "1/5", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_eventtrace": "1/5", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_filer": "0/1", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_filestore": "1/3", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_finisher": "1/1", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_fuse": "1/5", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_heartbeat_testing_span": "0", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_heartbeatmap": "1/5", 2023-10-08T06:57:36.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_immutable_obj_cache": "0/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_javaclient": "1/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_journal": "1/3", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_journaler": "0/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_kstore": "1/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_lockdep": "0/1", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mclock": "1/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds": "1/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_balancer": "1/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_locker": "1/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_log": "1/5", 2023-10-08T06:57:36.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_log_expire": "1/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_migrator": "1/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_memstore": "1/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mgr": "2/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mgrc": "1/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mon": "20/20", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_monc": "0/10", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_ms": "1/1", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_none": "0/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objclass": "0/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objectcacher": "0/5", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objecter": "0/1", 2023-10-08T06:57:36.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_optracker": "0/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_osd": "1/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_paxos": "20/20", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_perfcounter": "1/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_prioritycache": "1/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rados": "0/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd": "0/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_mirror": "0/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_pwl": "0/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_replay": "0/5", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_refs": "0/0", 2023-10-08T06:57:36.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_reserver": "1/1", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw": "1/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_access": "1/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_datacache": "1/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_dbstore": "1/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_flight": "1/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_sync": "1/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rocksdb": "4/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore": "0/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_backref": "0/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_cache": "0/5", 2023-10-08T06:57:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_cleaner": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_device": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_epm": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_journal": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_lba": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_odata": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_omap": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_onode": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_t": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_tm": "0/5", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_striper": "0/1", 2023-10-08T06:57:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_test": "0/5", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_throttle": "1/1", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_timer": "0/1", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_tp": "0/5", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_trace": "1/5", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "defer_client_eviction_on_laggy_osds": "true", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "device_failure_prediction_mode": "none", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-10-08T06:57:36.454 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_graylog": "false", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_journald": "false", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_stderr": "true", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_syslog": "false", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "event_tracing": "false", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_addr": "0.0.0.0", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_http_port": "9926", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_prio_limit": "5", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-10-08T06:57:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_sort_metrics": "true", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_stats_period": "5", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "fake_statfs_for_testing": "0", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "fatal_signal_handlers": "true", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filer_max_purge_ops": "10", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filer_max_truncate_ops": "128", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_apply_finisher_threads": "1", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_blackhole": "false", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_btrfs_clone_range": "true", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_btrfs_snap": "true", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_caller_concurrency": "10", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_collect_device_partition_information": "true", 2023-10-08T06:57:36.456 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_commit_timeout": "600.000000", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_inject_read_err": "false", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_omap_check": "false", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_random_read_err": "0.000000", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_verify_split": "false", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_dump_file": "", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fadvise": "true", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fail_eio": "true", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fd_cache_shards": "16", 2023-10-08T06:57:36.457 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fd_cache_size": "128", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fiemap": "false", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fiemap_threshold": "4096", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_index_retry_probability": "0.000000", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_inject_stall": "0", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_parallel": "false", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_trailing": "false", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_writeahead": "false", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_kill_at": "0", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-10-08T06:57:36.458 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size": "0", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs": "0", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_other": "2", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_sync_interval": "5.000000", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size": "0", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-10-08T06:57:36.459 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_merge_threshold": "-10", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_min_sync_interval": "0.010000", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_odsync_write": "false", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_backend": "rocksdb", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_backend_path": "", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_header_cache_size": "1024", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_ondisk_finisher_threads": "1", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_thread_timeout": "60", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_threads": "2", 2023-10-08T06:57:36.460 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_punch_hole": "false", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_bytes": "104857600", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_ops": "50", 2023-10-08T06:57:36.461 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_seek_data_hole": "false", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_sloppy_crc": "false", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_splice": "false", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_split_multiple": "2", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_split_rand_factor": "20", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_update_to": "1000", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-10-08T06:57:36.462 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_enable": "true", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-10-08T06:57:36.463 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-10-08T06:57:36.465 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-10-08T06:57:36.465 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_xfs_extsize": "false", 2023-10-08T06:57:36.465 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_zfs_snap": "false", 2023-10-08T06:57:36.465 INFO:teuthology.orchestra.run.smithi037.stdout: "fio_dir": "/tmp/fio", 2023-10-08T06:57:36.465 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "a28386aa-6313-4530-b2e8-fd7736a43dc5", 2023-10-08T06:57:36.465 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_allow_other": "true", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_atomic_o_trunc": "true", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_big_writes": "true", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_debug": "false", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_default_permissions": "false", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_disable_pagecache": "false", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_max_write": "0", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_multithreaded": "true", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_require_active_mds": "true", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_set_user_groups": "true", 2023-10-08T06:57:36.466 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_splice_move": "true", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_splice_read": "true", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_splice_write": "true", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_syncfs_on_mksnap": "true", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_use_invalidate_cb": "true", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "gss_target_name": "ceph", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_file": "", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_inject_failure": "0", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_interval": "5", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "host": "smithi037", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-10-08T06:57:36.467 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_max_size": "1073741824", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_watermark": "0.900000", 2023-10-08T06:57:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: "inject_early_sigterm": "false", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "jaeger_agent_port": "6799", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "jaeger_tracing_enable": "false", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_aio": "true", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_align_min_size": "65536", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_block_align": "true", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_block_size": "4096", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_dio": "true", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_discard": "false", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_force_aio": "false", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_ignore_corruption": "false", 2023-10-08T06:57:36.469 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_max_write_bytes": "10485760", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_max_write_entries": "100", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_replay_from": "0", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_high_multiple": "0.000000", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_max_multiple": "0.000000", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_write_header_frequency": "0", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_zero_on_create": "false", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_prefetch_periods": "10", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_prezero_periods": "5", 2023-10-08T06:57:36.470 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_write_head_interval": "15", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "keyfile": "", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_backend": "rocksdb", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_default_stripe_size": "65536", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_fsck_on_mount": "false", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_fsck_on_mount_deep": "true", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_max_bytes": "67108864", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_max_ops": "512", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_nid_prealloc": "1024", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_onode_map_size": "1024", 2023-10-08T06:57:36.471 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_sync_submit_transaction": "false", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_sync_transaction": "false", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "librados_thread_count": "2", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "lockdep": "false", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "lockdep_force_backtrace": "false", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_coarse_timestamps": "true", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_flush_on_exit": "false", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_graylog_host": "127.0.0.1", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_graylog_port": "12201", 2023-10-08T06:57:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_max_new": "1000", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_max_recent": "10000", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_stderr_prefix": "", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_stop_at_utilization": "0.970000", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": "true", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_graylog": "false", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_journald": "false", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_stderr": "false", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_syslog": "false", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max_rotating_auth_attempts": "10", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_action_on_write_error": "1", 2023-10-08T06:57:36.473 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_alternate_name_max": "8192", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_asio_thread_count": "2", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_export_pin": "true", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_dirs": "true", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_interval": "5", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_size_max": "100000", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_idle_threshold": "0.000000", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_interval": "10", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_max": "-1", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_max_until": "-1", 2023-10-08T06:57:36.474 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_merge_size": "50", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_midchunk": "0.300000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_min_rebalance": "0.100000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_min_start": "0.200000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_minchunk": "0.001000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_mode": "0", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_need_max": "1.200000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_need_min": "0.800000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_overload_epochs": "2", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_sample_interval": "3.000000", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_bits": "3", 2023-10-08T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_rd": "25000.000000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_size": "10000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_wr": "10000.000000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_target_decay": "10.000000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_grace": "15.000000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_interval": "4.000000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_mon_down_grace": "60", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_memory_limit": "4294967296", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_mid": "0.700000", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_release_free_interval": "10", 2023-10-08T06:57:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_reservation": "0.050000", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_interval": "1", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_threshold": "262144", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_delegate_inos_pct": "0", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_prealloc_inos": "1000", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_connect_bootstrapping": "false", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_damage_table_max_entries": "10000", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-10-08T06:57:36.477 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_auth_pins": "false", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_frag": "false", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_scatterstat": "false", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_subtrees": "false", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_decay_halflife": "5.000000", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_default_dir_hash": "2", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_defer_session_stale": "true", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_deny_all_reconnect": "false", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_keys_per_op": "16384", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_max_commit_size": "10", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_max_entries": "0", 2023-10-08T06:57:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_prefetch": "true", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dirstat_min_interval": "1.000000", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_after_rejoin": "false", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_on_map": "false", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_threshold_file": "0", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_early_reply": "true", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_enable_op_tracker": "true", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_enforce_unique_name": "true", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_distributed": "true", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_random": "true", 2023-10-08T06:57:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_forward_all_requests_to_auth": "false", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_go_bad_corrupt_dentry": "true", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_health_cache_threshold": "1.500000", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_health_summarize_threshold": "10", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_heartbeat_grace": "15.000000", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_heartbeat_reset_grace": "1000", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_health_dummy": "false", 2023-10-08T06:57:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_migrator_session_race": "false", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_skip_replaying_inotable": "false", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_join_fs": "", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_journal_format": "1", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_create_at": "0", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_export_at": "0", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_import_at": "0", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_at": "0", 2023-10-08T06:57:36.481 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_expire_at": "0", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_replay_at": "0", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_link_at": "0", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_mdstable_at": "0", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_openc_at": "0", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_rename_at": "0", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_shutdown_at": "0", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_skip_replaying_inotable": "false", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_event_large_threshold": "524288", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_events_per_segment": "1024", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_major_segment_event_ratio": "12", 2023-10-08T06:57:36.482 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_max_events": "-1", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_max_segments": "128", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_pause": "false", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_segment_size": "0", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_skip_corrupt_events": "false", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_skip_unbounded_events": "false", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_warn_factor": "2.000000", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_caps_per_client": "1048576", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_completed_flushes": "100000", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_completed_requests": "100000", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_export_size": "20971520", 2023-10-08T06:57:36.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_file_recover": "32", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_files": "64", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_ops": "8192", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_snaps_per_dir": "100", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_metrics_update_interval": "2", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_min_caps_per_client": "100", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_min_caps_working_set": "10000", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_numa_node": "-1", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-10-08T06:57:36.484 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_complaint_time": "30.000000", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_duration": "600", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_size": "20", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_slow_op_size": "20", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_slow_op_threshold": "10", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_log_threshold": "5", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_ping_grace": "15", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_ping_interval": "5", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_caps": "30000", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-10-08T06:57:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_decay_threshold": "131072", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_warning_threshold": "262144", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_reconnect_timeout": "45.000000", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_replay_interval": "1.000000", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_root_ino_gid": "0", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_root_ino_uid": "0", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_blocklist_on_evict": "true", 2023-10-08T06:57:36.486 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_blocklist_on_timeout": "true", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cap_acquisition_throttle": "100000", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_metadata_threshold": "16777216", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_shutdown_check": "0", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_skip_ino": "0", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sleep_rank_change": "0.000000", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_max_uid": "4294967294", 2023-10-08T06:57:36.487 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_min_uid": "0", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_rstat": "false", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_standby_replay_damaged": "false", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_symlink_recovery": "true", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_task_status_update_interval": "2.000000", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_thrash_exports": "0", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_thrash_fragments": "0", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_tick_interval": "5.000000", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_valgrind_exit": "false", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_verify_backtrace": "1", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_verify_scatter": "false", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_wipe_ino_prealloc": "false", 2023-10-08T06:57:36.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_wipe_sessions": "false", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool_debug": "false", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_debug_omit_block_device_write": "false", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_device_bytes": "1073741824", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_page_set": "false", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_page_size": "65536", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_bytes": "134217728", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_messages": "512", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_connect_retry_interval": "1.000000", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-10-08T06:57:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_disabled_modules": "", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_max_pg_num_change": "128", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mds_bytes": "134217728", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mds_messages": "128", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mon_bytes": "134217728", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mon_messages": "128", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_osd_bytes": "536870912", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_osd_messages": "8192", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_pool": "true", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_service_beacon_grace": "60.000000", 2023-10-08T06:57:36.490 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_standby_modules": "true", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_stats_period": "5", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_stats_threshold": "5", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_tick_period": "2", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_accept_timeout_factor": "2.000000", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_allow_pool_delete": "true", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_allow_pool_size_one": "true", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_auth_validate_all_caps": "true", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-10-08T06:57:36.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_bytes": "104857600", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_directed_command_retry": "2", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval": "3.000000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_parallel": "3", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_log_interval": "1.000000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_ping_interval": "10.000000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_ping_timeout": "30.000000", 2023-10-08T06:57:36.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_target_rank": "-1", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clock_drift_allowed": "1.000000", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_file_level": "debug", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_file": "true", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog": "false", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_journald": "false", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_stderr": "false", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-10-08T06:57:36.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_bootstrap": "false", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_start": "false", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_trim": "true", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_con_tracker_persist_interval": "10", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_con_tracker_score_halflife": "43200", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_config_key_max_entry_size": "65536", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cpu_threads": "4", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_crush_min_required_version": "hammer", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_daemon_bytes": "419430400", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-10-08T06:57:36.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_avail_crit": "5", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_avail_warn": "5", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_size_warn": "16106127360", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_block_osdmap_trim": "false", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_json": "false", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_transactions": "false", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_extra_checks": "false", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-10-08T06:57:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_quincy": "false", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_reef": "false", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_delta_reset_interval": "10.000000", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_dns_srv_name": "ceph-mon", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_down_mkfs_grace": "120", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_election_default_strategy": "1", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_election_timeout": "5.000000", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_elector_ping_divisor": "2", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_elector_ping_timeout": "2.000000", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_enable_op_tracker": "true", 2023-10-08T06:57:36.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_fake_pool_delete": "false", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_force_quorum_join": "false", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_globalid_prealloc": "10000", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_detail_to_clog": "false", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_log_update_period": "5", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_max_detail": "50", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog": "true", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog_interval": "600", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_host": "172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],[v2:172.21.15.37:3302,v1:172.21.15.37:6791]", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_host_override": "", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_initial_members": "", 2023-10-08T06:57:36.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_keyvaluedb": "rocksdb", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease": "5.000000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_log_full_interval": "50", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_log_max": "10000", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_log_max_summary": "50", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_log_entries_per_event": "4096", 2023-10-08T06:57:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_log_epochs": "500", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_mdsmap_epochs": "500", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_mgrmap_epochs": "500", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_osd": "10000", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_pg_per_osd": "10000", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_pool_pg_num": "65536", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_force_trim_to": "0", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_skip_sanity": "false", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_memory_autotune": "true", 2023-10-08T06:57:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_memory_target": "2147483648", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_beacon_grace": "30", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_digest_period": "5", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_inactive_grace": "60", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_mkfs_grace": "240", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_min_osdmap_epochs": "500", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_complaint_time": "30", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_duration": "600", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_size": "20", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_slow_op_size": "20", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_slow_op_threshold": "10", 2023-10-08T06:57:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_log_threshold": "5", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_in": "false", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_new_in": "true", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_cache_size": "500", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_cache_size_min": "134217728", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_crush_smoke_test": "true", 2023-10-08T06:57:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_destroyed_out_interval": "600", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_down_out_interval": "600", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_force_trim_to": "0", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_full_ratio": "0.950000", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_halflife": "3600", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_max_interval": "300", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_weight": "0.300000", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_max_creating_pgs": "1024", 2023-10-08T06:57:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_max_initial_pgs": "1024", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_down_reporters": "2", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp": "true", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_report_timeout": "900", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_warn_num_repaired": "10", 2023-10-08T06:57:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_warn_op_age": "32.000000", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_interval": "10", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_min": "10000", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_stuck_threshold": "60", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_objects": "10000", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_per_osd": "0", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pool_quota_crit_threshold": "0", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pool_quota_warn_threshold": "0", 2023-10-08T06:57:36.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_probe_timeout": "2.000000", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_max_change": "0.050000", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_max_osds": "4", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_interval": "86400", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_max_keys": "100", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_timeout": "300", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_session_timeout": "300", 2023-10-08T06:57:36.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_smart_report_timeout": "5", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stat_smooth_intervals": "6", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_pool_min_size": "2", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_pool_size": "4", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_subscribe_interval": "86400.000000", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_debug": "false", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_max_payload_keys": "2000", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_max_payload_size": "1048576", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_provider_kill_at": "0", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_requester_kill_at": "0", 2023-10-08T06:57:36.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_timeout": "60.000000", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_target_pg_per_osd": "100", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_tick_interval": "5", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_timecheck_interval": "300.000000", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_use_min_delay_socket": "false", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_older_version_delay": "604800", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_filestore_osds": "false", 2023-10-08T06:57:36.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_misplaced": "false", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_older_version": "true", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_no_app": "true", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-10-08T06:57:36.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_too_few_osds": "false", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": "", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_tracing_enabled": "false", 2023-10-08T06:57:36.509 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_op_threads": "3", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_buffer_size": "131072", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_cm": "false", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_device_name": "", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_dscp": "96", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_gid_idx": "0", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_local_gid": "", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_polling_us": "1000", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_port_num": "1", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-10-08T06:57:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_roce_ver": "1", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_send_buffers": "1024", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_sl": "3", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_support_srq": "true", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_type": "ib", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_reap_threshold": "5", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_before_connect": "false", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_ipv4": "true", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_ipv6": "false", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_msgr1": "true", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_msgr2": "true", 2023-10-08T06:57:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_port_max": "7568", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_port_min": "6800", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_prefer_ipv4": "false", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_retry_count": "3", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_retry_delay": "5", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_client": "false", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mds": "false", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mgr": "false", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mon": "false", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_osd": "false", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_client_mode": "crc secure", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_cluster_mode": "crc secure", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_cluster_type": "", 2023-10-08T06:57:36.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_compress_secure": "false", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_connection_idle_timeout": "900", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_connection_ready_timeout": "10", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_crc_data": "true", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_crc_header": "true", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_bad_msg": "false", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_bug": "true", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_old_message": "true", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_skipped_message": "false", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_unhandled_msg": "false", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_coremask": "0xF", 2023-10-08T06:57:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_devs_allowlist": "", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_enable_tso": "true", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hugepages": "", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hw_flow_control": "true", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_lro": "true", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_memory_channel": "4", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-10-08T06:57:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_pmd": "", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_port_id": "0", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dump_corrupt_message_level": "1", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dump_on_send": "false", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_initial_backoff": "0.200000", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_max": "1.000000", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_probability": "0.000000", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_type": "", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_internal_delays": "0.000000", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_network_congestion": "0", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_socket_failures": "0", 2023-10-08T06:57:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_learn_addr_from_peer": "true", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_max_accept_failures": "4", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_max_backoff": "15.000000", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_client_mode": "secure crc", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_cluster_mode": "secure crc", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_service_mode": "secure crc", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_osd_compress_min_size": "1024", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_osd_compress_mode": "none", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_osd_compression_algorithm": "snappy", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_pq_min_cost": "65536", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_public_type": "", 2023-10-08T06:57:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_service_mode": "crc secure", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_listen_backlog": "512", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_nodelay": "true", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_rcvbuf": "0", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_type": "async+posix", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "no_config_file": "false", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_completion_locks_per_session": "32", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_debug_inject_relock_delay": "false", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inflight_op_bytes": "104857600", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inflight_ops": "1024", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inject_no_watch_ping": "false", 2023-10-08T06:57:36.517 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_tick_interval": "5.000000", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_timeout": "10.000000", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "objectstore_blackhole": "false", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "openssl_engine_opts": "", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_delay_time": "5.000000", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_hist_halflife": "1000", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_max_low_ops": "2", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_max_ops": "4", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_quantize_effort": "0.100000", 2023-10-08T06:57:36.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_slop": "0.020000", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_allow_recovery_below_min_size": "true", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_asio_thread_count": "2", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_async_recovery_min_cost": "100", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_auto_mark_unfound_lost": "false", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_retry_interval": "30.000000", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_scan_max": "512", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_scan_min": "64", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_degraded": "false", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_peering": "false", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_unfound": "true", 2023-10-08T06:57:36.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_beacon_report_interval": "300", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_duration": "30", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_max_block_size": "67108864", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_small_size_max_iops": "100", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_blkin_trace_all": "false", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_blocked_scrub_grace_period": "120", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_check_for_log_corruption": "false", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-10-08T06:57:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_update_on_start": "true", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_message_cap": "256", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_message_size_cap": "524288000", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_op_priority": "63", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_watch_timeout": "30", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_command_max_records": "256", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_compact_on_start": "false", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-10-08T06:57:36.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_chooseleaf_type": "0", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_initial_weight": "-1.000000", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_update_on_start": "true", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_update_weight_set": "true", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_drop_ping_duration": "0", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_feed_pullee": "-1", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-10-08T06:57:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_misdirected_ops": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_no_acting_change": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_no_purge_strays": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_op_order": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_pg_log_writeout": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_pretend_recovery_active": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_shutdown": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-10-08T06:57:36.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_cached_snaps": "false", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_missing_on_start": "false", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_snaps": "false", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_keys": "1024", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_stride": "524288", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-10-08T06:57:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_default_data_pool_replay_window": "5", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_default_notify_timeout": "30", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep": "0.000000", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_discard_disconnected_ops": "true", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_enable_op_tracker": "true", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_extblkdev_plugins": "vdo", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-10-08T06:57:36.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_info": "true", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_shutdown": "true", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_shutdown_timeout": "15", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_function_tracing": "false", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_grace": "20", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_interval": "6", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-10-08T06:57:36.526 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_peers": "10", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_size": "2000", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_stale": "600", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_max_size": "100000", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_min_size": "1000", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal_flush_on_shutdown": "true", 2023-10-08T06:57:36.527 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal_size": "5120", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_kill_backfill_at": "0", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_loop_before_reset_tphandle": "64", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_cache_size": "50", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_dedup": "true", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_message_max": "40", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_message_max_bytes": "10485760", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_share_max_epochs": "40", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_attr_name_len": "100", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_attr_size": "0", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_backfills": "1", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_markdown_count": "5", 2023-10-08T06:57:36.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_markdown_period": "600", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_name_len": "2048", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_namespace_len": "256", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_size": "134217728", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_omap_entries_per_request": "1024", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_blocked_by": "16", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_log_entries": "10000", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pgls": "1024", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_push_cost": "8388608", 2023-10-08T06:57:36.529 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_push_objects": "10", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_scrubs": "3", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_trimming_pgs": "2", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_write_op_reply_len": "64", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_write_size": "90", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2023-10-08T06:57:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_override_recovery_settings": "false", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_profile": "balanced", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2023-10-08T06:57:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_skip_benchmark": "false", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_base": "805306368", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_cache_min": "134217728", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target": "4294967296", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target_autotune": "false", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_min_pg_log_entries": "250", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_min_recovery_priority": "0", 2023-10-08T06:57:36.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_heartbeat_interval": "30", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_report_interval": "5", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_report_max_in_flight": "2", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_num_cache_shards": "32", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_num_op_tracker_shard": "32", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_auto_affinity": "true", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_node": "-1", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_prefer_iface": "true", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objecter_finishers": "1", 2023-10-08T06:57:36.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore": "bluestore", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore_fuse": "false", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore_tracing": "false", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_complaint_time": "30.000000", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_duration": "600", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_size": "20", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_slow_op_size": "20", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_log_threshold": "5", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards": "0", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards_hdd": "5", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards_ssd": "8", 2023-10-08T06:57:36.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard": "0", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_pq_min_cost": "65536", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_queue": "mclock_scheduler", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_queue_cut_off": "high", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_thread_suicide_timeout": "150", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_thread_timeout": "15", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_open_classes_on_start": "true", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_os_flags": "0", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_peering_op_priority": "255", 2023-10-08T06:57:36.535 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_delete_cost": "1048576", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_delete_priority": "5", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_dups_tracked": "3000", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_trim_max": "10000", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_trim_min": "100", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_object_context_cache_count": "64", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_stat_report_interval_max": "500", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-10-08T06:57:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_crimson": "false", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_crush_rule": "-1", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_ec_fast_read": "false", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_bulk": "false", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nodelete": "false", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-10-08T06:57:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flags": "0", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_min_size": "0", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pg_num": "32", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pgp_num": "0", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_size": "2", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_type": "replicated", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-10-08T06:57:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_use_gmt_hitset": "true", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_push_per_object_cost": "1000", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_read_ec_check_for_errors": "false", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recover_clone_overlap": "true", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recover_clone_overlap_limit": "10", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_cost": "20971520", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_delay_start": "0.000000", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active": "0", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active_hdd": "3", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active_ssd": "10", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_chunk": "8388608", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-10-08T06:57:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_single_start": "1", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_op_priority": "3", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_op_warn_multiple": "16", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_priority": "5", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_retry_interval": "30.000000", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep": "0.000000", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_repair_during_recovery": "false", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_requested_scrub_priority": "120", 2023-10-08T06:57:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_rollback_to_cluster_snap": "", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_auto_repair": "false", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_begin_hour": "0", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_begin_week_day": "0", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_chunk_max": "25", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_chunk_min": "5", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_cost": "52428800", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_during_recovery": "false", 2023-10-08T06:57:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_end_hour": "0", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_end_week_day": "0", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_event_cost": "4096", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_invalid_stats": "true", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_load_threshold": "0.500000", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_max_interval": "604800.000000", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_max_preemptions": "5", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_min_interval": "86400.000000", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_priority": "5", 2023-10-08T06:57:36.542 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_reservation_timeout": "5000", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_sleep": "0.000000", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_slow_reservation_response": "2200", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_shallow_scrub_chunk_max": "100", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_shallow_scrub_chunk_min": "50", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_shutdown_pgref_assert": "false", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_skip_data_digest": "false", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_smart_report_timeout": "5", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_cost": "1048576", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_priority": "5", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep": "0.000000", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-10-08T06:57:36.543 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_stats_update_period_not_scrubbing": "120", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_stats_update_period_scrubbing": "15", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_target_transaction_size": "30", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-10-08T06:57:36.544 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_mode": "writeback", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tracing": "false", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_use_stale_snap": "false", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "osdc_blkin_trace_all": "false", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_kill_at": "0", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_max_join_drift": "10", 2023-10-08T06:57:36.545 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_min": "500", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_min_wait": "0.050000", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_propose_interval": "1.000000", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_max": "500", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_max_multiplier": "20", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_min": "250", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_stash_full_interval": "25", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_trim_max": "500", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_trim_min": "250", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "perf": "true", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-10-08T06:57:36.546 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "-", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrv": "", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "public_bind_addr": "-", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "public_network": "", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "public_network_interface": "", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "qat_compressor_enabled": "false", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "qat_compressor_session_max_number": "256", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_mon_op_timeout": "0", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_osd_op_timeout": "0", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_tracing": "false", 2023-10-08T06:57:36.547 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_atime_update_interval": "60", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_balance_parent_reads": "false", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_balance_snap_reads": "false", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blkin_trace_all": "false", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blocklist_expire_seconds": "0", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blocklist_on_break_lock": "true", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache": "true", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_block_writes_upfront": "false", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty": "25165824", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty_object": "0", 2023-10-08T06:57:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_policy": "writearound", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_size": "33554432", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_target_dirty": "16777216", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_clone_copy_on_read": "false", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_compression_hint": "none", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_concurrent_management_ops": "10", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_clone_format": "auto", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_data_pool": "", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_features": "61", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_format": "2", 2023-10-08T06:57:36.549 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_map_options": "", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_order": "22", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_pool": "rbd", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_stripe_count": "0", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_stripe_unit": "0", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_disable_zero_copy_writes": "true", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_discard_granularity_bytes": "65536", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_enable_alloc_hint": "true", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_io_scheduler": "simple", 2023-10-08T06:57:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_commit_age": "5.000000", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_interval": "0", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_order": "24", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_pool": "", 2023-10-08T06:57:36.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_splay_width": "4", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_localize_parent_reads": "false", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_localize_snap_reads": "false", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_type": "simple", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-10-08T06:57:36.552 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_autotune": "true", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_base": "805306368", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_target": "4294967296", 2023-10-08T06:57:36.553 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_delete_delay": "0", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_replay_delay": "0", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_to_trash_on_remove": "false", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mtime_update_interval": "60", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_non_blocking_aio": "true", 2023-10-08T06:57:36.554 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_op_thread_timeout": "60", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_op_threads": "1", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_parent_cache_enabled": "false", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_persistent_cache_mode": "disabled", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_persistent_cache_path": "/tmp", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_persistent_cache_size": "1073741824", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_plugins": "", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_burst": "0", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_limit": "0", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_exclude_ops": "0", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_burst": "0", 2023-10-08T06:57:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_limit": "0", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_burst": "0", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_limit": "0", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_burst": "0", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_limit": "0", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_schedule_tick_min": "50", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_burst": "0", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-10-08T06:57:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_limit": "0", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_burst": "0", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_limit": "0", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_quiesce_notification_attempts": "10", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_read_from_replica_policy": "default", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_max_bytes": "524288", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_trigger_requests": "10", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_request_timed_out_seconds": "30", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_skip_partial_discard": "true", 2023-10-08T06:57:36.557 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_tracing": "false", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_validate_names": "true", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_validate_pool": "true", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "restapi_base_url": "", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "restapi_log_level": "", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_acl_grants_max_num": "100", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_admin_entry": "admin", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_backend_store": "rados", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_barbican_url": "", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_beast_enable_async": "true", 2023-10-08T06:57:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_index_max_aio": "128", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_quota_ttl": "600", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_sync_spawn_window": "20", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_enabled": "true", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_expiry_interval": "900", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_lru_size": "10000", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_config_store": "rados", 2023-10-08T06:57:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_content_length_compat": "false", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_copy_obj_progress": "true", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cors_rules_max_num": "100", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cross_domain_policy": "", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_default_encryption_key": "", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_addr": "", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_ca_path": "", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_client_cert": "", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_client_key": "", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-10-08T06:57:36.560 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_password": "", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_username": "", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_require_ssl": "true", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_backend": "vault", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2023-10-08T06:57:36.561 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_suppress_logs": "true", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_addr": "", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_auth": "token", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_namespace": "", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_prefix": "", 2023-10-08T06:57:36.562 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_token_file": "", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_buffersize": "524288", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_low_speed_limit": "1024", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_low_speed_time": "300", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_tcp_keepalive": "0", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2023-10-08T06:57:36.563 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_fadvise": "4", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_libaio_aio_num": "64", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_libaio_aio_threads": "20", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_host": "127.0.0.1", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_port": "6379", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_changes_size": "1000", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_num_shards": "128", 2023-10-08T06:57:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_window": "30", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_notify_interval_msec": "0", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_sync_poll_interval": "20", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_sync_spawn_window": "20", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_debug_inject_set_olh_err": "0", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_data_log_backing": "fifo", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_region_info_oid": "default.region", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-10-08T06:57:36.565 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_defer_to_bucket_acls": "", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_res": "500.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-10-08T06:57:36.566 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dns_name": "", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dns_s3website_name": "", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dynamic_resharding": "true", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_gc_threads": "true", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_lc_threads": "true", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_ops_log": "false", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_quota_threads": "true", 2023-10-08T06:57:36.567 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_static_website": "false", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_usage_log": "false", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enforce_swift_acls": "true", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_exit_timeout_secs": "120", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_expose_bucket": "false", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_extended_http_attrs": "", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_filter": "none", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_frontends": "beast port=7480", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_concurrent_io": "10", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_deferred": "50", 2023-10-08T06:57:36.568 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_objs": "32", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_queue_size": "134213632", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_trim_chunk": "16", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_obj_min_wait": "7200", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_processor_max_time": "3600", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_processor_period": "3600", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_get_obj_window_size": "16777216", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_healthcheck_disabling_path": "", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ignore_get_invalid_range": "false", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_init_timeout": "300", 2023-10-08T06:57:36.569 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_reader_roles": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_domain": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_password": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_password_path": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_project": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_tenant": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_token": "", 2023-10-08T06:57:36.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_token_path": "", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_user": "", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_api_version": "2", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_domain": "", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_password": "", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_project": "", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_tenant": "", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_user": "", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_implicit_tenants": "false", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2023-10-08T06:57:36.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_service_token_enabled": "false", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_token_cache_size": "10000", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_url": "", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_verify_ssl": "true", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_debug_interval": "-1", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_lock_max_time": "90", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_objs": "32", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_rules": "1000", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_worker": "3", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_wp_worker": "3", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_thread_delay": "0", 2023-10-08T06:57:36.572 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_dnattr": "uid", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_searchfilter": "", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_uri": "ldaps://", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_http_headers": "", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_nonexistent_bucket": "false", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-10-08T06:57:36.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_object_name_utc": "false", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lua_max_memory_per_state": "128000", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attr_name_len": "0", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attr_size": "0", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attrs_num_in_req": "0", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_chunk_size": "4194304", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_concurrent_requests": "1024", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_dynamic_shards": "1999", 2023-10-08T06:57:36.574 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_listing_results": "1000", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_notify_retries": "10", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_objs_per_shard": "100000", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_put_param_size": "1048576", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_put_size": "5368709120", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_slo_entries": "1000", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_md_log_max_shards": "64", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_md_notify_interval_msec": "200", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_meta_sync_poll_interval": "20", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_meta_sync_spawn_window": "20", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_mp_lock_max_time": "600", 2023-10-08T06:57:36.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multi_obj_del_max_aio": "16", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multipart_min_part_size": "5242880", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_fhcache_size": "2017", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_frontends": "rgw-nfs", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_lru_lanes": "5", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_max_gc": "300", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_gc_threads": "false", 2023-10-08T06:57:36.576 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_lc_threads": "false", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_quota_threads": "false", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_sync_thread": "false", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_num_async_rados_threads": "32", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_num_control_oids": "8", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_numa_node": "-1", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_obj_stripe_size": "4194304", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_chunk_size": "100", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_gc_interval": "600", 2023-10-08T06:57:36.577 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_hints_num_shards": "127", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_thread_timeout": "600", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_tracing": "false", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_token": "", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_url": "", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_verify_ssl": "true", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_rados": "false", 2023-10-08T06:57:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_socket_path": "", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_push_interval": "2.000000", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_push_interval_max": "30.000000", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_root_pool": ".rgw.root", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_policy_reject_invalid_principals": "true", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_lanes": "3", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_lmdb_count": "3", 2023-10-08T06:57:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_max_buckets": "100", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_partitions": "3", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_print_continue": "true", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_print_prohibited_content_length": "false", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_tracing": "false", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm": "", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm_id": "", 2023-10-08T06:57:36.580 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_region": "", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_region_root_pool": ".rgw.root", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_relaxed_region_enforcement": "false", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_request_uri": "", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_batch_size": "64", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_max_aio": "128", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_num_logs": "16", 2023-10-08T06:57:36.581 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_thread_interval": "600", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_resolve_cname": "false", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rest_getusage_op_compat": "false", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_run_sync_thread": "true", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_keystone": "false", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_ldap": "false", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_rados": "true", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_sts": "false", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_client_max_sig_ver": "-1", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_success_create_obj_status": "0", 2023-10-08T06:57:36.582 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_scheduler_type": "throttler", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_script_uri": "", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_service_provider_name": "", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_client_id": "", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_client_secret": "", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_entry": "sts", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_key": "sts", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_max_session_duration": "43200", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_min_session_duration": "900", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_token_introspection_url": "", 2023-10-08T06:57:36.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_account_in_url": "false", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_auth_entry": "auth", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_auth_url": "", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_custom_header": "", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_enforce_content_length": "false", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_need_stats": "true", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_tenant_name": "", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_token_expiration": "86400", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_url": "", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_url_prefix": "swift", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_versioning_enabled": "false", 2023-10-08T06:57:36.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_lease_period": "120", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_interval": "1200", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_obj_etag_verify": "false", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_history_size": "4096", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-10-08T06:57:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_thread_pool_size": "512", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_topic_persistency_max_retries": "0", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_topic_persistency_sleep_duration": "0", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_topic_persistency_time_to_live": "0", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_comment": "", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_createby": "", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_encoding": "", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_flag": "false", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_max_size": "5368709120", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_origin": "", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_sha_unit": "524288", 2023-10-08T06:57:36.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_tracker": "", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_trust_forwarded_https": "false", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_log_tick_interval": "30", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_max_shards": "32", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_max_user_shards": "1", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_use_opa_authz": "false", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_default_quota_max_size": "-1", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_max_buckets": "1000", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_policies_max_num": "100", 2023-10-08T06:57:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_interval": "86400", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_unique_email": "true", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_verify_ssl": "true", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_website_routing_rules_max_num": "50", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone": "", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone_id": "", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup": "", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup_id": "", 2023-10-08T06:57:36.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rgwlc_auto_session_clear": "true", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rgwlc_skip_bucket_step": "false", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_block_size": "4096", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_shard_bits": "4", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_size": "536870912", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_type": "binned_lru", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cf_compact_on_deletion": "true", 2023-10-08T06:57:36.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_compaction_stats": "false", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_extended_stats": "false", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_memory_stats": "false", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_index_type": "binary_search", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_log_to_ceph_log": "true", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_metadata_block_size": "4096", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_partition_filters": "false", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_perf": "false", 2023-10-08T06:57:36.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "rotating_keys_renewal_timeout": "10", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "run_dir": "/var/run/ceph", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_block_create": "true", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_cache_lru_size": "67108864", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_cbjournal_size": "5368709120", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_default_max_object_size": "16777216", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_default_object_metadata_reservation": "16777216", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_device_size": "53687091200", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_batch_capacity": "16", 2023-10-08T06:57:36.591 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_batch_flush_size": "16777216", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_iodepth_limit": "5", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_main_device_type": "SSD", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_max_concurrent_transactions": "8", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_obj_data_write_amplification": "1.250000", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_segment_size": "67108864", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "set_keepcaps": "false", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "setgroup": "", 2023-10-08T06:57:36.592 INFO:teuthology.orchestra.run.smithi037.stdout: "setuser": "", 2023-10-08T06:57:36.593 INFO:teuthology.orchestra.run.smithi037.stdout: "setuser_match_path": "", 2023-10-08T06:57:36.593 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_misplaced_ratio": "0.050000", 2023-10-08T06:57:36.593 INFO:teuthology.orchestra.run.smithi037.stdout: "thp": "false", 2023-10-08T06:57:36.593 INFO:teuthology.orchestra.run.smithi037.stdout: "threadpool_default_timeout": "60", 2023-10-08T06:57:36.593 INFO:teuthology.orchestra.run.smithi037.stdout: "threadpool_empty_queue_max_wait": "2", 2023-10-08T06:57:36.593 INFO:teuthology.orchestra.run.smithi037.stdout: "throttler_perf_counter": "true" 2023-10-08T06:57:36.593 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T06:57:36.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-10-08T06:57:36.733 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a: {} 2023-10-08T06:57:36.743 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b: {} 2023-10-08T06:57:36.752 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c: {} 2023-10-08T06:57:36.753 INFO:teuthology.orchestra.run.smithi037.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-10-08T06:57:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-10-08T06:57:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-10-08T06:57:36.765 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2023-10-08T06:57:36.765 INFO:teuthology.run_tasks:Running task radosbench... 2023-10-08T06:57:36.778 INFO:tasks.radosbench:Beginning radosbench... 2023-10-08T06:57:36.778 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2023-10-08T06:57:36.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2023-10-08T06:57:36.779 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-10-08T06:57:36.779 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T06:57:36.779 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T06:57:36.779 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-10-08T06:57:36.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-10-08T06:57:36.780 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-10-08T06:57:36.780 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-10-08T06:57:36.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:57:36.781 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-10-08T06:57:36.781 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:36.781 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-10-08T06:57:36.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:57:36.783 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:36.781+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:36.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:36.881+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:36.924 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:36.924 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:57:36.924 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2023-10-08T06:57:36.924 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:36.934 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:36.983 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:36.983+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:36.996 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:36.997 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:57:36.998 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:57:36.998 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:57:37.084 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.083+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:37.101 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:37.101 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:37.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:37.185 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T06:57:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 19, 2023-10-08T06:57:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "a28386aa-6313-4530-b2e8-fd7736a43dc5", 2023-10-08T06:57:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "created": "2023-10-08T06:56:54.481679+0000", 2023-10-08T06:57:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2023-10-08T06:57:18.323568+0000", 2023-10-08T06:57:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "last_up_change": "2023-10-08T06:57:03.011095+0000", 2023-10-08T06:57:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "last_in_change": "2023-10-08T06:56:55.385351+0000", 2023-10-08T06:57:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T06:57:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_num": 5799936, 2023-10-08T06:57:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_set": [ 2023-10-08T06:57:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "pglog_hardlimit", 2023-10-08T06:57:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "purged_snapdirs", 2023-10-08T06:57:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_deletes", 2023-10-08T06:57:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "sortbitwise" 2023-10-08T06:57:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_version": 4, 2023-10-08T06:57:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "full_ratio": 0.94999998807907104, 2023-10-08T06:57:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-08T06:57:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-08T06:57:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_snapshot": "", 2023-10-08T06:57:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_max": 4, 2023-10-08T06:57:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd": 3, 2023-10-08T06:57:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "require_min_compat_client": "luminous", 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min_compat_client": "jewel", 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "require_osd_release": "reef", 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_crimson": false, 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "pools": [ 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 1, 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": ".mgr", 2023-10-08T06:57:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:04.997403+0000", 2023-10-08T06:57:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 1, 2023-10-08T06:57:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 1, 2023-10-08T06:57:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 1, 2023-10-08T06:57:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 1, 2023-10-08T06:57:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 1, 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "12", 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_max": 32, 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 1 2023-10-08T06:57:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": {} 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 2.9900000095367432, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 2.9900000095367432, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 2, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 2, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 2, 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "rbd", 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:09.831792+0000", 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 8, 2023-10-08T06:57:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 8, 2023-10-08T06:57:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 8, 2023-10-08T06:57:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 8, 2023-10-08T06:57:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 8, 2023-10-08T06:57:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "15", 2023-10-08T06:57:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "options": {}, 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd": {} 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.5, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.5, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.5, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.5, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 3, 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_metadata", 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:14.549981+0000", 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 32, 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 32, 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 32, 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 32, 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 32, 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "18", 2023-10-08T06:57:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_bias": 4, 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 16, 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_priority": 5 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:57:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": "cephfs" 2023-10-08T06:57:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 4, 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_data", 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:15.701169+0000", 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 64, 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 64, 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 64, 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 64, 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 64, 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "19", 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 64, 2023-10-08T06:57:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "data": "cephfs" 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "osds": [ 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06", 2023-10-08T06:57:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 17, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6800", 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6801", 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6802", 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6803", 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6806", 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6807", 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6804", 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6805", 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.163:6801/2190327034", 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.163:6803/2190327034", 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.163:6807/2190327034", 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.163:6805/2190327034", 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "da732e65-55c2-489e-bec4-ce4124704896", 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 17, 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6800", 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6801", 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6802", 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6803", 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6806", 2023-10-08T06:57:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6807", 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6804", 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6805", 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.169:6801/3772527464", 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.169:6803/3772527464", 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.169:6807/3772527464", 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.169:6805/3772527464", 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1", 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 17, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6800", 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6801", 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6802", 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6803", 2023-10-08T06:57:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6806", 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6807", 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6804", 2023-10-08T06:57:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6805", 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.183:6801/1488347209", 2023-10-08T06:57:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.183:6803/1488347209", 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.183:6807/1488347209", 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.183:6805/1488347209", 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_xinfo": [ 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.463792+0000", 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.488920+0000", 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.516673+0000", 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap": [], 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_items": [], 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_primaries": [], 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_temp": [], 2023-10-08T06:57:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_temp": [], 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklist": {}, 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "range_blocklist": {}, 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profiles": { 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "default": { 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-failure-domain": "osd", 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "k": "2", 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "m": "1", 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin": "jerasure", 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "technique": "reed_sol_van" 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps_queue": [], 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "new_removed_snaps": [], 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "new_purged_snaps": [], 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_node_flags": {}, 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "device_class_flags": {}, 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode": { 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_enabled": false, 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_bucket_count": 0, 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "degraded_stretch_mode": 0, 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "recovering_stretch_mode": 0, 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_bucket": 0 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:37.256 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T06:57:37.257 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.184+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:37.258 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:37.259 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:37.259 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': 'a28386aa-6313-4530-b2e8-fd7736a43dc5', 'created': '2023-10-08T06:56:54.481679+0000', 'modified': '2023-10-08T06:57:18.323568+0000', 'last_up_change': '2023-10-08T06:57:03.011095+0000', 'last_in_change': '2023-10-08T06:56:55.385351+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:57:14.549981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:57:15.701169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 2190327034}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 2190327034}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 2190327034}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 2190327034}]}, 'public_addr': '172.21.15.163:6801/2190327034', 'cluster_addr': '172.21.15.163:6803/2190327034', 'heartbeat_back_addr': '172.21.15.163:6807/2190327034', 'heartbeat_front_addr': '172.21.15.163:6805/2190327034', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'da732e65-55c2-489e-bec4-ce4124704896', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 3772527464}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 3772527464}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 3772527464}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 3772527464}]}, 'public_addr': '172.21.15.169:6801/3772527464', 'cluster_addr': '172.21.15.169:6803/3772527464', 'heartbeat_back_addr': '172.21.15.169:6807/3772527464', 'heartbeat_front_addr': '172.21.15.169:6805/3772527464', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6800', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6801', 'nonce': 1488347209}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6802', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6803', 'nonce': 1488347209}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6806', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6807', 'nonce': 1488347209}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6804', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6805', 'nonce': 1488347209}]}, 'public_addr': '172.21.15.183:6801/1488347209', 'cluster_addr': '172.21.15.183:6803/1488347209', 'heartbeat_back_addr': '172.21.15.183:6807/1488347209', 'heartbeat_front_addr': '172.21.15.183:6805/1488347209', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.463792+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.488920+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.516673+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-10-08T06:57:37.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:37.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:37.304 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.303+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:37.386 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.385+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:37.401 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:37.402 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:37.412 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:37.487 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:37.487+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:37.579 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:37.579 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:37.587 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.587+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:37.590 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:37.603 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:37.614 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-08T06:57:36.946348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81728,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033792,"statfs":{"total":289910292480,"available":289826603008,"internally_reserved":0,"allocated":671744,"data_stored":1358647,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002356"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200953+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:19.200953+0000","last_peered":"2023-10-08T06:57:19.200953+0000","last_clean":"2023-10-08T06:57:19.200953+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:19.200953+0000","last_undegraded":"2023-10-08T06:57:19.200953+0000","last_fullsized":"2023-10-08T06:57:19.200953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200608+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:19.200608+0000","last_peered":"2023-10-08T06:57:19.200608+0000","last_clean":"2023-10-08T06:57:19.200608+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:19.200608+0000","last_undegraded":"2023-10-08T06:57:19.200608+0000","last_fullsized":"2023-10-08T06:57:19.200608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334697+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.334697+0000","last_peered":"2023-10-08T06:57:18.334697+0000","last_clean":"2023-10-08T06:57:18.334697+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.334697+0000","last_undegraded":"2023-10-08T06:57:18.334697+0000","last_fullsized":"2023-10-08T06:57:18.334697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334477+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.334477+0000","last_peered":"2023-10-08T06:57:18.334477+0000","last_clean":"2023-10-08T06:57:18.334477+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.334477+0000","last_undegraded":"2023-10-08T06:57:18.334477+0000","last_fullsized":"2023-10-08T06:57:18.334477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200220+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:19.200220+0000","last_peered":"2023-10-08T06:57:19.200220+0000","last_clean":"2023-10-08T06:57:19.200220+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:19.200220+0000","last_undegraded":"2023-10-08T06:57:19.200220+0000","last_fullsized":"2023-10-08T06:57:19.200220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333757+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.333757+0000","last_peered":"2023-10-08T06:57:18.333757+0000","last_clean":"2023-10-08T06:57:18.333757+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.333757+0000","last_undegraded":"2023-10-08T06:57:18.333757+0000","last_fullsized":"2023-10-08T06:57:18.333757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333585+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.333585+0000","last_peered":"2023-10-08T06:57:18.333585+0000","last_clean":"2023-10-08T06:57:18.333585+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.333585+0000","last_undegraded":"2023-10-08T06:57:18.333585+0000","last_fullsized":"2023-10-08T06:57:18.333585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333429+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.333429+0000","last_peered":"2023-10-08T06:57:18.333429+0000","last_clean":"2023-10-08T06:57:18.333429+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.333429+0000","last_undegraded":"2023-10-08T06:57:18.333429+0000","last_fullsized":"2023-10-08T06:57:18.333429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331881+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.331881+0000","last_peered":"2023-10-08T06:57:18.331881+0000","last_clean":"2023-10-08T06:57:18.331881+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.331881+0000","last_undegraded":"2023-10-08T06:57:18.331881+0000","last_fullsized":"2023-10-08T06:57:18.331881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200786+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:19.200786+0000","last_peered":"2023-10-08T06:57:19.200786+0000","last_clean":"2023-10-08T06:57:19.200786+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:19.200786+0000","last_undegraded":"2023-10-08T06:57:19.200786+0000","last_fullsized":"2023-10-08T06:57:19.200786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334400+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.334400+0000","last_peered":"2023-10-08T06:57:18.334400+0000","last_clean":"2023-10-08T06:57:18.334400+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.334400+0000","last_undegraded":"2023-10-08T06:57:18.334400+0000","last_fullsized":"2023-10-08T06:57:18.334400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199983+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:19.199983+0000","last_peered":"2023-10-08T06:57:19.199983+0000","last_clean":"2023-10-08T06:57:19.199983+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:19.199983+0000","last_undegraded":"2023-10-08T06:57:19.199983+0000","last_fullsized":"2023-10-08T06:57:19.199983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200029+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:19.200029+0000","last_peered":"2023-10-08T06:57:19.200029+0000","last_clean":"2023-10-08T06:57:19.200029+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:19.200029+0000","last_undegraded":"2023-10-08T06:57:19.200029+0000","last_fullsized":"2023-10-08T06:57:19.200029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334425+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.334425+0000","last_peered":"2023-10-08T06:57:18.334425+0000","last_clean":"2023-10-08T06:57:18.334425+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.334425+0000","last_undegraded":"2023-10-08T06:57:18.334425+0000","last_fullsized":"2023-10-08T06:57:18.334425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333883+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.333883+0000","last_peered":"2023-10-08T06:57:18.333883+0000","last_clean":"2023-10-08T06:57:18.333883+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.333883+0000","last_undegraded":"2023-10-08T06:57:18.333883+0000","last_fullsized":"2023-10-08T06:57:18.333883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333504+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.333504+0000","last_peered":"2023-10-08T06:57:18.333504+0000","last_clean":"2023-10-08T06:57:18.333504+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.333504+0000","last_undegraded":"2023-10-08T06:57:18.333504+0000","last_fullsized":"2023-10-08T06:57:18.333504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331981+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.331981+0000","last_peered":"2023-10-08T06:57:18.331981+0000","last_clean":"2023-10-08T06:57:18.331981+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.331981+0000","last_undegraded":"2023-10-08T06:57:18.331981+0000","last_fullsized":"2023-10-08T06:57:18.331981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200897+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:19.200897+0000","last_peered":"2023-10-08T06:57:19.200897+0000","last_clean":"2023-10-08T06:57:19.200897+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:19.200897+0000","last_undegraded":"2023-10-08T06:57:19.200897+0000","last_fullsized":"2023-10-08T06:57:19.200897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331998+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.331998+0000","last_peered":"2023-10-08T06:57:18.331998+0000","last_clean":"2023-10-08T06:57:18.331998+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.331998+0000","last_undegraded":"2023-10-08T06:57:18.331998+0000","last_fullsized":"2023-10-08T06:57:18.331998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334495+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.334495+0000","last_peered":"2023-10-08T06:57:18.334495+0000","last_clean":"2023-10-08T06:57:18.334495+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.334495+0000","last_undegraded":"2023-10-08T06:57:18.334495+0000","last_fullsized":"2023-10-08T06:57:18.334495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333990+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.333990+0000","last_peered":"2023-10-08T06:57:18.333990+0000","last_clean":"2023-10-08T06:57:18.333990+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.333990+0000","last_undegraded":"2023-10-08T06:57:18.333990+0000","last_fullsized":"2023-10-08T06:57:18.333990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199761+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:19.199761+0000","last_peered":"2023-10-08T06:57:19.199761+0000","last_clean":"2023-10-08T06:57:19.199761+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:19.199761+0000","last_undegraded":"2023-10-08T06:57:19.199761+0000","last_fullsized":"2023-10-08T06:57:19.199761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:15.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331586+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.331586+0000","last_peered":"2023-10-08T06:57:18.331586+0000","last_clean":"2023-10-08T06:57:18.331586+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.331586+0000","last_undegraded":"2023-10-08T06:57:18.331586+0000","last_fullsized":"2023-10-08T06:57:18.331586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199836+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:19.199836+0000","last_peered":"2023-10-08T06:57:19.199836+0000","last_clean":"2023-10-08T06:57:19.199836+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:19.199836+0000","last_undegraded":"2023-10-08T06:57:19.199836+0000","last_fullsized":"2023-10-08T06:57:19.199836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200845+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:19.200845+0000","last_peered":"2023-10-08T06:57:19.200845+0000","last_clean":"2023-10-08T06:57:19.200845+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:19.200845+0000","last_undegraded":"2023-10-08T06:57:19.200845+0000","last_fullsized":"2023-10-08T06:57:19.200845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331941+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.331941+0000","last_peered":"2023-10-08T06:57:18.331941+0000","last_clean":"2023-10-08T06:57:18.331941+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.331941+0000","last_undegraded":"2023-10-08T06:57:18.331941+0000","last_fullsized":"2023-10-08T06:57:18.331941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334529+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.334529+0000","last_peered":"2023-10-08T06:57:18.334529+0000","last_clean":"2023-10-08T06:57:18.334529+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.334529+0000","last_undegraded":"2023-10-08T06:57:18.334529+0000","last_fullsized":"2023-10-08T06:57:18.334529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955164+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:18.955164+0000","last_peered":"2023-10-08T06:57:18.955164+0000","last_clean":"2023-10-08T06:57:18.955164+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:18.955164+0000","last_undegraded":"2023-10-08T06:57:18.955164+0000","last_fullsized":"2023-10-08T06:57:18.955164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200640+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:19.200640+0000","last_peered":"2023-10-08T06:57:19.200640+0000","last_clean":"2023-10-08T06:57:19.200640+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:19.200640+0000","last_undegraded":"2023-10-08T06:57:19.200640+0000","last_fullsized":"2023-10-08T06:57:19.200640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331590+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.331590+0000","last_peered":"2023-10-08T06:57:18.331590+0000","last_clean":"2023-10-08T06:57:18.331590+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.331590+0000","last_undegraded":"2023-10-08T06:57:18.331590+0000","last_fullsized":"2023-10-08T06:57:18.331590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332180+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.332180+0000","last_peered":"2023-10-08T06:57:18.332180+0000","last_clean":"2023-10-08T06:57:18.332180+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.332180+0000","last_undegraded":"2023-10-08T06:57:18.332180+0000","last_fullsized":"2023-10-08T06:57:18.332180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331115+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.331115+0000","last_peered":"2023-10-08T06:57:18.331115+0000","last_clean":"2023-10-08T06:57:18.331115+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.331115+0000","last_undegraded":"2023-10-08T06:57:18.331115+0000","last_fullsized":"2023-10-08T06:57:18.331115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200839+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:19.200839+0000","last_peered":"2023-10-08T06:57:19.200839+0000","last_clean":"2023-10-08T06:57:19.200839+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:19.200839+0000","last_undegraded":"2023-10-08T06:57:19.200839+0000","last_fullsized":"2023-10-08T06:57:19.200839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332324+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.332324+0000","last_peered":"2023-10-08T06:57:18.332324+0000","last_clean":"2023-10-08T06:57:18.332324+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.332324+0000","last_undegraded":"2023-10-08T06:57:18.332324+0000","last_fullsized":"2023-10-08T06:57:18.332324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331371+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.331371+0000","last_peered":"2023-10-08T06:57:18.331371+0000","last_clean":"2023-10-08T06:57:18.331371+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.331371+0000","last_undegraded":"2023-10-08T06:57:18.331371+0000","last_fullsized":"2023-10-08T06:57:18.331371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334291+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.334291+0000","last_peered":"2023-10-08T06:57:18.334291+0000","last_clean":"2023-10-08T06:57:18.334291+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.334291+0000","last_undegraded":"2023-10-08T06:57:18.334291+0000","last_fullsized":"2023-10-08T06:57:18.334291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331763+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.331763+0000","last_peered":"2023-10-08T06:57:18.331763+0000","last_clean":"2023-10-08T06:57:18.331763+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.331763+0000","last_undegraded":"2023-10-08T06:57:18.331763+0000","last_fullsized":"2023-10-08T06:57:18.331763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955311+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:18.955311+0000","last_peered":"2023-10-08T06:57:18.955311+0000","last_clean":"2023-10-08T06:57:18.955311+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:18.955311+0000","last_undegraded":"2023-10-08T06:57:18.955311+0000","last_fullsized":"2023-10-08T06:57:18.955311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331669+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.331669+0000","last_peered":"2023-10-08T06:57:18.331669+0000","last_clean":"2023-10-08T06:57:18.331669+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.331669+0000","last_undegraded":"2023-10-08T06:57:18.331669+0000","last_fullsized":"2023-10-08T06:57:18.331669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334290+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.334290+0000","last_peered":"2023-10-08T06:57:18.334290+0000","last_clean":"2023-10-08T06:57:18.334290+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.334290+0000","last_undegraded":"2023-10-08T06:57:18.334290+0000","last_fullsized":"2023-10-08T06:57:18.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334365+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.334365+0000","last_peered":"2023-10-08T06:57:18.334365+0000","last_clean":"2023-10-08T06:57:18.334365+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.334365+0000","last_undegraded":"2023-10-08T06:57:18.334365+0000","last_fullsized":"2023-10-08T06:57:18.334365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334237+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.334237+0000","last_peered":"2023-10-08T06:57:18.334237+0000","last_clean":"2023-10-08T06:57:18.334237+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.334237+0000","last_undegraded":"2023-10-08T06:57:18.334237+0000","last_fullsized":"2023-10-08T06:57:18.334237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200115+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:19.200115+0000","last_peered":"2023-10-08T06:57:19.200115+0000","last_clean":"2023-10-08T06:57:19.200115+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:19.200115+0000","last_undegraded":"2023-10-08T06:57:19.200115+0000","last_fullsized":"2023-10-08T06:57:19.200115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331687+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.331687+0000","last_peered":"2023-10-08T06:57:18.331687+0000","last_clean":"2023-10-08T06:57:18.331687+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.331687+0000","last_undegraded":"2023-10-08T06:57:18.331687+0000","last_fullsized":"2023-10-08T06:57:18.331687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200606+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:19.200606+0000","last_peered":"2023-10-08T06:57:19.200606+0000","last_clean":"2023-10-08T06:57:19.200606+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:19.200606+0000","last_undegraded":"2023-10-08T06:57:19.200606+0000","last_fullsized":"2023-10-08T06:57:19.200606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955092+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:18.955092+0000","last_peered":"2023-10-08T06:57:18.955092+0000","last_clean":"2023-10-08T06:57:18.955092+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:18.955092+0000","last_undegraded":"2023-10-08T06:57:18.955092+0000","last_fullsized":"2023-10-08T06:57:18.955092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332284+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.332284+0000","last_peered":"2023-10-08T06:57:18.332284+0000","last_clean":"2023-10-08T06:57:18.332284+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.332284+0000","last_undegraded":"2023-10-08T06:57:18.332284+0000","last_fullsized":"2023-10-08T06:57:18.332284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333778+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.333778+0000","last_peered":"2023-10-08T06:57:18.333778+0000","last_clean":"2023-10-08T06:57:18.333778+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.333778+0000","last_undegraded":"2023-10-08T06:57:18.333778+0000","last_fullsized":"2023-10-08T06:57:18.333778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332441+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.332441+0000","last_peered":"2023-10-08T06:57:18.332441+0000","last_clean":"2023-10-08T06:57:18.332441+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.332441+0000","last_undegraded":"2023-10-08T06:57:18.332441+0000","last_fullsized":"2023-10-08T06:57:18.332441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334724+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.334724+0000","last_peered":"2023-10-08T06:57:18.334724+0000","last_clean":"2023-10-08T06:57:18.334724+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.334724+0000","last_undegraded":"2023-10-08T06:57:18.334724+0000","last_fullsized":"2023-10-08T06:57:18.334724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199355+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:19.199355+0000","last_peered":"2023-10-08T06:57:19.199355+0000","last_clean":"2023-10-08T06:57:19.199355+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:19.199355+0000","last_undegraded":"2023-10-08T06:57:19.199355+0000","last_fullsized":"2023-10-08T06:57:19.199355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955383+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:18.955383+0000","last_peered":"2023-10-08T06:57:18.955383+0000","last_clean":"2023-10-08T06:57:18.955383+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:18.955383+0000","last_undegraded":"2023-10-08T06:57:18.955383+0000","last_fullsized":"2023-10-08T06:57:18.955383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199953+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:19.199953+0000","last_peered":"2023-10-08T06:57:19.199953+0000","last_clean":"2023-10-08T06:57:19.199953+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:19.199953+0000","last_undegraded":"2023-10-08T06:57:19.199953+0000","last_fullsized":"2023-10-08T06:57:19.199953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334506+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.334506+0000","last_peered":"2023-10-08T06:57:18.334506+0000","last_clean":"2023-10-08T06:57:18.334506+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.334506+0000","last_undegraded":"2023-10-08T06:57:18.334506+0000","last_fullsized":"2023-10-08T06:57:18.334506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334249+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.334249+0000","last_peered":"2023-10-08T06:57:18.334249+0000","last_clean":"2023-10-08T06:57:18.334249+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.334249+0000","last_undegraded":"2023-10-08T06:57:18.334249+0000","last_fullsized":"2023-10-08T06:57:18.334249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333896+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.333896+0000","last_peered":"2023-10-08T06:57:18.333896+0000","last_clean":"2023-10-08T06:57:18.333896+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.333896+0000","last_undegraded":"2023-10-08T06:57:18.333896+0000","last_fullsized":"2023-10-08T06:57:18.333896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332051+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.332051+0000","last_peered":"2023-10-08T06:57:18.332051+0000","last_clean":"2023-10-08T06:57:18.332051+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.332051+0000","last_undegraded":"2023-10-08T06:57:18.332051+0000","last_fullsized":"2023-10-08T06:57:18.332051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331427+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.331427+0000","last_peered":"2023-10-08T06:57:18.331427+0000","last_clean":"2023-10-08T06:57:18.331427+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.331427+0000","last_undegraded":"2023-10-08T06:57:18.331427+0000","last_fullsized":"2023-10-08T06:57:18.331427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334184+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.334184+0000","last_peered":"2023-10-08T06:57:18.334184+0000","last_clean":"2023-10-08T06:57:18.334184+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.334184+0000","last_undegraded":"2023-10-08T06:57:18.334184+0000","last_fullsized":"2023-10-08T06:57:18.334184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333798+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.333798+0000","last_peered":"2023-10-08T06:57:18.333798+0000","last_clean":"2023-10-08T06:57:18.333798+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.333798+0000","last_undegraded":"2023-10-08T06:57:18.333798+0000","last_fullsized":"2023-10-08T06:57:18.333798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334844+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.334844+0000","last_peered":"2023-10-08T06:57:18.334844+0000","last_clean":"2023-10-08T06:57:18.334844+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.334844+0000","last_undegraded":"2023-10-08T06:57:18.334844+0000","last_fullsized":"2023-10-08T06:57:18.334844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955080+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:18.955080+0000","last_peered":"2023-10-08T06:57:18.955080+0000","last_clean":"2023-10-08T06:57:18.955080+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:18.955080+0000","last_undegraded":"2023-10-08T06:57:18.955080+0000","last_fullsized":"2023-10-08T06:57:18.955080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334527+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.334527+0000","last_peered":"2023-10-08T06:57:18.334527+0000","last_clean":"2023-10-08T06:57:18.334527+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.334527+0000","last_undegraded":"2023-10-08T06:57:18.334527+0000","last_fullsized":"2023-10-08T06:57:18.334527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955052+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:18.955052+0000","last_peered":"2023-10-08T06:57:18.955052+0000","last_clean":"2023-10-08T06:57:18.955052+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:18.955052+0000","last_undegraded":"2023-10-08T06:57:18.955052+0000","last_fullsized":"2023-10-08T06:57:18.955052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332280+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.332280+0000","last_peered":"2023-10-08T06:57:18.332280+0000","last_clean":"2023-10-08T06:57:18.332280+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.332280+0000","last_undegraded":"2023-10-08T06:57:18.332280+0000","last_fullsized":"2023-10-08T06:57:18.332280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.322034+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:17.322034+0000","last_peered":"2023-10-08T06:57:17.322034+0000","last_clean":"2023-10-08T06:57:17.322034+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:17.322034+0000","last_undegraded":"2023-10-08T06:57:17.322034+0000","last_fullsized":"2023-10-08T06:57:17.322034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334630+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.334630+0000","last_peered":"2023-10-08T06:57:18.334630+0000","last_clean":"2023-10-08T06:57:18.334630+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.334630+0000","last_undegraded":"2023-10-08T06:57:18.334630+0000","last_fullsized":"2023-10-08T06:57:18.334630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199918+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:19.199918+0000","last_peered":"2023-10-08T06:57:19.199918+0000","last_clean":"2023-10-08T06:57:19.199918+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:19.199918+0000","last_undegraded":"2023-10-08T06:57:19.199918+0000","last_fullsized":"2023-10-08T06:57:19.199918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329398+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:17.329398+0000","last_peered":"2023-10-08T06:57:17.329398+0000","last_clean":"2023-10-08T06:57:17.329398+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:17.329398+0000","last_undegraded":"2023-10-08T06:57:17.329398+0000","last_fullsized":"2023-10-08T06:57:17.329398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334137+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.334137+0000","last_peered":"2023-10-08T06:57:18.334137+0000","last_clean":"2023-10-08T06:57:18.334137+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.334137+0000","last_undegraded":"2023-10-08T06:57:18.334137+0000","last_fullsized":"2023-10-08T06:57:18.334137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332274+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.332274+0000","last_peered":"2023-10-08T06:57:18.332274+0000","last_clean":"2023-10-08T06:57:18.332274+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.332274+0000","last_undegraded":"2023-10-08T06:57:18.332274+0000","last_fullsized":"2023-10-08T06:57:18.332274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.321071+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:17.321071+0000","last_peered":"2023-10-08T06:57:17.321071+0000","last_clean":"2023-10-08T06:57:17.321071+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:17.321071+0000","last_undegraded":"2023-10-08T06:57:17.321071+0000","last_fullsized":"2023-10-08T06:57:17.321071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955037+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:18.955037+0000","last_peered":"2023-10-08T06:57:18.955037+0000","last_clean":"2023-10-08T06:57:18.955037+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:18.955037+0000","last_undegraded":"2023-10-08T06:57:18.955037+0000","last_fullsized":"2023-10-08T06:57:18.955037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332451+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.332451+0000","last_peered":"2023-10-08T06:57:18.332451+0000","last_clean":"2023-10-08T06:57:18.332451+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.332451+0000","last_undegraded":"2023-10-08T06:57:18.332451+0000","last_fullsized":"2023-10-08T06:57:18.332451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330319+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:17.330319+0000","last_peered":"2023-10-08T06:57:17.330319+0000","last_clean":"2023-10-08T06:57:17.330319+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:17.330319+0000","last_undegraded":"2023-10-08T06:57:17.330319+0000","last_fullsized":"2023-10-08T06:57:17.330319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.329262+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:17.329262+0000","last_peered":"2023-10-08T06:57:17.329262+0000","last_clean":"2023-10-08T06:57:17.329262+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:17.329262+0000","last_undegraded":"2023-10-08T06:57:17.329262+0000","last_fullsized":"2023-10-08T06:57:17.329262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331430+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.331430+0000","last_peered":"2023-10-08T06:57:18.331430+0000","last_clean":"2023-10-08T06:57:18.331430+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.331430+0000","last_undegraded":"2023-10-08T06:57:18.331430+0000","last_fullsized":"2023-10-08T06:57:18.331430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334793+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.334793+0000","last_peered":"2023-10-08T06:57:18.334793+0000","last_clean":"2023-10-08T06:57:18.334793+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.334793+0000","last_undegraded":"2023-10-08T06:57:18.334793+0000","last_fullsized":"2023-10-08T06:57:18.334793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.330138+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:17.330138+0000","last_peered":"2023-10-08T06:57:17.330138+0000","last_clean":"2023-10-08T06:57:17.330138+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:17.330138+0000","last_undegraded":"2023-10-08T06:57:17.330138+0000","last_fullsized":"2023-10-08T06:57:17.330138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331051+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.331051+0000","last_peered":"2023-10-08T06:57:18.331051+0000","last_clean":"2023-10-08T06:57:18.331051+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.331051+0000","last_undegraded":"2023-10-08T06:57:18.331051+0000","last_fullsized":"2023-10-08T06:57:18.331051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200820+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:19.200820+0000","last_peered":"2023-10-08T06:57:19.200820+0000","last_clean":"2023-10-08T06:57:19.200820+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:19.200820+0000","last_undegraded":"2023-10-08T06:57:19.200820+0000","last_fullsized":"2023-10-08T06:57:19.200820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.325509+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:17.325509+0000","last_peered":"2023-10-08T06:57:17.325509+0000","last_clean":"2023-10-08T06:57:17.325509+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:17.325509+0000","last_undegraded":"2023-10-08T06:57:17.325509+0000","last_fullsized":"2023-10-08T06:57:17.325509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332015+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.332015+0000","last_peered":"2023-10-08T06:57:18.332015+0000","last_clean":"2023-10-08T06:57:18.332015+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.332015+0000","last_undegraded":"2023-10-08T06:57:18.332015+0000","last_fullsized":"2023-10-08T06:57:18.332015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200292+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:19.200292+0000","last_peered":"2023-10-08T06:57:19.200292+0000","last_clean":"2023-10-08T06:57:19.200292+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:19.200292+0000","last_undegraded":"2023-10-08T06:57:19.200292+0000","last_fullsized":"2023-10-08T06:57:19.200292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332004+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.332004+0000","last_peered":"2023-10-08T06:57:18.332004+0000","last_clean":"2023-10-08T06:57:18.332004+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.332004+0000","last_undegraded":"2023-10-08T06:57:18.332004+0000","last_fullsized":"2023-10-08T06:57:18.332004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.323142+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:17.323142+0000","last_peered":"2023-10-08T06:57:17.323142+0000","last_clean":"2023-10-08T06:57:17.323142+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:17.323142+0000","last_undegraded":"2023-10-08T06:57:17.323142+0000","last_fullsized":"2023-10-08T06:57:17.323142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.330989+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.330989+0000","last_peered":"2023-10-08T06:57:18.330989+0000","last_clean":"2023-10-08T06:57:18.330989+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.330989+0000","last_undegraded":"2023-10-08T06:57:18.330989+0000","last_fullsized":"2023-10-08T06:57:18.330989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:17.331023+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:17.331023+0000","last_peered":"2023-10-08T06:57:17.331023+0000","last_clean":"2023-10-08T06:57:17.331023+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:17.331023+0000","last_undegraded":"2023-10-08T06:57:17.331023+0000","last_fullsized":"2023-10-08T06:57:17.331023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952345+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:18.952345+0000","last_peered":"2023-10-08T06:57:18.952345+0000","last_clean":"2023-10-08T06:57:18.952345+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:18.952345+0000","last_undegraded":"2023-10-08T06:57:18.952345+0000","last_fullsized":"2023-10-08T06:57:18.952345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199708+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:19.199708+0000","last_peered":"2023-10-08T06:57:19.199708+0000","last_clean":"2023-10-08T06:57:19.199708+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:19.199708+0000","last_undegraded":"2023-10-08T06:57:19.199708+0000","last_fullsized":"2023-10-08T06:57:19.199708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955224+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:18.955224+0000","last_peered":"2023-10-08T06:57:18.955224+0000","last_clean":"2023-10-08T06:57:18.955224+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:18.955224+0000","last_undegraded":"2023-10-08T06:57:18.955224+0000","last_fullsized":"2023-10-08T06:57:18.955224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200258+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:19.200258+0000","last_peered":"2023-10-08T06:57:19.200258+0000","last_clean":"2023-10-08T06:57:19.200258+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:19.200258+0000","last_undegraded":"2023-10-08T06:57:19.200258+0000","last_fullsized":"2023-10-08T06:57:19.200258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334243+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.334243+0000","last_peered":"2023-10-08T06:57:18.334243+0000","last_clean":"2023-10-08T06:57:18.334243+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.334243+0000","last_undegraded":"2023-10-08T06:57:18.334243+0000","last_fullsized":"2023-10-08T06:57:18.334243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334062+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.334062+0000","last_peered":"2023-10-08T06:57:18.334062+0000","last_clean":"2023-10-08T06:57:18.334062+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.334062+0000","last_undegraded":"2023-10-08T06:57:18.334062+0000","last_fullsized":"2023-10-08T06:57:18.334062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.955330+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:18.955330+0000","last_peered":"2023-10-08T06:57:18.955330+0000","last_clean":"2023-10-08T06:57:18.955330+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:18.955330+0000","last_undegraded":"2023-10-08T06:57:18.955330+0000","last_fullsized":"2023-10-08T06:57:18.955330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333951+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.333951+0000","last_peered":"2023-10-08T06:57:18.333951+0000","last_clean":"2023-10-08T06:57:18.333951+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.333951+0000","last_undegraded":"2023-10-08T06:57:18.333951+0000","last_fullsized":"2023-10-08T06:57:18.333951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332288+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.332288+0000","last_peered":"2023-10-08T06:57:18.332288+0000","last_clean":"2023-10-08T06:57:18.332288+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.332288+0000","last_undegraded":"2023-10-08T06:57:18.332288+0000","last_fullsized":"2023-10-08T06:57:18.332288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199990+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:19.199990+0000","last_peered":"2023-10-08T06:57:19.199990+0000","last_clean":"2023-10-08T06:57:19.199990+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:19.199990+0000","last_undegraded":"2023-10-08T06:57:19.199990+0000","last_fullsized":"2023-10-08T06:57:19.199990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332218+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.332218+0000","last_peered":"2023-10-08T06:57:18.332218+0000","last_clean":"2023-10-08T06:57:18.332218+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.332218+0000","last_undegraded":"2023-10-08T06:57:18.332218+0000","last_fullsized":"2023-10-08T06:57:18.332218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334155+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.334155+0000","last_peered":"2023-10-08T06:57:18.334155+0000","last_clean":"2023-10-08T06:57:18.334155+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.334155+0000","last_undegraded":"2023-10-08T06:57:18.334155+0000","last_fullsized":"2023-10-08T06:57:18.334155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333744+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.333744+0000","last_peered":"2023-10-08T06:57:18.333744+0000","last_clean":"2023-10-08T06:57:18.333744+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.333744+0000","last_undegraded":"2023-10-08T06:57:18.333744+0000","last_fullsized":"2023-10-08T06:57:18.333744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331439+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.331439+0000","last_peered":"2023-10-08T06:57:18.331439+0000","last_clean":"2023-10-08T06:57:18.331439+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.331439+0000","last_undegraded":"2023-10-08T06:57:18.331439+0000","last_fullsized":"2023-10-08T06:57:18.331439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199961+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:19.199961+0000","last_peered":"2023-10-08T06:57:19.199961+0000","last_clean":"2023-10-08T06:57:19.199961+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:19.199961+0000","last_undegraded":"2023-10-08T06:57:19.199961+0000","last_fullsized":"2023-10-08T06:57:19.199961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331729+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.331729+0000","last_peered":"2023-10-08T06:57:18.331729+0000","last_clean":"2023-10-08T06:57:18.331729+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.331729+0000","last_undegraded":"2023-10-08T06:57:18.331729+0000","last_fullsized":"2023-10-08T06:57:18.331729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200274+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:19.200274+0000","last_peered":"2023-10-08T06:57:19.200274+0000","last_clean":"2023-10-08T06:57:19.200274+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:19.200274+0000","last_undegraded":"2023-10-08T06:57:19.200274+0000","last_fullsized":"2023-10-08T06:57:19.200274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":650475,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":649859,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:37.620 INFO:tasks.thrashosds.thrasher:Setting 2.1 to [1, 0, 2] 2023-10-08T06:57:37.620 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.1', '1', '0', '2'] 2023-10-08T06:57:37.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.1 1 0 2 2023-10-08T06:57:37.689 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:37.689+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:37.759 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:37.759 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:37.770 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:37.789 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.789+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:37.890 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.890+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:37.911 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:37.911 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:37.922 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:37.992 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:37.991+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2023-10-08T06:57:38.011 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-08T06:57:38.012 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2023-10-08T06:57:38.049 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:38.049 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:38.059 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:38.093 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:38.092+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_0' created 2023-10-08T06:57:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:57:38.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2023-10-08T06:57:38.188 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:38.188 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:38.193 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:38.193+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:38.199 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:38.295 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:38.294+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:38.338 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:38.338 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:38.348 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:38.396 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:38.396+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:38.476 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:38.476 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:38.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:38.496 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:38.496+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:38.597 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:38.597+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:38.613 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:38.614 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:38.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:38.698 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:38.698+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:38.764 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:38.764 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:38.774 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:38.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:38.798+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:38.899 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:38.898+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:38.901 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:38.901 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:38.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:39.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:38.999+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:39.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:57:39.080 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:39.080 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:39.090 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:39.100 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:39.100+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:39.156 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_0' 2023-10-08T06:57:39.178 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:39.199 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:39.201 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:39.201+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:39.218 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:57:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:57:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:57:39.229 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:39.229 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:57:39.229 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2023-10-08T06:57:39.229 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:39.239 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:39.323 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:39.323+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:39.403 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:39.403+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:39.406 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:39.406 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:57:39.406 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2023-10-08T06:57:39.406 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2023-10-08T06:57:39.406 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:39.415 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:39.504 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:39.503+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:39.586 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:39.586 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:57:39.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:57:39.586 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253632536000001, 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012193371999999999, 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:39.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330209+0000", 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9219999999999992e-06 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330217+0000", 2023-10-08T06:57:39.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9049999999999997e-06 2023-10-08T06:57:39.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330228+0000", 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330242+0000", 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3141e-05 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331761+0000", 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015191009999999999 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331881+0000", 2023-10-08T06:57:39.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000120701 2023-10-08T06:57:39.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:39.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332370+0000", 2023-10-08T06:57:39.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048859900000000004 2023-10-08T06:57:39.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336444+0000", 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040740780000000001 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342335+0000", 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058908399999999996 2023-10-08T06:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342370+0000", 2023-10-08T06:57:39.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4993999999999997e-05 2023-10-08T06:57:39.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342393+0000", 2023-10-08T06:57:39.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2736999999999999e-05 2023-10-08T06:57:39.596 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.596 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.596 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253567116999999, 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012275207999999999, 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:39.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2099999999999996e-07 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330270+0000", 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2509999999999996e-06 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330279+0000", 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1409999999999994e-06 2023-10-08T06:57:39.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330286+0000", 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332713+0000", 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024269370000000001 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332918+0000", 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020486300000000001 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:39.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333021+0000", 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001032 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336451+0000", 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003429578 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342439+0000", 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059881639999999998 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342500+0000", 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0723000000000001e-05 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342540+0000", 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9950999999999997e-05 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330296+0000", 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253535458999998, 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073905510000000004, 2023-10-08T06:57:39.605 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.606 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.606 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330296+0000", 2023-10-08T06:57:39.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330296+0000", 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330297+0000", 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4400000000000001e-07 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330300+0000", 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.185e-06 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330307+0000", 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6379999999999998e-06 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330313+0000", 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7449999999999998e-06 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332699+0000", 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0023857180000000002 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333193+0000", 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00049434000000000001 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333697+0000", 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00050372600000000002 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336457+0000", 2023-10-08T06:57:39.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027602170000000001 2023-10-08T06:57:39.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:39.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337609+0000", 2023-10-08T06:57:39.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001151972 2023-10-08T06:57:39.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337652+0000", 2023-10-08T06:57:39.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3149999999999999e-05 2023-10-08T06:57:39.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337687+0000", 2023-10-08T06:57:39.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4415999999999997e-05 2023-10-08T06:57:39.613 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.613 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.614 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.614 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.614 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330322+0000", 2023-10-08T06:57:39.614 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253509941000001, 2023-10-08T06:57:39.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075319599999999999, 2023-10-08T06:57:39.615 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.615 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.615 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330322+0000", 2023-10-08T06:57:39.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330322+0000", 2023-10-08T06:57:39.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330322+0000", 2023-10-08T06:57:39.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4099999999999999e-07 2023-10-08T06:57:39.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330328+0000", 2023-10-08T06:57:39.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:57:39.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330337+0000", 2023-10-08T06:57:39.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4230000000000005e-06 2023-10-08T06:57:39.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330346+0000", 2023-10-08T06:57:39.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5699999999999999e-06 2023-10-08T06:57:39.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334059+0000", 2023-10-08T06:57:39.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037125940000000001 2023-10-08T06:57:39.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334144+0000", 2023-10-08T06:57:39.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5548000000000002e-05 2023-10-08T06:57:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334262+0000", 2023-10-08T06:57:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000117231 2023-10-08T06:57:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336488+0000", 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022264590000000001 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:39.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337739+0000", 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012513730000000001 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337813+0000", 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3795999999999996e-05 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337854+0000", 2023-10-08T06:57:39.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0496e-05 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253475596000001, 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012552061999999999, 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.625 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330357+0000", 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6800000000000001e-07 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330362+0000", 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2580000000000003e-06 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330370+0000", 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330376+0000", 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8599999999999998e-06 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334003+0000", 2023-10-08T06:57:39.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003627473 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334126+0000", 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012268899999999999 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334291+0000", 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000165582 2023-10-08T06:57:39.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.338174+0000", 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0038830750000000002 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342831+0000", 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0046565549999999997 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342871+0000", 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9614999999999999e-05 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342908+0000", 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7703999999999997e-05 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330386+0000", 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253445428999999, 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.009743392, 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330386+0000", 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330386+0000", 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330387+0000", 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:57:39.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330390+0000", 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330398+0000", 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2220000000000002e-06 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330405+0000", 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1759999999999998e-06 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330468+0000", 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3398000000000005e-05 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330949+0000", 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048125799999999998 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331109+0000", 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015934599999999999 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:39.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336046+0000", 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049378249999999999 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340034+0000", 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039870060000000004 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340089+0000", 2023-10-08T06:57:39.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5980000000000003e-05 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340130+0000", 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0241000000000003e-05 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.638 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253404338999999, 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012140507, 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330428+0000", 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.44e-07 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330432+0000", 2023-10-08T06:57:39.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6270000000000002e-06 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330440+0000", 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4449999999999996e-06 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330447+0000", 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9920000000000001e-06 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332674+0000", 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002227003 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332817+0000", 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000142385 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342568+0000", 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0097514109999999998 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.253374144999999, 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012554457, 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.643 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8599999999999998e-07 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330461+0000", 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1140000000000002e-06 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330890+0000", 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042921399999999997 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330901+0000", 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0664e-05 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334897+0000", 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039962260000000003 2023-10-08T06:57:39.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.335028+0000", 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013081400000000001 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.343012+0000", 2023-10-08T06:57:39.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079839390000000007 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330917+0000", 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.252914466, 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0047373789999999999, 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330917+0000", 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330917+0000", 2023-10-08T06:57:39.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330918+0000", 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3500000000000005e-07 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330929+0000", 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.047e-05 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330938+0000", 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1479999999999995e-06 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330956+0000", 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8406999999999998e-05 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331015+0000", 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9200000000000002e-05 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331210+0000", 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00019460199999999999 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.335655+0000", 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0044447169999999999 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.653 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.333823+0000", 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.250008946000001, 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026641500000000001, 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:57:39.654 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333823+0000", 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333823+0000", 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333823+0000", 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3199999999999999e-07 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333829+0000", 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9699999999999996e-06 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333840+0000", 2023-10-08T06:57:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1195999999999999e-05 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333855+0000", 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5213e-05 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333934+0000", 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8526e-05 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336487+0000", 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0025531130000000001 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.337575+0000", 2023-10-08T06:57:39.658 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.246256924000001, 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00028827399999999998, 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337575+0000", 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337575+0000", 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337575+0000", 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3799999999999999e-07 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337577+0000", 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4729999999999999e-06 2023-10-08T06:57:39.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337581+0000", 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6480000000000002e-06 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337584+0000", 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.959e-06 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337723+0000", 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000139176 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337732+0000", 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5259999999999993e-06 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.337863+0000", 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000131254 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(mds.0.3:21 3.b e18/16 ondisk, result = 0)", 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.339943+0000", 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.243889052, 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00019357599999999999, 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:39.663 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.339943+0000", 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.339943+0000", 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.339943+0000", 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1899999999999998e-07 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.339947+0000", 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6600000000000001e-06 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.339953+0000", 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.477e-06 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.339971+0000", 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7703999999999999e-05 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340018+0000", 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7429999999999998e-05 2023-10-08T06:57:39.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340027+0000", 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4200000000000007e-06 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340136+0000", 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000109566 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.667 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.340017+0000", 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.243814815, 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012969800000000001, 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.668 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340017+0000", 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340017+0000", 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340017+0000", 2023-10-08T06:57:39.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9299999999999999e-07 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340028+0000", 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0701e-05 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340036+0000", 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5950000000000001e-06 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340042+0000", 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.939e-06 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340172+0000", 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012904 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340192+0000", 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0421999999999999e-05 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.341264+0000", 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001072307 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.341314+0000", 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9682999999999998e-05 2023-10-08T06:57:39.672 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.340123+0000", 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.243709074000002, 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001226579, 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340123+0000", 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340123+0000", 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340123+0000", 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1e-07 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340140+0000", 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7540000000000001e-05 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340147+0000", 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0430000000000002e-06 2023-10-08T06:57:39.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340154+0000", 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.635e-06 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340238+0000", 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4363000000000005e-05 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340256+0000", 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7393000000000001e-05 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.341305+0000", 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010490219999999999 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.341349+0000", 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4372999999999997e-05 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.340164+0000", 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.243668246999999, 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019290819999999999, 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.678 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340164+0000", 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340164+0000", 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.680 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.680 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340164+0000", 2023-10-08T06:57:39.680 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6800000000000002e-07 2023-10-08T06:57:39.680 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.680 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.680 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.680 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340168+0000", 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.138e-06 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340175+0000", 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.464e-06 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340180+0000", 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8280000000000002e-06 2023-10-08T06:57:39.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340531+0000", 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00035099099999999999 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340551+0000", 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9360000000000001e-05 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342050+0000", 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014998609999999999 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342093+0000", 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2172000000000002e-05 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.340187+0000", 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.243644561, 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001191742, 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340187+0000", 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.684 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340187+0000", 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340187+0000", 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0599999999999999e-07 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.685 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340204+0000", 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6748e-05 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340211+0000", 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5679999999999996e-06 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340217+0000", 2023-10-08T06:57:39.686 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.801e-06 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340476+0000", 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00025912500000000002 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.340496+0000", 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9998999999999999e-05 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.687 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.341343+0000", 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00084774399999999999 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.341379+0000", 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5550999999999999e-05 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.688 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.342341+0000", 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.241491161999999, 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000209192, 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342341+0000", 2023-10-08T06:57:39.689 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342341+0000", 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342341+0000", 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9099999999999999e-07 2023-10-08T06:57:39.690 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342343+0000", 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1849999999999998e-06 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342350+0000", 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.596e-06 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.691 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342354+0000", 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0450000000000002e-06 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342426+0000", 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2162999999999993e-05 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342433+0000", 2023-10-08T06:57:39.692 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3769999999999998e-06 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342550+0000", 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011643500000000001 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-10-08T06:57:39.693 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.342782+0000", 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.241049275999998, 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000237808, 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342782+0000", 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.694 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342782+0000", 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342783+0000", 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8000000000000002e-07 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342786+0000", 2023-10-08T06:57:39.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0450000000000001e-06 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342792+0000", 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1199999999999999e-06 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342806+0000", 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3585e-05 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342944+0000", 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013803599999999999 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.343020+0000", 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6742000000000005e-05 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.697 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:21.402335+0000", 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 18.181496793000001, 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001878558, 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402335+0000", 2023-10-08T06:57:39.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402335+0000", 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402336+0000", 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3060000000000001e-06 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402344+0000", 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3359999999999997e-06 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402359+0000", 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.588e-05 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402369+0000", 2023-10-08T06:57:39.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9070000000000002e-06 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402501+0000", 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013137700000000001 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402627+0000", 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012614899999999999 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.402747+0000", 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000119597 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.403463+0000", 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00071603499999999996 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:39.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404108+0000", 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064552900000000005 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404166+0000", 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8158999999999997e-05 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404214+0000", 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7283000000000001e-05 2023-10-08T06:57:39.703 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:21.404008+0000", 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 18.179823509999999, 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00021321099999999999, 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.704 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404008+0000", 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404008+0000", 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404009+0000", 2023-10-08T06:57:39.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.16e-07 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404014+0000", 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8029999999999996e-06 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404028+0000", 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3944000000000001e-05 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404037+0000", 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1130000000000007e-06 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404092+0000", 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4898999999999997e-05 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:39.707 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404102+0000", 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0032e-05 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:21.404221+0000", 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000119604 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:39.708 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:39.710 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:39.710 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:39.709+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:39.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:39.810+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:39.852 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:39.852 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:57:39.852 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2023-10-08T06:57:39.852 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:39.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:39.912 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:39.912+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:40.013 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:40.013+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:40.030 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:40.030 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:57:40.030 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:57:40.030 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:57:40.030 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:40.040 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:40.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:40.112+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:40.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:57:40.169 DEBUG:teuthology.orchestra.run.smithi037:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2023-10-08T06:57:40.171 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:57:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:57:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.548214477999998, 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011390189, 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 138 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620642+0000", 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.172e-06 2023-10-08T06:57:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620646+0000", 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6380000000000002e-06 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620648+0000", 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6199999999999999e-06 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625513+0000", 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004864635 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625565+0000", 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1842000000000003e-05 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625656+0000", 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0928999999999996e-05 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.629969+0000", 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043131350000000001 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.631936+0000", 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019671889999999998 2023-10-08T06:57:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.631991+0000", 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5226999999999998e-05 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632028+0000", 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6480000000000003e-05 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.178 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.548198063000001, 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011461148000000001, 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 139 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5800000000000001e-07 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620657+0000", 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7180000000000001e-06 2023-10-08T06:57:40.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620661+0000", 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5640000000000001e-06 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620663+0000", 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6079999999999998e-06 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626056+0000", 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053925049999999997 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626104+0000", 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8486999999999998e-05 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626179+0000", 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4725e-05 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.629972+0000", 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037933670000000002 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632060+0000", 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020872460000000001 2023-10-08T06:57:40.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632093+0000", 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3314e-05 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632115+0000", 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2356000000000001e-05 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.185 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.548136489999997, 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011776666999999999, 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.186 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 140 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:40.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6199999999999999e-07 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620788+0000", 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2639999999999996e-05 2023-10-08T06:57:40.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620793+0000", 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9629999999999997e-06 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620796+0000", 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0359999999999998e-06 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626432+0000", 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056358270000000004 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626511+0000", 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8640999999999995e-05 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626653+0000", 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014228600000000001 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632155+0000", 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055017809999999999 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632438+0000", 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028323999999999998 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632471+0000", 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2484999999999998e-05 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632492+0000", 2023-10-08T06:57:40.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1506e-05 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.548049851999998, 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013962354, 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.193 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 141 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620803+0000", 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7000000000000001e-07 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620806+0000", 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.676e-06 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620810+0000", 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.647e-06 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620812+0000", 2023-10-08T06:57:40.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5019999999999999e-06 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627179+0000", 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0063668500000000003 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627272+0000", 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3276000000000006e-05 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627404+0000", 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131428 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632498+0000", 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005094164 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634675+0000", 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021769570000000002 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634731+0000", 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6144999999999999e-05 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634765+0000", 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3439000000000003e-05 2023-10-08T06:57:40.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.417161376000003, 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011009055, 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 164 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3200000000000001e-07 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751760+0000", 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9245999999999994e-05 2023-10-08T06:57:40.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751767+0000", 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5740000000000001e-06 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751770+0000", 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3270000000000001e-06 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.756961+0000", 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051907580000000002 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757016+0000", 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5041999999999999e-05 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757109+0000", 2023-10-08T06:57:40.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3183999999999994e-05 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.761179+0000", 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040696949999999999 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762655+0000", 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001476045 2023-10-08T06:57:40.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762682+0000", 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6948999999999999e-05 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762700+0000", 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8003e-05 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.417076457999997, 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010965292, 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.207 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 165 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:40.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4400000000000001e-07 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751778+0000", 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0150000000000002e-06 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751781+0000", 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.433e-06 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751784+0000", 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757514+0000", 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00572983 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757591+0000", 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6790000000000002e-05 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757698+0000", 2023-10-08T06:57:40.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010757899999999999 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.761205+0000", 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003506866 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762703+0000", 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001497998 2023-10-08T06:57:40.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762724+0000", 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0818e-05 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762741+0000", 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6935999999999998e-05 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.213 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.907831+0000", 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.261021425000003, 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010022583999999999, 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.214 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907831+0000", 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907831+0000", 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907831+0000", 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9100000000000004e-07 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907835+0000", 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4419999999999998e-06 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907843+0000", 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3659999999999992e-06 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907850+0000", 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4229999999999999e-06 2023-10-08T06:57:40.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.911392+0000", 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035418099999999998 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.911451+0000", 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8349e-05 2023-10-08T06:57:40.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.911529+0000", 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8410000000000003e-05 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.915866+0000", 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043367320000000003 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917805+0000", 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001939622 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917835+0000", 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9926000000000001e-05 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917853+0000", 2023-10-08T06:57:40.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8012999999999998e-05 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.907859+0000", 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.260993331999998, 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010068456999999999, 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.221 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907859+0000", 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907859+0000", 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907859+0000", 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4900000000000001e-07 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907863+0000", 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3160000000000001e-06 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907869+0000", 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5729999999999996e-06 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907875+0000", 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1090000000000003e-06 2023-10-08T06:57:40.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.911852+0000", 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039771069999999997 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.911909+0000", 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7088e-05 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.911987+0000", 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7157999999999995e-05 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.915868+0000", 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038813849999999998 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917882+0000", 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020137380000000002 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917909+0000", 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6945999999999999e-05 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917927+0000", 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8587999999999999e-05 2023-10-08T06:57:40.227 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.907884+0000", 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.260967841999999, 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010119326, 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907884+0000", 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907884+0000", 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907885+0000", 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4700000000000002e-07 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907938+0000", 2023-10-08T06:57:40.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3761000000000002e-05 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907946+0000", 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5259999999999996e-06 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907952+0000", 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7989999999999999e-06 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.912236+0000", 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042840919999999998 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.912287+0000", 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1366000000000003e-05 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.912368+0000", 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1005000000000001e-05 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.915870+0000", 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035018990000000002 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917958+0000", 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020875220000000001 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.917985+0000", 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7069000000000001e-05 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.918004+0000", 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8839999999999999e-05 2023-10-08T06:57:40.234 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.907961+0000", 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.260890734999997, 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010108839, 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:40.235 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907961+0000", 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907961+0000", 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907962+0000", 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6000000000000004e-07 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907965+0000", 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2200000000000001e-06 2023-10-08T06:57:40.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907972+0000", 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.596e-06 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.907977+0000", 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0119999999999996e-06 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.912746+0000", 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047693420000000002 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.912797+0000", 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0729000000000002e-05 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.912874+0000", 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6880999999999998e-05 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.915872+0000", 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002998545 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.918026+0000", 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021540610000000001 2023-10-08T06:57:40.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.918052+0000", 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5380000000000001e-05 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.918070+0000", 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8513e-05 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.331928+0000", 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.836924242999999, 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0099703420000000001, 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.331928+0000", 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.331928+0000", 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.331930+0000", 2023-10-08T06:57:40.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0839999999999999e-06 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.331944+0000", 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4433999999999999e-05 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332508+0000", 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056382999999999997 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332522+0000", 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3995000000000001e-05 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332757+0000", 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023508599999999999 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.334147+0000", 2023-10-08T06:57:40.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0013894300000000001 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.334304+0000", 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000157164 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341758+0000", 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0074538740000000001 2023-10-08T06:57:40.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341806+0000", 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8520000000000003e-05 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341866+0000", 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9734000000000001e-05 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341898+0000", 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2190999999999997e-05 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.332621+0000", 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.836230697000001, 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097612370000000007, 2023-10-08T06:57:40.248 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332621+0000", 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332621+0000", 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332622+0000", 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5799999999999998e-07 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332627+0000", 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0100000000000003e-06 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332636+0000", 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0399999999999998e-06 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332664+0000", 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121e-05 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.335953+0000", 2023-10-08T06:57:40.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032895580000000002 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.336579+0000", 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00062600700000000004 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.336738+0000", 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015856299999999999 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341930+0000", 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051928479999999999 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342273+0000", 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034286599999999999 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342349+0000", 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6117000000000003e-05 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342383+0000", 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3148999999999997e-05 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.8360995, 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01058655, 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332754+0000", 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.097e-06 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332760+0000", 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8459999999999996e-06 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333028+0000", 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026832499999999998 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333042+0000", 2023-10-08T06:57:40.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3706000000000001e-05 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337211+0000", 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041694540000000004 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337302+0000", 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1018000000000002e-05 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337439+0000", 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013716100000000001 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342181+0000", 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047421140000000004 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343237+0000", 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001055467 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343294+0000", 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7132999999999997e-05 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343339+0000", 2023-10-08T06:57:40.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5228999999999997e-05 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.835793959, 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0105679, 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333059+0000", 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6700000000000002e-07 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333064+0000", 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3730000000000001e-06 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333083+0000", 2023-10-08T06:57:40.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8414999999999999e-05 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333089+0000", 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6649999999999997e-06 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338347+0000", 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052580420000000001 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338475+0000", 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000127126 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338606+0000", 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131839 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342403+0000", 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037962629999999998 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343515+0000", 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011117939999999999 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343580+0000", 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5961000000000001e-05 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343626+0000", 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5555e-05 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.267 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.835751526999999, 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010644859, 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8800000000000002e-07 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333108+0000", 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7170000000000002e-06 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333117+0000", 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.431e-06 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333124+0000", 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9909999999999996e-06 2023-10-08T06:57:40.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339316+0000", 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061920350000000002 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339422+0000", 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105944 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339605+0000", 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018256300000000001 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342597+0000", 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029923630000000001 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343671+0000", 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001073875 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343707+0000", 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5989999999999999e-05 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343745+0000", 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8262000000000001e-05 2023-10-08T06:57:40.273 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.835711808999999, 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010707638, 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.274 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333141+0000", 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7800000000000001e-07 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333145+0000", 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.811e-06 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333152+0000", 2023-10-08T06:57:40.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0979999999999996e-06 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333159+0000", 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7970000000000003e-06 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340436+0000", 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0072776949999999998 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340523+0000", 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7148e-05 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340623+0000", 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9544999999999996e-05 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342810+0000", 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021866170000000001 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343777+0000", 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00096742699999999998 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343823+0000", 2023-10-08T06:57:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5569999999999999e-05 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343848+0000", 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5352000000000001e-05 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.280 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.835605481000002, 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010728084000000001, 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7700000000000004e-07 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333252+0000", 2023-10-08T06:57:40.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3290000000000004e-06 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333259+0000", 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9070000000000007e-06 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333265+0000", 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9730000000000002e-06 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340906+0000", 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076407360000000004 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341004+0000", 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8303999999999999e-05 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341164+0000", 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015931699999999999 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342869+0000", 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001705008 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343909+0000", 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001040469 2023-10-08T06:57:40.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343950+0000", 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0645000000000001e-05 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343975+0000", 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4819000000000001e-05 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.286 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333273+0000", 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.835579263, 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010036464, 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333273+0000", 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333273+0000", 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333273+0000", 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3599999999999999e-07 2023-10-08T06:57:40.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333277+0000", 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3620000000000002e-06 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333283+0000", 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8279999999999997e-06 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333289+0000", 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2490000000000001e-06 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.336951+0000", 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036621829999999998 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337042+0000", 2023-10-08T06:57:40.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1611000000000001e-05 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337162+0000", 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011935899999999999 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342233+0000", 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050716060000000002 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343214+0000", 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00098024900000000009 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343269+0000", 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4836999999999997e-05 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343309+0000", 2023-10-08T06:57:40.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0744000000000002e-05 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333386+0000", 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.835466455999999, 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010273635999999999, 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.293 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333386+0000", 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333386+0000", 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333387+0000", 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333390+0000", 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6669999999999998e-06 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333909+0000", 2023-10-08T06:57:40.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00051829600000000001 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333917+0000", 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7320000000000004e-06 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338212+0000", 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042944790000000004 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338351+0000", 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013899600000000001 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338483+0000", 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132755 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342632+0000", 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041486960000000003 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343564+0000", 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00093228500000000004 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343621+0000", 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:57:40.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343659+0000", 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8708000000000003e-05 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:40.299 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333980+0000", 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.834872423, 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0099550000000000003, 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333980+0000", 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333980+0000", 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333980+0000", 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.23e-07 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:40.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333984+0000", 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.031e-06 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333992+0000", 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.334000+0000", 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.157e-06 2023-10-08T06:57:40.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339891+0000", 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058907589999999998 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340039+0000", 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014839900000000001 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340506+0000", 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00046678300000000002 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342844+0000", 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002338368 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343872+0000", 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0010277579999999999 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343909+0000", 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6878999999999997e-05 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343935+0000", 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5803999999999999e-05 2023-10-08T06:57:40.305 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.306 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.306 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.306 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:40.306 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:40.306 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:40.308 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:40.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:40.306+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:40.309 INFO:teuthology.run_tasks:Running task admin_socket... 2023-10-08T06:57:40.347 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2023-10-08T06:57:40.347 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2023-10-08T06:57:40.360 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:hints = 1 2023-10-08T06:57:40.360 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2023-10-08T06:57:40.361 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object prefix: benchmark_data_smithi037_101035 2023-10-08T06:57:40.361 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-10-08T06:57:40.361 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 0 0 0 0 0 0 - 0 2023-10-08T06:57:40.366 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'main'} 2023-10-08T06:57:40.367 DEBUG:teuthology.orchestra.run.smithi037:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph-ci.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=main' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2023-10-08T06:57:40.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:40.407+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:40.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:40.508+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:40.530 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:583 5.a e22/20 5:5f757e49:::benchmark_data_smithi037_101035_object582:head v 22'35, mlcod=22'32)", 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.527430+0000", 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021103810000000001, 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021276419999999999, 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527430+0000", 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527430+0000", 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527431+0000", 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3300000000000002e-07 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527529+0000", 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8221999999999996e-05 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527535+0000", 2023-10-08T06:57:40.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5119999999999997e-06 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527541+0000", 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9070000000000004e-06 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527581+0000", 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9379999999999999e-05 2023-10-08T06:57:40.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527595+0000", 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4319e-05 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:574 5.4 5:26d09f79:::benchmark_data_smithi037_101035_object573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.535 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.523409+0000", 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0061313160000000004, 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061914500000000003, 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 574 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523409+0000", 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523409+0000", 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523410+0000", 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5799999999999999e-07 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523464+0000", 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4150000000000002e-05 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523477+0000", 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2551000000000001e-05 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523482+0000", 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7819999999999999e-06 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523519+0000", 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6767000000000002e-05 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523601+0000", 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1479999999999999e-05 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.523676+0000", 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5550999999999995e-05 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524164+0000", 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048807800000000003 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:575 5.e 5:7d68e24b:::benchmark_data_smithi037_101035_object574:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.541 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.524291+0000", 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0052494550000000001, 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053585799999999999, 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 575 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524291+0000", 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524291+0000", 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524292+0000", 2023-10-08T06:57:40.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2300000000000001e-07 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524361+0000", 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9041000000000005e-05 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524370+0000", 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9479999999999997e-06 2023-10-08T06:57:40.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524374+0000", 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6870000000000002e-06 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524406+0000", 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1284000000000001e-05 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524477+0000", 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1662999999999995e-05 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524551+0000", 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3774000000000002e-05 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.525353+0000", 2023-10-08T06:57:40.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080163900000000004 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:576 5.e 5:71273a30:::benchmark_data_smithi037_101035_object575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.524423+0000", 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0051175869999999998, 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005295747, 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.547 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 576 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524423+0000", 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524423+0000", 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524423+0000", 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1200000000000003e-07 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524504+0000", 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0867999999999999e-05 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524510+0000", 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1460000000000001e-06 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524514+0000", 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.765e-06 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524816+0000", 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030174299999999999 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524923+0000", 2023-10-08T06:57:40.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106569 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.525051+0000", 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012815799999999999 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527289+0000", 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022381940000000002 2023-10-08T06:57:40.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:580 5.b 5:d6530176:::benchmark_data_smithi037_101035_object579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.524547+0000", 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0049937510000000003, 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005274066, 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:40.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 580 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524547+0000", 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524547+0000", 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524547+0000", 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1199999999999998e-07 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524650+0000", 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102672 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524656+0000", 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3759999999999996e-06 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524660+0000", 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8929999999999998e-06 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524693+0000", 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2564000000000002e-05 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524771+0000", 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8123999999999999e-05 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.524894+0000", 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012290599999999999 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.525603+0000", 2023-10-08T06:57:40.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00070882300000000003 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.529752+0000", 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041494510000000002 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.529810+0000", 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7858000000000001e-05 2023-10-08T06:57:40.559 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:584 5.d 5:b462434b:::benchmark_data_smithi037_101035_object583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.526956+0000", 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0025841839999999998, 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029547039999999998, 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.560 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 584 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.526956+0000", 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.526956+0000", 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.526957+0000", 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3799999999999996e-07 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527077+0000", 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011963700000000001 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527091+0000", 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4319e-05 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527098+0000", 2023-10-08T06:57:40.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8279999999999997e-06 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527162+0000", 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3700000000000003e-05 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527278+0000", 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011607000000000001 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527372+0000", 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4367e-05 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.528281+0000", 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000908423 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:585 5.4 5:258ae9db:::benchmark_data_smithi037_101035_object584:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.527115+0000", 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002424987, 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028532660000000001, 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 585 2023-10-08T06:57:40.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527115+0000", 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527115+0000", 2023-10-08T06:57:40.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527116+0000", 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7700000000000004e-07 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527158+0000", 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1514000000000003e-05 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527165+0000", 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5440000000000001e-06 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527179+0000", 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4103e-05 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527224+0000", 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4366000000000002e-05 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527326+0000", 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102481 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527454+0000", 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012827300000000001 2023-10-08T06:57:40.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:586 5.4 5:271c2cb2:::benchmark_data_smithi037_101035_object585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.527196+0000", 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0023441590000000002, 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002849234, 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:40.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 586 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527196+0000", 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527196+0000", 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527197+0000", 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7000000000000005e-07 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527231+0000", 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3955000000000003e-05 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527238+0000", 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.255e-06 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527245+0000", 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4350000000000002e-06 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527764+0000", 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000519631 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527831+0000", 2023-10-08T06:57:40.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6626999999999998e-05 2023-10-08T06:57:40.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527909+0000", 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8431999999999997e-05 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.530058+0000", 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021491449999999999 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:588 5.0 5:0d3cc30b:::benchmark_data_smithi037_101035_object587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.527402+0000", 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021389249999999999, 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027946820000000002, 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:40.579 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 588 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527402+0000", 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527402+0000", 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527402+0000", 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2200000000000003e-07 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527506+0000", 2023-10-08T06:57:40.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103835 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527515+0000", 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8189999999999998e-06 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527522+0000", 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0310000000000001e-06 2023-10-08T06:57:40.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527570+0000", 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7886999999999997e-05 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527684+0000", 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114423 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.527828+0000", 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014382300000000001 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.530036+0000", 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022074519999999999 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:57:40.584 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 9 2023-10-08T06:57:40.585 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:40.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:40.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2023-10-08T06:57:40.629 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:40.628+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:40.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:40.710+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:40.744 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:57:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:57:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:57:40.745 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:40.745 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T06:57:40.745 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [ 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1406, 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.f3ae11df", 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1405", 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1405", 2023-10-08T06:57:40.746 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.871268s", 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0039999479999999997, 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.741456+0000", 2023-10-08T06:57:40.747 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1410, 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.63fc1832", 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:40.748 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1409", 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1409", 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.872268s", 2023-10-08T06:57:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0029999610000000002, 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.742498+0000", 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1417, 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.9bc3dc97", 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1416", 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1416", 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.751 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.874268s", 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.00099998699999999992, 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.745010+0000", 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.752 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1419, 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.42ba3e72", 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1418", 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1418", 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.753 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.874268s", 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.00099998699999999992, 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.745225+0000", 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.754 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1403, 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.c7087c3d", 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1402", 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1402", 2023-10-08T06:57:40.755 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.870268s", 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0049999349999999996, 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.756 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.757 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.741268+0000", 2023-10-08T06:57:40.757 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1405, 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.59f46b08", 2023-10-08T06:57:40.758 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1404", 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1404", 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.871268s", 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0039999479999999997, 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.759 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.741356+0000", 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1408, 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.8e29d78b", 2023-10-08T06:57:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.761 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1407", 2023-10-08T06:57:40.761 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.761 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1407", 2023-10-08T06:57:40.761 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.761 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.761 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.872268s", 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0029999610000000002, 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.742400+0000", 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.762 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1409, 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.5a1e057d", 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1408", 2023-10-08T06:57:40.763 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1408", 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.872268s", 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0029999610000000002, 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.764 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.742409+0000", 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1412, 2023-10-08T06:57:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.c6027150", 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1411", 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1411", 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.872268s", 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0029999610000000002, 2023-10-08T06:57:40.766 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.742668+0000", 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1413, 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.9979896d", 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1412", 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1412", 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.768 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.769 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.769 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.872268s", 2023-10-08T06:57:40.769 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0029999610000000002, 2023-10-08T06:57:40.769 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.769 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.769 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.769 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.742674+0000", 2023-10-08T06:57:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1414, 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.c3de7ec8", 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1413", 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1413", 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.771 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.874268s", 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.00099998699999999992, 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.744930+0000", 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1415, 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.ab7ddedb", 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1414", 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1414", 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.773 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.874268s", 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.00099998699999999992, 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.774 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.744996+0000", 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1407, 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.ad76ea3a", 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1406", 2023-10-08T06:57:40.776 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.776 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1406", 2023-10-08T06:57:40.776 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.776 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.776 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.776 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.776 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.871268s", 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0039999479999999997, 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.741512+0000", 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.777 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1411, 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.1946dc8c", 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1410", 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1410", 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.778 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.872268s", 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0029999610000000002, 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.742641+0000", 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.779 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1416, 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.2a4df9f3", 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1415", 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1415", 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.780 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.874268s", 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.00099998699999999992, 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.745005+0000", 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tid": 1418, 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "pg": "5.f598c353", 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "object_id": "benchmark_data_smithi037_101035_object1417", 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "object_locator": "@5", 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_id": "benchmark_data_smithi037_101035_object1417", 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "target_object_locator": "@5", 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "paused": 0, 2023-10-08T06:57:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: "used_replica": 0, 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "precalc_pgid": 0, 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "last_sent": "914.874268s", 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.00099998699999999992, 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "attempts": 1, 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "snapid": "head", 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_context": "0=[]", 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "mtime": "2023-10-08T06:57:40.745128+0000", 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ops": [ 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: "write 0~65536 in=65536b" 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:40.784 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:40.784 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ops": [], 2023-10-08T06:57:40.784 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ops": [], 2023-10-08T06:57:40.784 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_stat_ops": [], 2023-10-08T06:57:40.784 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_ops": [], 2023-10-08T06:57:40.784 INFO:teuthology.orchestra.run.smithi037.stdout: "command_ops": [] 2023-10-08T06:57:40.784 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T06:57:40.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:40.786 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 1406, "pg": "5.f3ae11df", "osd": 0, "object_id": "benchmark_data_smithi037_101035_object1405", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1405", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.871268s", "age": 0.0039999479999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.741456+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1410, "pg": "5.63fc1832", "osd": 0, "object_id": "benchmark_data_smithi037_101035_object1409", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1409", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.872268s", "age": 0.0029999610000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.742498+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1417, "pg": "5.9bc3dc97", "osd": 0, "object_id": "benchmark_data_smithi037_101035_object1416", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1416", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.874268s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.745010+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1419, "pg": "5.42ba3e72", "osd": 0, "object_id": "benchmark_data_smithi037_101035_object1418", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1418", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.874268s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.745225+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1403, "pg": "5.c7087c3d", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1402", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1402", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.870268s", "age": 0.0049999349999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.741268+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1405, "pg": "5.59f46b08", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1404", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1404", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.871268s", "age": 0.0039999479999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.741356+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1408, "pg": "5.8e29d78b", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1407", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1407", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.872268s", "age": 0.0029999610000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.742400+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1409, "pg": "5.5a1e057d", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1408", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1408", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.872268s", "age": 0.0029999610000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.742409+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1412, "pg": "5.c6027150", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1411", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1411", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.872268s", "age": 0.0029999610000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.742668+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1413, "pg": "5.9979896d", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1412", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1412", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.872268s", "age": 0.0029999610000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.742674+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1414, "pg": "5.c3de7ec8", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1413", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1413", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.874268s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.744930+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1415, "pg": "5.ab7ddedb", "osd": 1, "object_id": "benchmark_data_smithi037_101035_object1414", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1414", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.874268s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.744996+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1407, "pg": "5.ad76ea3a", "osd": 2, "object_id": "benchmark_data_smithi037_101035_object1406", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1406", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.871268s", "age": 0.0039999479999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.741512+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1411, "pg": "5.1946dc8c", "osd": 2, "object_id": "benchmark_data_smithi037_101035_object1410", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1410", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.872268s", "age": 0.0029999610000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.742641+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1416, "pg": "5.2a4df9f3", "osd": 2, "object_id": "benchmark_data_smithi037_101035_object1415", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1415", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.874268s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.745005+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1418, "pg": "5.f598c353", "osd": 2, "object_id": "benchmark_data_smithi037_101035_object1417", "object_locator": "@5", "target_object_id": "benchmark_data_smithi037_101035_object1417", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "914.874268s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-10-08T06:57:40.745128+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2023-10-08T06:57:40.787 DEBUG:teuthology.orchestra.run.smithi037:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2023-10-08T06:57:40.812 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:40.812+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:40.829 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2023-10-08T06:57:40.887 DEBUG:teuthology.parallel:result is None 2023-10-08T06:57:40.887 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2023-10-08T06:57:40.899 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2023-10-08T06:57:40.899 INFO:teuthology.orchestra.run:waiting for 2100 2023-10-08T06:57:40.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:40.913+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:41.015 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:41.014+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:41.017 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:41.017 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:57:41.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:57:41.017 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4156.0:204 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'150, mlcod=11'145)", 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:07.130569+0000", 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.882932117000003, 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0076203770000000002, 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.130569+0000", 2023-10-08T06:57:41.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.130569+0000", 2023-10-08T06:57:41.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.130569+0000", 2023-10-08T06:57:41.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.72e-07 2023-10-08T06:57:41.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.130572+0000", 2023-10-08T06:57:41.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8459999999999999e-06 2023-10-08T06:57:41.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.130580+0000", 2023-10-08T06:57:41.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6210000000000004e-06 2023-10-08T06:57:41.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.130583+0000", 2023-10-08T06:57:41.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5279999999999999e-06 2023-10-08T06:57:41.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.133021+0000", 2023-10-08T06:57:41.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024381149999999998 2023-10-08T06:57:41.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.133036+0000", 2023-10-08T06:57:41.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4688000000000001e-05 2023-10-08T06:57:41.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.138157+0000", 2023-10-08T06:57:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005120683 2023-10-08T06:57:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:07.138189+0000", 2023-10-08T06:57:41.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2524000000000002e-05 2023-10-08T06:57:41.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.026 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:41.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.685130785999998, 2023-10-08T06:57:41.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013838266, 2023-10-08T06:57:41.028 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.028 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:41.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328375+0000", 2023-10-08T06:57:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.843e-06 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328384+0000", 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5669999999999995e-06 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328397+0000", 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2925000000000001e-05 2023-10-08T06:57:41.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328411+0000", 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.454e-05 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001114128 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329709+0000", 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018355199999999999 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329888+0000", 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179576 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332277+0000", 2023-10-08T06:57:41.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023889419999999998 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342081+0000", 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098036779999999997 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342151+0000", 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0166999999999994e-05 2023-10-08T06:57:41.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342208+0000", 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7348e-05 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.684463036, 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013649668, 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329039+0000", 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3030000000000001e-06 2023-10-08T06:57:41.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329046+0000", 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4690000000000002e-06 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329058+0000", 2023-10-08T06:57:41.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2319e-05 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329068+0000", 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0036e-05 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329696+0000", 2023-10-08T06:57:41.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062830000000000004 2023-10-08T06:57:41.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329836+0000", 2023-10-08T06:57:41.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000139388 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329998+0000", 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016215399999999999 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333392+0000", 2023-10-08T06:57:41.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033940540000000001 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342572+0000", 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091795669999999996 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342641+0000", 2023-10-08T06:57:41.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9270000000000006e-05 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342688+0000", 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6808000000000003e-05 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.042 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.684144494999998, 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012619155, 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329357+0000", 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2399999999999998e-07 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329361+0000", 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2590000000000002e-06 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329370+0000", 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9719999999999998e-06 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329377+0000", 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3790000000000003e-06 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329789+0000", 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041219999999999999 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329987+0000", 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019829299999999999 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.330264+0000", 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027674399999999999 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333231+0000", 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029667819999999998 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341872+0000", 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086410529999999992 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341935+0000", 2023-10-08T06:57:41.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2928999999999993e-05 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341976+0000", 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0920000000000001e-05 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.050 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.050 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:41.050 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.683977123999998, 2023-10-08T06:57:41.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013179840999999999, 2023-10-08T06:57:41.050 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.050 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:41.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2079999999999999e-06 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329532+0000", 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6359999999999997e-06 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329542+0000", 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0526000000000001e-05 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329552+0000", 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7240000000000004e-06 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.330785+0000", 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012331690000000001 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331292+0000", 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00050700099999999998 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331437+0000", 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144893 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333557+0000", 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021202690000000001 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342585+0000", 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090282239999999996 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342659+0000", 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3082000000000003e-05 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342704+0000", 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5108999999999998e-05 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.683931384000001, 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013211446, 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:41.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3600000000000004e-07 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329575+0000", 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7639999999999996e-06 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329583+0000", 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9859999999999994e-06 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329591+0000", 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331450+0000", 2023-10-08T06:57:41.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001859716 2023-10-08T06:57:41.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331623+0000", 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017258400000000001 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332251+0000", 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062847900000000004 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333691+0000", 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439959 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342718+0000", 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090267509999999995 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342751+0000", 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3259999999999997e-05 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342781+0000", 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9771999999999999e-05 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.065 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.683893736000002, 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012542774, 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329608+0000", 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6899999999999997e-07 2023-10-08T06:57:41.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329612+0000", 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2050000000000004e-06 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329620+0000", 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5320000000000001e-06 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329638+0000", 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8070000000000001e-05 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331274+0000", 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016366970000000001 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331385+0000", 2023-10-08T06:57:41.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110227 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331541+0000", 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015609099999999999 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333590+0000", 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020487790000000001 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342030+0000", 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084407719999999992 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342089+0000", 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8576999999999998e-05 2023-10-08T06:57:41.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342150+0000", 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1155000000000007e-05 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.683847226000001, 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013190815, 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329655+0000", 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1689999999999999e-06 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329660+0000", 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3909999999999997e-06 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329669+0000", 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7399999999999993e-06 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329680+0000", 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.132e-05 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332399+0000", 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027186649999999999 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332522+0000", 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000123156 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332791+0000", 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026831700000000001 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.334099+0000", 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013086700000000001 2023-10-08T06:57:41.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342753+0000", 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086533489999999994 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342812+0000", 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9348999999999997e-05 2023-10-08T06:57:41.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342845+0000", 2023-10-08T06:57:41.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2688999999999998e-05 2023-10-08T06:57:41.079 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.079 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.079 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.68380883, 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012210571999999999, 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.080 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329693+0000", 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9800000000000004e-07 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329695+0000", 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6699999999999998e-06 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329702+0000", 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329707+0000", 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7810000000000002e-06 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329821+0000", 2023-10-08T06:57:41.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113608 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329947+0000", 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012642 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341903+0000", 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011955245 2023-10-08T06:57:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329728+0000", 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.683773458000001, 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.007927669, 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329728+0000", 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329728+0000", 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329728+0000", 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5000000000000002e-07 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329735+0000", 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3849999999999999e-06 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329745+0000", 2023-10-08T06:57:41.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0582e-05 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329752+0000", 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.63e-06 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329857+0000", 2023-10-08T06:57:41.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105101 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329969+0000", 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112416 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.337655+0000", 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0076858050000000004 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:3 5.8 5:1f5dd8ae:::benchmark_data_smithi037_101035_object2:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.362616+0000", 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.65088513599999998, 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077125730000000003, 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.090 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.362616+0000", 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.362616+0000", 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.362617+0000", 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.542e-06 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.363012+0000", 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039434700000000002 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.363027+0000", 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5333e-05 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.363037+0000", 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0436e-05 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.363126+0000", 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8986999999999994e-05 2023-10-08T06:57:41.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.363288+0000", 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016141199999999999 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.363477+0000", 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000189373 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.365984+0000", 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025069189999999998 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.370241+0000", 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004256882 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.370290+0000", 2023-10-08T06:57:41.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8829999999999998e-05 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.370328+0000", 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8512e-05 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.096 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:184 5.4 5:21aae24b:::benchmark_data_smithi037_101035_object183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.418867+0000", 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.59463406200000002, 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079595059999999999, 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 184 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.418867+0000", 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.418867+0000", 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.418868+0000", 2023-10-08T06:57:41.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.418911+0000", 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3630000000000001e-05 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.418920+0000", 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3489999999999992e-06 2023-10-08T06:57:41.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.418944+0000", 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4032999999999998e-05 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.420200+0000", 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001256613 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.420327+0000", 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012684799999999999 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.420423+0000", 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6026999999999994e-05 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.421454+0000", 2023-10-08T06:57:41.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010303280000000001 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.426762+0000", 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053082770000000001 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.426796+0000", 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4536000000000003e-05 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.426826+0000", 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0065000000000001e-05 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:633 5.0 5:09cda323:::benchmark_data_smithi037_101035_object632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.541876+0000", 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.47162525399999999, 2023-10-08T06:57:41.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077553759999999996, 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 633 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.541876+0000", 2023-10-08T06:57:41.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.541876+0000", 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.541876+0000", 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.27e-07 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.541902+0000", 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6084999999999998e-05 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.541907+0000", 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6349999999999997e-06 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.541910+0000", 2023-10-08T06:57:41.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.54e-06 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.543254+0000", 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001343835 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.543375+0000", 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120708 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.543508+0000", 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013325000000000001 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.548343+0000", 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048343120000000003 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.549569+0000", 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001226485 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.549610+0000", 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0629e-05 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.549631+0000", 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1469999999999999e-05 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:685 5.0 5:05b175c5:::benchmark_data_smithi037_101035_object684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.110 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.555533+0000", 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.45796760399999997, 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080133719999999995, 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 685 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555533+0000", 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555533+0000", 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555534+0000", 2023-10-08T06:57:41.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5900000000000003e-07 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555640+0000", 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010634800000000001 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555647+0000", 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2180000000000002e-06 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555651+0000", 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9500000000000003e-06 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555680+0000", 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8892999999999999e-05 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555766+0000", 2023-10-08T06:57:41.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5384999999999996e-05 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555848+0000", 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2045000000000005e-05 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.559979+0000", 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041309449999999996 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.563454+0000", 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034759080000000002 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.563512+0000", 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7166000000000001e-05 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.563547+0000", 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5154999999999998e-05 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:686 5.b 5:d3f9e15f:::benchmark_data_smithi037_101035_object685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.555658+0000", 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.45784259300000002, 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0083660539999999995, 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.117 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 686 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555658+0000", 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555658+0000", 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555659+0000", 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5699999999999998e-07 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555770+0000", 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111265 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555775+0000", 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.293e-06 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555779+0000", 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3780000000000001e-06 2023-10-08T06:57:41.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555802+0000", 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3512000000000001e-05 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555867+0000", 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4609000000000004e-05 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.555942+0000", 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4750000000000001e-05 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.559886+0000", 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039447370000000002 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.563968+0000", 2023-10-08T06:57:41.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040814709999999997 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.564002+0000", 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4421000000000001e-05 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.564024+0000", 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2260999999999999e-05 2023-10-08T06:57:41.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:1118 5.0 5:0213ae7a:::benchmark_data_smithi037_101035_object1117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.669353+0000", 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.34414818899999999, 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078690089999999997, 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1118 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669353+0000", 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669353+0000", 2023-10-08T06:57:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669354+0000", 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669471+0000", 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117674 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669481+0000", 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4490000000000005e-06 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669488+0000", 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.866e-06 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669635+0000", 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014767 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669742+0000", 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106637 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669868+0000", 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126246 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.671443+0000", 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015752819999999999 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677127+0000", 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056835770000000004 2023-10-08T06:57:41.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677184+0000", 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7265000000000001e-05 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677222+0000", 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7543000000000003e-05 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:1122 5.b 5:dd91080b:::benchmark_data_smithi037_101035_object1121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.669506+0000", 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.34399463899999999, 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078293870000000002, 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1122 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669506+0000", 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669506+0000", 2023-10-08T06:57:41.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669507+0000", 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4900000000000005e-07 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669567+0000", 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9599000000000003e-05 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669574+0000", 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3379999999999999e-06 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669581+0000", 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4230000000000002e-06 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669632+0000", 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1814999999999998e-05 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669747+0000", 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114345 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669854+0000", 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010686100000000001 2023-10-08T06:57:41.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.671023+0000", 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011695519999999999 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677243+0000", 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006219497 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677299+0000", 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6789000000000001e-05 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677336+0000", 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6319000000000002e-05 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:1123 5.e 5:77089f38:::benchmark_data_smithi037_101035_object1122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.669598+0000", 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.34390291299999998, 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077445789999999997, 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1123 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669598+0000", 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669598+0000", 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669599+0000", 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0900000000000001e-07 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669685+0000", 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6252e-05 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669694+0000", 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2720000000000003e-06 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669703+0000", 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3140000000000004e-06 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669750+0000", 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7670999999999998e-05 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669880+0000", 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012947100000000001 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670005+0000", 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125773 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.671480+0000", 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014741800000000001 2023-10-08T06:57:41.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677266+0000", 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057861969999999999 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677310+0000", 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4054999999999997e-05 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677343+0000", 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2784999999999999e-05 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:1127 5.4 5:27be42c5:::benchmark_data_smithi037_101035_object1126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.669792+0000", 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.34370939099999998, 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0076130879999999996, 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.144 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1127 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669792+0000", 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669792+0000", 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669792+0000", 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0900000000000001e-07 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669926+0000", 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013364799999999999 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669935+0000", 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6459999999999999e-06 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669942+0000", 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9840000000000004e-06 2023-10-08T06:57:41.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669991+0000", 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9543999999999999e-05 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670130+0000", 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013920999999999999 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670281+0000", 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015025800000000001 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.671516+0000", 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012352019999999999 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677319+0000", 2023-10-08T06:57:41.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058032300000000004 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677372+0000", 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2509000000000002e-05 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677405+0000", 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3148000000000002e-05 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.150 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:1130 5.e 5:7c7b491b:::benchmark_data_smithi037_101035_object1129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:40.669958+0000", 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.34354251800000002, 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0075213679999999996, 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1130 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669958+0000", 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669958+0000", 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:41.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.669959+0000", 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2300000000000001e-07 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670036+0000", 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7365000000000002e-05 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:41.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670044+0000", 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0479999999999999e-06 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670051+0000", 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2729999999999999e-06 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670424+0000", 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037293899999999997 2023-10-08T06:57:41.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670510+0000", 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6259000000000002e-05 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.670590+0000", 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0111000000000006e-05 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.671497+0000", 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00090675399999999996 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677389+0000", 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058924600000000004 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677444+0000", 2023-10-08T06:57:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5143999999999999e-05 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:40.677480+0000", 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5392000000000003e-05 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:41.157 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:41.159 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:41.159 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:41.158+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:41.163 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:57:41.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:57:41.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:41.258+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:41.356 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:41.356 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:41.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.356 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:4402 5.5 5:aa2adbe6:::benchmark_data_smithi037_101035_object4401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:41.356 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.351852+0000", 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.002774543, 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028115979999999998, 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 4402 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.351852+0000", 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.351852+0000", 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.351853+0000", 2023-10-08T06:57:41.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4e-07 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.351984+0000", 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013113600000000001 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.351999+0000", 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4946000000000001e-05 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352012+0000", 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3097e-05 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352071+0000", 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8938999999999999e-05 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352238+0000", 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016747600000000001 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352469+0000", 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00023084599999999999 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354135+0000", 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016659750000000001 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:4400 5.0 e23/20 5:043eb361:::benchmark_data_smithi037_101035_object4399:head v 23'291, mlcod=23'288)", 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.352102+0000", 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.002524536, 2023-10-08T06:57:41.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002659865, 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352102+0000", 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352102+0000", 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352102+0000", 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352167+0000", 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4333999999999998e-05 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352178+0000", 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1104000000000001e-05 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352182+0000", 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.386e-06 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352218+0000", 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5478999999999997e-05 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352230+0000", 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2736e-05 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:4401 5.e e23/20 5:77268489:::benchmark_data_smithi037_101035_object4400:head v 23'277, mlcod=23'275)", 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.352370+0000", 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0022564460000000001, 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024600820000000002, 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352370+0000", 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352370+0000", 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352370+0000", 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9499999999999998e-07 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352404+0000", 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3204999999999998e-05 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352411+0000", 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1119999999999998e-06 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352421+0000", 2023-10-08T06:57:41.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.91e-06 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352464+0000", 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3797000000000001e-05 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.352482+0000", 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.749e-05 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.370 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:4404 5.e e23/20 5:712897c9:::benchmark_data_smithi037_101035_object4403:head v 23'278, mlcod=23'275)", 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.353134+0000", 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.001492726, 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0017710549999999999, 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353134+0000", 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353134+0000", 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353134+0000", 2023-10-08T06:57:41.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3399999999999999e-07 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353207+0000", 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2497999999999996e-05 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353215+0000", 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9510000000000006e-06 2023-10-08T06:57:41.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353219+0000", 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6319999999999999e-06 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353257+0000", 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7221999999999997e-05 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.353269+0000", 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2515e-05 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:4405 5.5 5:a79b71e5:::benchmark_data_smithi037_101035_object4404:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:41.375 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.354126+0000", 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00050058000000000004, 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00088697799999999996, 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 4405 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.376 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354126+0000", 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354126+0000", 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354127+0000", 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5300000000000003e-07 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354177+0000", 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0621000000000002e-05 2023-10-08T06:57:41.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354184+0000", 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5200000000000003e-06 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354189+0000", 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9459999999999997e-06 2023-10-08T06:57:41.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354261+0000", 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2114999999999996e-05 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354392+0000", 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000131421 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354551+0000", 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015866599999999999 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:4406 5.c 5:3ecd08b3:::benchmark_data_smithi037_101035_object4405:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:41.381 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.354207+0000", 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00041901299999999998, 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00090167999999999997, 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 4406 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354207+0000", 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354207+0000", 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354208+0000", 2023-10-08T06:57:41.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6400000000000003e-07 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354266+0000", 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8168000000000003e-05 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354273+0000", 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.46e-06 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354276+0000", 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8070000000000001e-06 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354309+0000", 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2308999999999998e-05 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354407+0000", 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7887000000000007e-05 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354544+0000", 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013727300000000001 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:4408 5.6 5:63f1b471:::benchmark_data_smithi037_101035_object4407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:41.386 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.354338+0000", 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00028803299999999998, 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00085913099999999996, 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 4408 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354338+0000", 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354338+0000", 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354339+0000", 2023-10-08T06:57:41.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4700000000000001e-07 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354446+0000", 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106358 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354454+0000", 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2330000000000006e-06 2023-10-08T06:57:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354471+0000", 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6750999999999999e-05 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354515+0000", 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4029999999999997e-05 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354630+0000", 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115247 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354751+0000", 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000121175 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:4409 5.5 5:ab2d5303:::benchmark_data_smithi037_101035_object4408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.354482+0000", 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00014414699999999999, 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082172199999999999, 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.392 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 4409 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354482+0000", 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354482+0000", 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354483+0000", 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.54e-07 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354543+0000", 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9657999999999997e-05 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354550+0000", 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7479999999999993e-06 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354557+0000", 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1970000000000001e-06 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355036+0000", 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00047926799999999998 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355142+0000", 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010634200000000001 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355312+0000", 2023-10-08T06:57:41.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017006500000000001 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:4407 5.0 e23/20 5:03363b03:::benchmark_data_smithi037_101035_object4406:head v 23'292, mlcod=23'288)", 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.354707+0000", 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9999199, 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00069083000000000002, 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354707+0000", 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354707+0000", 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354707+0000", 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.32e-07 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354804+0000", 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6384000000000004e-05 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354816+0000", 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2858e-05 2023-10-08T06:57:41.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354834+0000", 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7578999999999999e-05 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354889+0000", 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4934e-05 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354909+0000", 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9871e-05 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:4412 5.a 5:5b42cd95:::benchmark_data_smithi037_101035_object4411:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.354653+0000", 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9999733, 2023-10-08T06:57:41.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082230900000000002, 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 4412 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354653+0000", 2023-10-08T06:57:41.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354653+0000", 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354654+0000", 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2900000000000002e-07 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354866+0000", 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00021205900000000001 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354882+0000", 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5410999999999999e-05 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354888+0000", 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2339999999999999e-06 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.354930+0000", 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2083999999999999e-05 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355041+0000", 2023-10-08T06:57:41.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000111458 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355162+0000", 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012015000000000001 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.406 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:4411 5.b e23/20 5:d0db213b:::benchmark_data_smithi037_101035_object4410:head v 23'282, mlcod=23'280)", 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.355121+0000", 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.999506, 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00040423899999999998, 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355121+0000", 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355121+0000", 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355121+0000", 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7300000000000002e-07 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355227+0000", 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010641600000000001 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355236+0000", 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6279999999999994e-06 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355242+0000", 2023-10-08T06:57:41.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.37e-06 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355284+0000", 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1900999999999997e-05 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355302+0000", 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7677999999999999e-05 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.410 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:4416 5.3 5:ca411442:::benchmark_data_smithi037_101035_object4415:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.355102+0000", 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9995246, 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046336800000000003, 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:41.411 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 4416 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355102+0000", 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355102+0000", 2023-10-08T06:57:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355103+0000", 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6499999999999998e-07 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355284+0000", 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018145499999999999 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355292+0000", 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8229999999999995e-06 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355298+0000", 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3559999999999998e-06 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355409+0000", 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011058 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355535+0000", 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012646399999999999 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:4414 5.1 e23/20 5:84d8659e:::benchmark_data_smithi037_101035_object4413:head v 23'264, mlcod=23'262)", 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:41.355315+0000", 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9993119, 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00030212400000000002, 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355315+0000", 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355315+0000", 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355315+0000", 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.99e-07 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355400+0000", 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4608e-05 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355409+0000", 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8489999999999995e-06 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:41.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355425+0000", 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6262000000000001e-05 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355494+0000", 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8639000000000005e-05 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:41.355532+0000", 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8656999999999999e-05 2023-10-08T06:57:41.419 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.420 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:41.420 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.420 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:41.420 INFO:teuthology.orchestra.run.smithi183.stdout: ], 2023-10-08T06:57:41.420 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 13 2023-10-08T06:57:41.420 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:41.421 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 1 16 4453 4437 277.298 277.312 0.00223152 0.00359883 2023-10-08T06:57:41.422 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:41.422 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:41.422 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:41.423 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:41.420+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:41.435 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:57:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:57:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:57:41.522 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:41.522+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:41.612 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:41.612 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:41.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:41.621+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:41.628 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:41.723 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:41.722+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:41.824 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:41.823+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:41.847 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:41.848 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:41.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:41.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:41.926+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:42.028 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:42.028+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:42.033 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:42.033 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:42.047 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:42.128 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:42.128+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:42.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:42.228+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:42.257 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:42.257 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:42.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:42.330 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:42.330+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:42.361 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 2 16 8564 8548 267.106 256.938 0.00342577 0.0037377 2023-10-08T06:57:42.431 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:42.431+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:42.481 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:42.481 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:42.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:42.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:42.531+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:42.632 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:42.632+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:42.658 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:42.658 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:42.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:42.733 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:42.733+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:42.834 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:42.834+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:42.839 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:42.839 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:42.853 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:42.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:42.935+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:43.013 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T06:57:43.013 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T06:57:43.013 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-10-08T06:57:43.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-10-08T06:57:43.036 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:43.036 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:43.037 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:43.035+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:43.050 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:43.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:43.136+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:43.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:57:43.226 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:43.227 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:43.238 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:43.237+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:43.242 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:43.338 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:43.338+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:43.361 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 3 16 11991 11975 249.461 214.188 0.00526691 0.00400416 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 23, 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "a28386aa-6313-4530-b2e8-fd7736a43dc5", 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: "created": "2023-10-08T06:56:54.481679+0000", 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2023-10-08T06:57:41.151822+0000", 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: "last_up_change": "2023-10-08T06:57:03.011095+0000", 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: "last_in_change": "2023-10-08T06:56:55.385351+0000", 2023-10-08T06:57:43.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_num": 5806080, 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_set": [ 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "nodeep-scrub", 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "noscrub", 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "pglog_hardlimit", 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "purged_snapdirs", 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_deletes", 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "sortbitwise" 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:43.373 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_version": 4, 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "full_ratio": 0.94999998807907104, 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_snapshot": "", 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_max": 5, 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd": 3, 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "require_min_compat_client": "luminous", 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min_compat_client": "jewel", 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "require_osd_release": "reef", 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_crimson": false, 2023-10-08T06:57:43.374 INFO:teuthology.orchestra.run.smithi037.stdout: "pools": [ 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 1, 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": ".mgr", 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:04.997403+0000", 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:43.375 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 1, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 1, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 1, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 1, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 1, 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:43.376 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "12", 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:43.377 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:43.378 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:43.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:43.380 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_max": 32, 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 1 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": {} 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 2.9900000095367432, 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 2.9900000095367432, 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 2, 2023-10-08T06:57:43.381 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 2, 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 2, 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "rbd", 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:09.831792+0000", 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:43.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:43.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 8, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 8, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 8, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 8, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 8, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:43.384 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "15", 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:43.386 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:43.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "options": {}, 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:43.388 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd": {} 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.5, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.5, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.5, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.5, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:43.389 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 3, 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_metadata", 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:14.549981+0000", 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 32, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 32, 2023-10-08T06:57:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 32, 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 32, 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 32, 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "18", 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_bias": 4, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 16, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_priority": 5 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": "cephfs" 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 4, 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_data", 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:15.701169+0000", 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 64, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 64, 2023-10-08T06:57:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 64, 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 64, 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 64, 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "19", 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:43.400 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:43.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 64, 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "data": "cephfs" 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.404 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.405 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 5, 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "unique_pool_0", 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:37.183131+0000", 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:43.406 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 16, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 16, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 16, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 16, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 16, 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:43.407 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "22", 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:43.408 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:43.409 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "options": {}, 2023-10-08T06:57:43.411 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rados": {} 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.412 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "osds": [ 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06", 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:43.413 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 20, 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6800", 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6801", 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.415 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6802", 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6803", 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6806", 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6807", 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6804", 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6805", 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.163:6801/2190327034", 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.163:6803/2190327034", 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.163:6807/2190327034", 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.163:6805/2190327034", 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "da732e65-55c2-489e-bec4-ce4124704896", 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 20, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6800", 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6801", 2023-10-08T06:57:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6802", 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6803", 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6806", 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6807", 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6804", 2023-10-08T06:57:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6805", 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.169:6801/3772527464", 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.169:6803/3772527464", 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.169:6807/3772527464", 2023-10-08T06:57:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.169:6805/3772527464", 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1", 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 20, 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6800", 2023-10-08T06:57:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6801", 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6802", 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6803", 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6806", 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6807", 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6804", 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6805", 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.183:6801/1488347209", 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.183:6803/1488347209", 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.183:6807/1488347209", 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.183:6805/1488347209", 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_xinfo": [ 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.463792+0000", 2023-10-08T06:57:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.488920+0000", 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.516673+0000", 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap": [], 2023-10-08T06:57:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_items": [], 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_primaries": [], 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_temp": [], 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_temp": [], 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklist": {}, 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "range_blocklist": {}, 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profiles": { 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default": { 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-failure-domain": "osd", 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "k": "2", 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "m": "1", 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin": "jerasure", 2023-10-08T06:57:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "technique": "reed_sol_van" 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps_queue": [], 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "new_removed_snaps": [], 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "new_purged_snaps": [], 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_node_flags": {}, 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "device_class_flags": {}, 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode": { 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_enabled": false, 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_bucket_count": 0, 2023-10-08T06:57:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "degraded_stretch_mode": 0, 2023-10-08T06:57:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "recovering_stretch_mode": 0, 2023-10-08T06:57:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_bucket": 0 2023-10-08T06:57:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:43.438 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T06:57:43.440 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:43.440 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:43.440 INFO:tasks.thrashosds.thrasher:j is {'epoch': 23, 'fsid': 'a28386aa-6313-4530-b2e8-fd7736a43dc5', 'created': '2023-10-08T06:56:54.481679+0000', 'modified': '2023-10-08T06:57:41.151822+0000', 'last_up_change': '2023-10-08T06:57:03.011095+0000', 'last_in_change': '2023-10-08T06:56:55.385351+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:57:14.549981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:57:15.701169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-10-08T06:57:37.183131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 2190327034}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 2190327034}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 2190327034}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 2190327034}]}, 'public_addr': '172.21.15.163:6801/2190327034', 'cluster_addr': '172.21.15.163:6803/2190327034', 'heartbeat_back_addr': '172.21.15.163:6807/2190327034', 'heartbeat_front_addr': '172.21.15.163:6805/2190327034', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'da732e65-55c2-489e-bec4-ce4124704896', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 3772527464}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 3772527464}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 3772527464}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 3772527464}]}, 'public_addr': '172.21.15.169:6801/3772527464', 'cluster_addr': '172.21.15.169:6803/3772527464', 'heartbeat_back_addr': '172.21.15.169:6807/3772527464', 'heartbeat_front_addr': '172.21.15.169:6805/3772527464', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6800', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6801', 'nonce': 1488347209}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6802', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6803', 'nonce': 1488347209}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6806', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6807', 'nonce': 1488347209}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6804', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6805', 'nonce': 1488347209}]}, 'public_addr': '172.21.15.183:6801/1488347209', 'cluster_addr': '172.21.15.183:6803/1488347209', 'heartbeat_back_addr': '172.21.15.183:6807/1488347209', 'heartbeat_front_addr': '172.21.15.183:6805/1488347209', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.463792+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.488920+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.516673+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-10-08T06:57:43.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:43.441 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:43.442 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:43.439+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:43.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:57:43.539 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:43.539+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:43.640 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:43.639+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:43.651 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:43.654 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:43.654 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:43.668 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:43.673 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:43.695 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:57:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:57:43.697 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:57:43.742 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:43.741+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:43.822 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-10-08T06:57:42.947492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81752,"kb_used_data":692,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033768,"statfs":{"total":289910292480,"available":289826578432,"internally_reserved":0,"allocated":708608,"data_stored":1373455,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.802833"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200977+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:19.200977+0000","last_peered":"2023-10-08T06:57:19.200977+0000","last_clean":"2023-10-08T06:57:19.200977+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:19.200977+0000","last_undegraded":"2023-10-08T06:57:19.200977+0000","last_fullsized":"2023-10-08T06:57:19.200977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200677+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:19.200677+0000","last_peered":"2023-10-08T06:57:19.200677+0000","last_clean":"2023-10-08T06:57:19.200677+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:19.200677+0000","last_undegraded":"2023-10-08T06:57:19.200677+0000","last_fullsized":"2023-10-08T06:57:19.200677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956853+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:18.956853+0000","last_peered":"2023-10-08T06:57:18.956853+0000","last_clean":"2023-10-08T06:57:18.956853+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:18.956853+0000","last_undegraded":"2023-10-08T06:57:18.956853+0000","last_fullsized":"2023-10-08T06:57:18.956853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956786+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:18.956786+0000","last_peered":"2023-10-08T06:57:18.956786+0000","last_clean":"2023-10-08T06:57:18.956786+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:18.956786+0000","last_undegraded":"2023-10-08T06:57:18.956786+0000","last_fullsized":"2023-10-08T06:57:18.956786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200276+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:19.200276+0000","last_peered":"2023-10-08T06:57:19.200276+0000","last_clean":"2023-10-08T06:57:19.200276+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:19.200276+0000","last_undegraded":"2023-10-08T06:57:19.200276+0000","last_fullsized":"2023-10-08T06:57:19.200276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956469+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:18.956469+0000","last_peered":"2023-10-08T06:57:18.956469+0000","last_clean":"2023-10-08T06:57:18.956469+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:18.956469+0000","last_undegraded":"2023-10-08T06:57:18.956469+0000","last_fullsized":"2023-10-08T06:57:18.956469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956429+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:18.956429+0000","last_peered":"2023-10-08T06:57:18.956429+0000","last_clean":"2023-10-08T06:57:18.956429+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:18.956429+0000","last_undegraded":"2023-10-08T06:57:18.956429+0000","last_fullsized":"2023-10-08T06:57:18.956429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956273+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:18.956273+0000","last_peered":"2023-10-08T06:57:18.956273+0000","last_clean":"2023-10-08T06:57:18.956273+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:18.956273+0000","last_undegraded":"2023-10-08T06:57:18.956273+0000","last_fullsized":"2023-10-08T06:57:18.956273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952398+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:18.952398+0000","last_peered":"2023-10-08T06:57:18.952398+0000","last_clean":"2023-10-08T06:57:18.952398+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:18.952398+0000","last_undegraded":"2023-10-08T06:57:18.952398+0000","last_fullsized":"2023-10-08T06:57:18.952398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200821+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:19.200821+0000","last_peered":"2023-10-08T06:57:19.200821+0000","last_clean":"2023-10-08T06:57:19.200821+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:19.200821+0000","last_undegraded":"2023-10-08T06:57:19.200821+0000","last_fullsized":"2023-10-08T06:57:19.200821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956801+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:18.956801+0000","last_peered":"2023-10-08T06:57:18.956801+0000","last_clean":"2023-10-08T06:57:18.956801+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:18.956801+0000","last_undegraded":"2023-10-08T06:57:18.956801+0000","last_fullsized":"2023-10-08T06:57:18.956801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200104+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:19.200104+0000","last_peered":"2023-10-08T06:57:19.200104+0000","last_clean":"2023-10-08T06:57:19.200104+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:19.200104+0000","last_undegraded":"2023-10-08T06:57:19.200104+0000","last_fullsized":"2023-10-08T06:57:19.200104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200070+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:19.200070+0000","last_peered":"2023-10-08T06:57:19.200070+0000","last_clean":"2023-10-08T06:57:19.200070+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:19.200070+0000","last_undegraded":"2023-10-08T06:57:19.200070+0000","last_fullsized":"2023-10-08T06:57:19.200070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956549+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:18.956549+0000","last_peered":"2023-10-08T06:57:18.956549+0000","last_clean":"2023-10-08T06:57:18.956549+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:18.956549+0000","last_undegraded":"2023-10-08T06:57:18.956549+0000","last_fullsized":"2023-10-08T06:57:18.956549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956445+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:18.956445+0000","last_peered":"2023-10-08T06:57:18.956445+0000","last_clean":"2023-10-08T06:57:18.956445+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:18.956445+0000","last_undegraded":"2023-10-08T06:57:18.956445+0000","last_fullsized":"2023-10-08T06:57:18.956445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956305+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:18.956305+0000","last_peered":"2023-10-08T06:57:18.956305+0000","last_clean":"2023-10-08T06:57:18.956305+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:18.956305+0000","last_undegraded":"2023-10-08T06:57:18.956305+0000","last_fullsized":"2023-10-08T06:57:18.956305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952408+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:18.952408+0000","last_peered":"2023-10-08T06:57:18.952408+0000","last_clean":"2023-10-08T06:57:18.952408+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:18.952408+0000","last_undegraded":"2023-10-08T06:57:18.952408+0000","last_fullsized":"2023-10-08T06:57:18.952408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200924+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:19.200924+0000","last_peered":"2023-10-08T06:57:19.200924+0000","last_clean":"2023-10-08T06:57:19.200924+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:19.200924+0000","last_undegraded":"2023-10-08T06:57:19.200924+0000","last_fullsized":"2023-10-08T06:57:19.200924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952324+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:18.952324+0000","last_peered":"2023-10-08T06:57:18.952324+0000","last_clean":"2023-10-08T06:57:18.952324+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:18.952324+0000","last_undegraded":"2023-10-08T06:57:18.952324+0000","last_fullsized":"2023-10-08T06:57:18.952324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956771+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:18.956771+0000","last_peered":"2023-10-08T06:57:18.956771+0000","last_clean":"2023-10-08T06:57:18.956771+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:18.956771+0000","last_undegraded":"2023-10-08T06:57:18.956771+0000","last_fullsized":"2023-10-08T06:57:18.956771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956567+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:18.956567+0000","last_peered":"2023-10-08T06:57:18.956567+0000","last_clean":"2023-10-08T06:57:18.956567+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:18.956567+0000","last_undegraded":"2023-10-08T06:57:18.956567+0000","last_fullsized":"2023-10-08T06:57:18.956567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199833+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:19.199833+0000","last_peered":"2023-10-08T06:57:19.199833+0000","last_clean":"2023-10-08T06:57:19.199833+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:19.199833+0000","last_undegraded":"2023-10-08T06:57:19.199833+0000","last_fullsized":"2023-10-08T06:57:19.199833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:15.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952194+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:18.952194+0000","last_peered":"2023-10-08T06:57:18.952194+0000","last_clean":"2023-10-08T06:57:18.952194+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:18.952194+0000","last_undegraded":"2023-10-08T06:57:18.952194+0000","last_fullsized":"2023-10-08T06:57:18.952194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199887+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:19.199887+0000","last_peered":"2023-10-08T06:57:19.199887+0000","last_clean":"2023-10-08T06:57:19.199887+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:19.199887+0000","last_undegraded":"2023-10-08T06:57:19.199887+0000","last_fullsized":"2023-10-08T06:57:19.199887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200880+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:19.200880+0000","last_peered":"2023-10-08T06:57:19.200880+0000","last_clean":"2023-10-08T06:57:19.200880+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:19.200880+0000","last_undegraded":"2023-10-08T06:57:19.200880+0000","last_fullsized":"2023-10-08T06:57:19.200880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952334+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:18.952334+0000","last_peered":"2023-10-08T06:57:18.952334+0000","last_clean":"2023-10-08T06:57:18.952334+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:18.952334+0000","last_undegraded":"2023-10-08T06:57:18.952334+0000","last_fullsized":"2023-10-08T06:57:18.952334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956818+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:18.956818+0000","last_peered":"2023-10-08T06:57:18.956818+0000","last_clean":"2023-10-08T06:57:18.956818+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:18.956818+0000","last_undegraded":"2023-10-08T06:57:18.956818+0000","last_fullsized":"2023-10-08T06:57:18.956818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199759+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:19.199759+0000","last_peered":"2023-10-08T06:57:19.199759+0000","last_clean":"2023-10-08T06:57:19.199759+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:19.199759+0000","last_undegraded":"2023-10-08T06:57:19.199759+0000","last_fullsized":"2023-10-08T06:57:19.199759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200697+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:19.200697+0000","last_peered":"2023-10-08T06:57:19.200697+0000","last_clean":"2023-10-08T06:57:19.200697+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:19.200697+0000","last_undegraded":"2023-10-08T06:57:19.200697+0000","last_fullsized":"2023-10-08T06:57:19.200697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952203+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:18.952203+0000","last_peered":"2023-10-08T06:57:18.952203+0000","last_clean":"2023-10-08T06:57:18.952203+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:18.952203+0000","last_undegraded":"2023-10-08T06:57:18.952203+0000","last_fullsized":"2023-10-08T06:57:18.952203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952355+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:18.952355+0000","last_peered":"2023-10-08T06:57:18.952355+0000","last_clean":"2023-10-08T06:57:18.952355+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:18.952355+0000","last_undegraded":"2023-10-08T06:57:18.952355+0000","last_fullsized":"2023-10-08T06:57:18.952355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952135+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:18.952135+0000","last_peered":"2023-10-08T06:57:18.952135+0000","last_clean":"2023-10-08T06:57:18.952135+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:18.952135+0000","last_undegraded":"2023-10-08T06:57:18.952135+0000","last_fullsized":"2023-10-08T06:57:18.952135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200889+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:19.200889+0000","last_peered":"2023-10-08T06:57:19.200889+0000","last_clean":"2023-10-08T06:57:19.200889+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:19.200889+0000","last_undegraded":"2023-10-08T06:57:19.200889+0000","last_fullsized":"2023-10-08T06:57:19.200889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952469+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:18.952469+0000","last_peered":"2023-10-08T06:57:18.952469+0000","last_clean":"2023-10-08T06:57:18.952469+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:18.952469+0000","last_undegraded":"2023-10-08T06:57:18.952469+0000","last_fullsized":"2023-10-08T06:57:18.952469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952144+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:18.952144+0000","last_peered":"2023-10-08T06:57:18.952144+0000","last_clean":"2023-10-08T06:57:18.952144+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:18.952144+0000","last_undegraded":"2023-10-08T06:57:18.952144+0000","last_fullsized":"2023-10-08T06:57:18.952144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956927+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:18.956927+0000","last_peered":"2023-10-08T06:57:18.956927+0000","last_clean":"2023-10-08T06:57:18.956927+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:18.956927+0000","last_undegraded":"2023-10-08T06:57:18.956927+0000","last_fullsized":"2023-10-08T06:57:18.956927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952213+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:18.952213+0000","last_peered":"2023-10-08T06:57:18.952213+0000","last_clean":"2023-10-08T06:57:18.952213+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:18.952213+0000","last_undegraded":"2023-10-08T06:57:18.952213+0000","last_fullsized":"2023-10-08T06:57:18.952213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200373+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:19.200373+0000","last_peered":"2023-10-08T06:57:19.200373+0000","last_clean":"2023-10-08T06:57:19.200373+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:19.200373+0000","last_undegraded":"2023-10-08T06:57:19.200373+0000","last_fullsized":"2023-10-08T06:57:19.200373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952239+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:18.952239+0000","last_peered":"2023-10-08T06:57:18.952239+0000","last_clean":"2023-10-08T06:57:18.952239+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:18.952239+0000","last_undegraded":"2023-10-08T06:57:18.952239+0000","last_fullsized":"2023-10-08T06:57:18.952239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956744+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:18.956744+0000","last_peered":"2023-10-08T06:57:18.956744+0000","last_clean":"2023-10-08T06:57:18.956744+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:18.956744+0000","last_undegraded":"2023-10-08T06:57:18.956744+0000","last_fullsized":"2023-10-08T06:57:18.956744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956678+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:18.956678+0000","last_peered":"2023-10-08T06:57:18.956678+0000","last_clean":"2023-10-08T06:57:18.956678+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:18.956678+0000","last_undegraded":"2023-10-08T06:57:18.956678+0000","last_fullsized":"2023-10-08T06:57:18.956678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956660+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:18.956660+0000","last_peered":"2023-10-08T06:57:18.956660+0000","last_clean":"2023-10-08T06:57:18.956660+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:18.956660+0000","last_undegraded":"2023-10-08T06:57:18.956660+0000","last_fullsized":"2023-10-08T06:57:18.956660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200155+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:19.200155+0000","last_peered":"2023-10-08T06:57:19.200155+0000","last_clean":"2023-10-08T06:57:19.200155+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:19.200155+0000","last_undegraded":"2023-10-08T06:57:19.200155+0000","last_fullsized":"2023-10-08T06:57:19.200155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952250+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:18.952250+0000","last_peered":"2023-10-08T06:57:18.952250+0000","last_clean":"2023-10-08T06:57:18.952250+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:18.952250+0000","last_undegraded":"2023-10-08T06:57:18.952250+0000","last_fullsized":"2023-10-08T06:57:18.952250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200678+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:19.200678+0000","last_peered":"2023-10-08T06:57:19.200678+0000","last_clean":"2023-10-08T06:57:19.200678+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:19.200678+0000","last_undegraded":"2023-10-08T06:57:19.200678+0000","last_fullsized":"2023-10-08T06:57:19.200678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199780+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:19.199780+0000","last_peered":"2023-10-08T06:57:19.199780+0000","last_clean":"2023-10-08T06:57:19.199780+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:19.199780+0000","last_undegraded":"2023-10-08T06:57:19.199780+0000","last_fullsized":"2023-10-08T06:57:19.199780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952370+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:18.952370+0000","last_peered":"2023-10-08T06:57:18.952370+0000","last_clean":"2023-10-08T06:57:18.952370+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:18.952370+0000","last_undegraded":"2023-10-08T06:57:18.952370+0000","last_fullsized":"2023-10-08T06:57:18.952370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956390+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:18.956390+0000","last_peered":"2023-10-08T06:57:18.956390+0000","last_clean":"2023-10-08T06:57:18.956390+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:18.956390+0000","last_undegraded":"2023-10-08T06:57:18.956390+0000","last_fullsized":"2023-10-08T06:57:18.956390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952487+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:18.952487+0000","last_peered":"2023-10-08T06:57:18.952487+0000","last_clean":"2023-10-08T06:57:18.952487+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:18.952487+0000","last_undegraded":"2023-10-08T06:57:18.952487+0000","last_fullsized":"2023-10-08T06:57:18.952487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.149729+0000","last_change":"2023-10-08T06:57:38.149729+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.149729+0000","last_undegraded":"2023-10-08T06:57:38.149729+0000","last_fullsized":"2023-10-08T06:57:38.149729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956958+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:18.956958+0000","last_peered":"2023-10-08T06:57:18.956958+0000","last_clean":"2023-10-08T06:57:18.956958+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:18.956958+0000","last_undegraded":"2023-10-08T06:57:18.956958+0000","last_fullsized":"2023-10-08T06:57:18.956958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199386+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:19.199386+0000","last_peered":"2023-10-08T06:57:19.199386+0000","last_clean":"2023-10-08T06:57:19.199386+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:19.199386+0000","last_undegraded":"2023-10-08T06:57:19.199386+0000","last_fullsized":"2023-10-08T06:57:19.199386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.147470+0000","last_change":"2023-10-08T06:57:38.147470+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.147470+0000","last_undegraded":"2023-10-08T06:57:38.147470+0000","last_fullsized":"2023-10-08T06:57:38.147470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200603+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:19.200603+0000","last_peered":"2023-10-08T06:57:19.200603+0000","last_clean":"2023-10-08T06:57:19.200603+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:19.200603+0000","last_undegraded":"2023-10-08T06:57:19.200603+0000","last_fullsized":"2023-10-08T06:57:19.200603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200009+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:19.200009+0000","last_peered":"2023-10-08T06:57:19.200009+0000","last_clean":"2023-10-08T06:57:19.200009+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:19.200009+0000","last_undegraded":"2023-10-08T06:57:19.200009+0000","last_fullsized":"2023-10-08T06:57:19.200009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.147013+0000","last_change":"2023-10-08T06:57:38.147013+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.147013+0000","last_undegraded":"2023-10-08T06:57:38.147013+0000","last_fullsized":"2023-10-08T06:57:38.147013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956835+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:18.956835+0000","last_peered":"2023-10-08T06:57:18.956835+0000","last_clean":"2023-10-08T06:57:18.956835+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:18.956835+0000","last_undegraded":"2023-10-08T06:57:18.956835+0000","last_fullsized":"2023-10-08T06:57:18.956835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956521+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:18.956521+0000","last_peered":"2023-10-08T06:57:18.956521+0000","last_clean":"2023-10-08T06:57:18.956521+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:18.956521+0000","last_undegraded":"2023-10-08T06:57:18.956521+0000","last_fullsized":"2023-10-08T06:57:18.956521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.146835+0000","last_change":"2023-10-08T06:57:38.146835+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.146835+0000","last_undegraded":"2023-10-08T06:57:38.146835+0000","last_fullsized":"2023-10-08T06:57:38.146835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956693+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:18.956693+0000","last_peered":"2023-10-08T06:57:18.956693+0000","last_clean":"2023-10-08T06:57:18.956693+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:18.956693+0000","last_undegraded":"2023-10-08T06:57:18.956693+0000","last_fullsized":"2023-10-08T06:57:18.956693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952271+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:18.952271+0000","last_peered":"2023-10-08T06:57:18.952271+0000","last_clean":"2023-10-08T06:57:18.952271+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:18.952271+0000","last_undegraded":"2023-10-08T06:57:18.952271+0000","last_fullsized":"2023-10-08T06:57:18.952271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.146957+0000","last_change":"2023-10-08T06:57:38.146957+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.146957+0000","last_undegraded":"2023-10-08T06:57:38.146957+0000","last_fullsized":"2023-10-08T06:57:38.146957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952261+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:18.952261+0000","last_peered":"2023-10-08T06:57:18.952261+0000","last_clean":"2023-10-08T06:57:18.952261+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:18.952261+0000","last_undegraded":"2023-10-08T06:57:18.952261+0000","last_fullsized":"2023-10-08T06:57:18.952261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956708+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:18.956708+0000","last_peered":"2023-10-08T06:57:18.956708+0000","last_clean":"2023-10-08T06:57:18.956708+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:18.956708+0000","last_undegraded":"2023-10-08T06:57:18.956708+0000","last_fullsized":"2023-10-08T06:57:18.956708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.146843+0000","last_change":"2023-10-08T06:57:38.146843+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.146843+0000","last_undegraded":"2023-10-08T06:57:38.146843+0000","last_fullsized":"2023-10-08T06:57:38.146843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956486+0000","last_change":"2023-10-08T06:57:16.318802+0000","last_active":"2023-10-08T06:57:18.956486+0000","last_peered":"2023-10-08T06:57:18.956486+0000","last_clean":"2023-10-08T06:57:18.956486+0000","last_became_active":"2023-10-08T06:57:16.318319+0000","last_became_peered":"2023-10-08T06:57:16.318319+0000","last_unstale":"2023-10-08T06:57:18.956486+0000","last_undegraded":"2023-10-08T06:57:18.956486+0000","last_fullsized":"2023-10-08T06:57:18.956486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956911+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:18.956911+0000","last_peered":"2023-10-08T06:57:18.956911+0000","last_clean":"2023-10-08T06:57:18.956911+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:18.956911+0000","last_undegraded":"2023-10-08T06:57:18.956911+0000","last_fullsized":"2023-10-08T06:57:18.956911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.149700+0000","last_change":"2023-10-08T06:57:38.149700+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.149700+0000","last_undegraded":"2023-10-08T06:57:38.149700+0000","last_fullsized":"2023-10-08T06:57:38.149700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199446+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:19.199446+0000","last_peered":"2023-10-08T06:57:19.199446+0000","last_clean":"2023-10-08T06:57:19.199446+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:19.199446+0000","last_undegraded":"2023-10-08T06:57:19.199446+0000","last_fullsized":"2023-10-08T06:57:19.199446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956942+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:18.956942+0000","last_peered":"2023-10-08T06:57:18.956942+0000","last_clean":"2023-10-08T06:57:18.956942+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:18.956942+0000","last_undegraded":"2023-10-08T06:57:18.956942+0000","last_fullsized":"2023-10-08T06:57:18.956942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.147027+0000","last_change":"2023-10-08T06:57:38.147027+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.147027+0000","last_undegraded":"2023-10-08T06:57:38.147027+0000","last_fullsized":"2023-10-08T06:57:38.147027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199533+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:19.199533+0000","last_peered":"2023-10-08T06:57:19.199533+0000","last_clean":"2023-10-08T06:57:19.199533+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:19.199533+0000","last_undegraded":"2023-10-08T06:57:19.199533+0000","last_fullsized":"2023-10-08T06:57:19.199533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952440+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:18.952440+0000","last_peered":"2023-10-08T06:57:18.952440+0000","last_clean":"2023-10-08T06:57:18.952440+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:18.952440+0000","last_undegraded":"2023-10-08T06:57:18.952440+0000","last_fullsized":"2023-10-08T06:57:18.952440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.146833+0000","last_change":"2023-10-08T06:57:38.146833+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.146833+0000","last_undegraded":"2023-10-08T06:57:38.146833+0000","last_fullsized":"2023-10-08T06:57:38.146833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332346+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:18.332346+0000","last_peered":"2023-10-08T06:57:18.332346+0000","last_clean":"2023-10-08T06:57:18.332346+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:18.332346+0000","last_undegraded":"2023-10-08T06:57:18.332346+0000","last_fullsized":"2023-10-08T06:57:18.332346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956868+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:18.956868+0000","last_peered":"2023-10-08T06:57:18.956868+0000","last_clean":"2023-10-08T06:57:18.956868+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:18.956868+0000","last_undegraded":"2023-10-08T06:57:18.956868+0000","last_fullsized":"2023-10-08T06:57:18.956868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199973+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:19.199973+0000","last_peered":"2023-10-08T06:57:19.199973+0000","last_clean":"2023-10-08T06:57:19.199973+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:19.199973+0000","last_undegraded":"2023-10-08T06:57:19.199973+0000","last_fullsized":"2023-10-08T06:57:19.199973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.146859+0000","last_change":"2023-10-08T06:57:38.146859+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.146859+0000","last_undegraded":"2023-10-08T06:57:38.146859+0000","last_fullsized":"2023-10-08T06:57:38.146859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334314+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:18.334314+0000","last_peered":"2023-10-08T06:57:18.334314+0000","last_clean":"2023-10-08T06:57:18.334314+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:18.334314+0000","last_undegraded":"2023-10-08T06:57:18.334314+0000","last_fullsized":"2023-10-08T06:57:18.334314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956611+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:18.956611+0000","last_peered":"2023-10-08T06:57:18.956611+0000","last_clean":"2023-10-08T06:57:18.956611+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:18.956611+0000","last_undegraded":"2023-10-08T06:57:18.956611+0000","last_fullsized":"2023-10-08T06:57:18.956611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952307+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:18.952307+0000","last_peered":"2023-10-08T06:57:18.952307+0000","last_clean":"2023-10-08T06:57:18.952307+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:18.952307+0000","last_undegraded":"2023-10-08T06:57:18.952307+0000","last_fullsized":"2023-10-08T06:57:18.952307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.146849+0000","last_change":"2023-10-08T06:57:38.146849+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.146849+0000","last_undegraded":"2023-10-08T06:57:38.146849+0000","last_fullsized":"2023-10-08T06:57:38.146849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.331327+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:18.331327+0000","last_peered":"2023-10-08T06:57:18.331327+0000","last_clean":"2023-10-08T06:57:18.331327+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:18.331327+0000","last_undegraded":"2023-10-08T06:57:18.331327+0000","last_fullsized":"2023-10-08T06:57:18.331327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199466+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:19.199466+0000","last_peered":"2023-10-08T06:57:19.199466+0000","last_clean":"2023-10-08T06:57:19.199466+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:19.199466+0000","last_undegraded":"2023-10-08T06:57:19.199466+0000","last_fullsized":"2023-10-08T06:57:19.199466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952479+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:18.952479+0000","last_peered":"2023-10-08T06:57:18.952479+0000","last_clean":"2023-10-08T06:57:18.952479+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:18.952479+0000","last_undegraded":"2023-10-08T06:57:18.952479+0000","last_fullsized":"2023-10-08T06:57:18.952479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.146955+0000","last_change":"2023-10-08T06:57:38.146955+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.146955+0000","last_undegraded":"2023-10-08T06:57:38.146955+0000","last_fullsized":"2023-10-08T06:57:38.146955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334167+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:18.334167+0000","last_peered":"2023-10-08T06:57:18.334167+0000","last_clean":"2023-10-08T06:57:18.334167+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:18.334167+0000","last_undegraded":"2023-10-08T06:57:18.334167+0000","last_fullsized":"2023-10-08T06:57:18.334167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333558+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:18.333558+0000","last_peered":"2023-10-08T06:57:18.333558+0000","last_clean":"2023-10-08T06:57:18.333558+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:18.333558+0000","last_undegraded":"2023-10-08T06:57:18.333558+0000","last_fullsized":"2023-10-08T06:57:18.333558+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952228+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:18.952228+0000","last_peered":"2023-10-08T06:57:18.952228+0000","last_clean":"2023-10-08T06:57:18.952228+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:18.952228+0000","last_undegraded":"2023-10-08T06:57:18.952228+0000","last_fullsized":"2023-10-08T06:57:18.952228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956886+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:18.956886+0000","last_peered":"2023-10-08T06:57:18.956886+0000","last_clean":"2023-10-08T06:57:18.956886+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:18.956886+0000","last_undegraded":"2023-10-08T06:57:18.956886+0000","last_fullsized":"2023-10-08T06:57:18.956886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.149278+0000","last_change":"2023-10-08T06:57:38.149278+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.149278+0000","last_undegraded":"2023-10-08T06:57:38.149278+0000","last_fullsized":"2023-10-08T06:57:38.149278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.333618+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:18.333618+0000","last_peered":"2023-10-08T06:57:18.333618+0000","last_clean":"2023-10-08T06:57:18.333618+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:18.333618+0000","last_undegraded":"2023-10-08T06:57:18.333618+0000","last_fullsized":"2023-10-08T06:57:18.333618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952154+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:18.952154+0000","last_peered":"2023-10-08T06:57:18.952154+0000","last_clean":"2023-10-08T06:57:18.952154+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:18.952154+0000","last_undegraded":"2023-10-08T06:57:18.952154+0000","last_fullsized":"2023-10-08T06:57:18.952154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200878+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:19.200878+0000","last_peered":"2023-10-08T06:57:19.200878+0000","last_clean":"2023-10-08T06:57:19.200878+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:19.200878+0000","last_undegraded":"2023-10-08T06:57:19.200878+0000","last_fullsized":"2023-10-08T06:57:19.200878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.149262+0000","last_change":"2023-10-08T06:57:38.149262+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.149262+0000","last_undegraded":"2023-10-08T06:57:38.149262+0000","last_fullsized":"2023-10-08T06:57:38.149262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200474+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:19.200474+0000","last_peered":"2023-10-08T06:57:19.200474+0000","last_clean":"2023-10-08T06:57:19.200474+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:19.200474+0000","last_undegraded":"2023-10-08T06:57:19.200474+0000","last_fullsized":"2023-10-08T06:57:19.200474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952299+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:18.952299+0000","last_peered":"2023-10-08T06:57:18.952299+0000","last_clean":"2023-10-08T06:57:18.952299+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:18.952299+0000","last_undegraded":"2023-10-08T06:57:18.952299+0000","last_fullsized":"2023-10-08T06:57:18.952299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200352+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:19.200352+0000","last_peered":"2023-10-08T06:57:19.200352+0000","last_clean":"2023-10-08T06:57:19.200352+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:19.200352+0000","last_undegraded":"2023-10-08T06:57:19.200352+0000","last_fullsized":"2023-10-08T06:57:19.200352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.149221+0000","last_change":"2023-10-08T06:57:38.149221+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.149221+0000","last_undegraded":"2023-10-08T06:57:38.149221+0000","last_fullsized":"2023-10-08T06:57:38.149221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952427+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:18.952427+0000","last_peered":"2023-10-08T06:57:18.952427+0000","last_clean":"2023-10-08T06:57:18.952427+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:18.952427+0000","last_undegraded":"2023-10-08T06:57:18.952427+0000","last_fullsized":"2023-10-08T06:57:18.952427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.332422+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:18.332422+0000","last_peered":"2023-10-08T06:57:18.332422+0000","last_clean":"2023-10-08T06:57:18.332422+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:18.332422+0000","last_undegraded":"2023-10-08T06:57:18.332422+0000","last_fullsized":"2023-10-08T06:57:18.332422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952118+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:18.952118+0000","last_peered":"2023-10-08T06:57:18.952118+0000","last_clean":"2023-10-08T06:57:18.952118+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:18.952118+0000","last_undegraded":"2023-10-08T06:57:18.952118+0000","last_fullsized":"2023-10-08T06:57:18.952118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-10-08T06:57:38.147029+0000","last_change":"2023-10-08T06:57:38.147029+0000","last_active":"2023-10-08T06:57:38.139123+0000","last_peered":"2023-10-08T06:57:38.139123+0000","last_clean":"2023-10-08T06:57:38.139123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T06:57:38.147029+0000","last_undegraded":"2023-10-08T06:57:38.147029+0000","last_fullsized":"2023-10-08T06:57:38.147029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.334817+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:18.334817+0000","last_peered":"2023-10-08T06:57:18.334817+0000","last_clean":"2023-10-08T06:57:18.334817+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:18.334817+0000","last_undegraded":"2023-10-08T06:57:18.334817+0000","last_fullsized":"2023-10-08T06:57:18.334817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:21.404168+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:21.404168+0000","last_peered":"2023-10-08T06:57:21.404168+0000","last_clean":"2023-10-08T06:57:21.404168+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:21.404168+0000","last_undegraded":"2023-10-08T06:57:21.404168+0000","last_fullsized":"2023-10-08T06:57:21.404168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.199792+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:19.199792+0000","last_peered":"2023-10-08T06:57:19.199792+0000","last_clean":"2023-10-08T06:57:19.199792+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:19.199792+0000","last_undegraded":"2023-10-08T06:57:19.199792+0000","last_fullsized":"2023-10-08T06:57:19.199792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200153+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:19.200153+0000","last_peered":"2023-10-08T06:57:19.200153+0000","last_clean":"2023-10-08T06:57:19.200153+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:19.200153+0000","last_undegraded":"2023-10-08T06:57:19.200153+0000","last_fullsized":"2023-10-08T06:57:19.200153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200296+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:19.200296+0000","last_peered":"2023-10-08T06:57:19.200296+0000","last_clean":"2023-10-08T06:57:19.200296+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:19.200296+0000","last_undegraded":"2023-10-08T06:57:19.200296+0000","last_fullsized":"2023-10-08T06:57:19.200296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956724+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:18.956724+0000","last_peered":"2023-10-08T06:57:18.956724+0000","last_clean":"2023-10-08T06:57:18.956724+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:18.956724+0000","last_undegraded":"2023-10-08T06:57:18.956724+0000","last_fullsized":"2023-10-08T06:57:18.956724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956583+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:18.956583+0000","last_peered":"2023-10-08T06:57:18.956583+0000","last_clean":"2023-10-08T06:57:18.956583+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:18.956583+0000","last_undegraded":"2023-10-08T06:57:18.956583+0000","last_fullsized":"2023-10-08T06:57:18.956583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200497+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:19.200497+0000","last_peered":"2023-10-08T06:57:19.200497+0000","last_clean":"2023-10-08T06:57:19.200497+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:19.200497+0000","last_undegraded":"2023-10-08T06:57:19.200497+0000","last_fullsized":"2023-10-08T06:57:19.200497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956504+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:18.956504+0000","last_peered":"2023-10-08T06:57:18.956504+0000","last_clean":"2023-10-08T06:57:18.956504+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:18.956504+0000","last_undegraded":"2023-10-08T06:57:18.956504+0000","last_fullsized":"2023-10-08T06:57:18.956504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952382+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:18.952382+0000","last_peered":"2023-10-08T06:57:18.952382+0000","last_clean":"2023-10-08T06:57:18.952382+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:18.952382+0000","last_undegraded":"2023-10-08T06:57:18.952382+0000","last_fullsized":"2023-10-08T06:57:18.952382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200055+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:19.200055+0000","last_peered":"2023-10-08T06:57:19.200055+0000","last_clean":"2023-10-08T06:57:19.200055+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:19.200055+0000","last_undegraded":"2023-10-08T06:57:19.200055+0000","last_fullsized":"2023-10-08T06:57:19.200055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952452+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:18.952452+0000","last_peered":"2023-10-08T06:57:18.952452+0000","last_clean":"2023-10-08T06:57:18.952452+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:18.952452+0000","last_undegraded":"2023-10-08T06:57:18.952452+0000","last_fullsized":"2023-10-08T06:57:18.952452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956410+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:18.956410+0000","last_peered":"2023-10-08T06:57:18.956410+0000","last_clean":"2023-10-08T06:57:18.956410+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:18.956410+0000","last_undegraded":"2023-10-08T06:57:18.956410+0000","last_fullsized":"2023-10-08T06:57:18.956410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.956371+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:18.956371+0000","last_peered":"2023-10-08T06:57:18.956371+0000","last_clean":"2023-10-08T06:57:18.956371+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:18.956371+0000","last_undegraded":"2023-10-08T06:57:18.956371+0000","last_fullsized":"2023-10-08T06:57:18.956371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952165+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:18.952165+0000","last_peered":"2023-10-08T06:57:18.952165+0000","last_clean":"2023-10-08T06:57:18.952165+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:18.952165+0000","last_undegraded":"2023-10-08T06:57:18.952165+0000","last_fullsized":"2023-10-08T06:57:18.952165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200009+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:19.200009+0000","last_peered":"2023-10-08T06:57:19.200009+0000","last_clean":"2023-10-08T06:57:19.200009+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:19.200009+0000","last_undegraded":"2023-10-08T06:57:19.200009+0000","last_fullsized":"2023-10-08T06:57:19.200009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:18.952289+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:18.952289+0000","last_peered":"2023-10-08T06:57:18.952289+0000","last_clean":"2023-10-08T06:57:18.952289+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:18.952289+0000","last_undegraded":"2023-10-08T06:57:18.952289+0000","last_fullsized":"2023-10-08T06:57:18.952289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T06:57:19.200325+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:19.200325+0000","last_peered":"2023-10-08T06:57:19.200325+0000","last_clean":"2023-10-08T06:57:19.200325+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:19.200325+0000","last_undegraded":"2023-10-08T06:57:19.200325+0000","last_fullsized":"2023-10-08T06:57:19.200325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":63249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":655411,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":654795,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:43.829 INFO:tasks.thrashosds.thrasher:Setting 3.a to [1, 2] 2023-10-08T06:57:43.829 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.a', '1', '2'] 2023-10-08T06:57:43.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.a 1 2 2023-10-08T06:57:43.833 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:43.833 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:43.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.834 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13499 5.7 5:e446c83f:::benchmark_data_smithi037_101035_object13498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:43.834 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.829797+0000", 2023-10-08T06:57:43.834 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0033664649999999999, 2023-10-08T06:57:43.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033880609999999999, 2023-10-08T06:57:43.834 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:43.834 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:43.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:43.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:43.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:43.835 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13499 2023-10-08T06:57:43.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.835 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:43.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.829797+0000", 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.829797+0000", 2023-10-08T06:57:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.829798+0000", 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-07 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:43.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.830092+0000", 2023-10-08T06:57:43.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000294703 2023-10-08T06:57:43.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:43.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.830107+0000", 2023-10-08T06:57:43.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4887e-05 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.830117+0000", 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6830000000000003e-06 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:43.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.830159+0000", 2023-10-08T06:57:43.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1851000000000003e-05 2023-10-08T06:57:43.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:43.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.830247+0000", 2023-10-08T06:57:43.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8739000000000005e-05 2023-10-08T06:57:43.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:43.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.830361+0000", 2023-10-08T06:57:43.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011390100000000001 2023-10-08T06:57:43.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:43.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.831986+0000", 2023-10-08T06:57:43.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016242629999999999 2023-10-08T06:57:43.842 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.843 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:43.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.843 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13507 5.2 5:44a8391b:::benchmark_data_smithi037_101035_object13506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:43.844 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.831976+0000", 2023-10-08T06:57:43.845 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001187558, 2023-10-08T06:57:43.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001268705, 2023-10-08T06:57:43.845 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:43.845 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:43.845 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:43.846 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:43.846 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:43.846 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13507 2023-10-08T06:57:43.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.846 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:43.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:43.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.831976+0000", 2023-10-08T06:57:43.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:43.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.831976+0000", 2023-10-08T06:57:43.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:43.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.831977+0000", 2023-10-08T06:57:43.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0699999999999996e-07 2023-10-08T06:57:43.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:43.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832077+0000", 2023-10-08T06:57:43.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000100603 2023-10-08T06:57:43.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:43.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832088+0000", 2023-10-08T06:57:43.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0472000000000001e-05 2023-10-08T06:57:43.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:43.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832096+0000", 2023-10-08T06:57:43.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4120000000000001e-06 2023-10-08T06:57:43.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:43.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832155+0000", 2023-10-08T06:57:43.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8865e-05 2023-10-08T06:57:43.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:43.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832298+0000", 2023-10-08T06:57:43.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014300399999999999 2023-10-08T06:57:43.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:43.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832386+0000", 2023-10-08T06:57:43.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8357999999999997e-05 2023-10-08T06:57:43.854 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.855 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:43.855 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.855 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13509 5.7 5:efb74515:::benchmark_data_smithi037_101035_object13508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:43.855 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.832121+0000", 2023-10-08T06:57:43.856 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0010425059999999999, 2023-10-08T06:57:43.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001182184, 2023-10-08T06:57:43.856 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:43.856 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:43.856 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:43.856 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:43.857 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:43.857 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13509 2023-10-08T06:57:43.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.857 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:43.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:43.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832121+0000", 2023-10-08T06:57:43.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:43.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832121+0000", 2023-10-08T06:57:43.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:43.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832121+0000", 2023-10-08T06:57:43.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099999999999997e-07 2023-10-08T06:57:43.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:43.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832181+0000", 2023-10-08T06:57:43.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9889000000000002e-05 2023-10-08T06:57:43.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:43.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832199+0000", 2023-10-08T06:57:43.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7966e-05 2023-10-08T06:57:43.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:43.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832206+0000", 2023-10-08T06:57:43.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5919999999999997e-06 2023-10-08T06:57:43.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:43.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832240+0000", 2023-10-08T06:57:43.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4017999999999999e-05 2023-10-08T06:57:43.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:43.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832315+0000", 2023-10-08T06:57:43.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4967000000000002e-05 2023-10-08T06:57:43.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:43.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832402+0000", 2023-10-08T06:57:43.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7291000000000002e-05 2023-10-08T06:57:43.867 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.867 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:43.867 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.868 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13510 5.2 5:447aa15a:::benchmark_data_smithi037_101035_object13509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:43.868 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.832219+0000", 2023-10-08T06:57:43.868 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00094422699999999996, 2023-10-08T06:57:43.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001144993, 2023-10-08T06:57:43.868 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:43.869 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:43.869 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:43.869 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:43.869 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:43.869 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13510 2023-10-08T06:57:43.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.870 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:43.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:43.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832219+0000", 2023-10-08T06:57:43.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:43.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832219+0000", 2023-10-08T06:57:43.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:43.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832220+0000", 2023-10-08T06:57:43.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5799999999999999e-07 2023-10-08T06:57:43.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:43.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832250+0000", 2023-10-08T06:57:43.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0141000000000002e-05 2023-10-08T06:57:43.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832257+0000", 2023-10-08T06:57:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2840000000000001e-06 2023-10-08T06:57:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.832263+0000", 2023-10-08T06:57:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5910000000000003e-06 2023-10-08T06:57:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833012+0000", 2023-10-08T06:57:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00074956600000000001 2023-10-08T06:57:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833105+0000", 2023-10-08T06:57:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2867000000000004e-05 2023-10-08T06:57:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833186+0000", 2023-10-08T06:57:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0851000000000002e-05 2023-10-08T06:57:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13512 5.2 5.b4bc23a2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.833036+0000", 2023-10-08T06:57:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00012702500000000001, 2023-10-08T06:57:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00041303100000000001, 2023-10-08T06:57:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:57:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13512 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833036+0000", 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833036+0000", 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833037+0000", 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.02e-06 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833101+0000", 2023-10-08T06:57:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4125e-05 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833111+0000", 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9520000000000006e-06 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.833119+0000", 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3780000000000003e-06 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:57:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 5 2023-10-08T06:57:43.883 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:43.885 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:43.885 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:43.884+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:43.985 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:43.984+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:44.057 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:57:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:57:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:57:44.058 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:44.071 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:44.086 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:44.085+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:57:44.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:44.185+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:44.245 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.621440907, 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011390189, 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 138 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620642+0000", 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.172e-06 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620646+0000", 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6380000000000002e-06 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620648+0000", 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6199999999999999e-06 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625513+0000", 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004864635 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625565+0000", 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1842000000000003e-05 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625656+0000", 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0928999999999996e-05 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.629969+0000", 2023-10-08T06:57:44.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043131350000000001 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.631936+0000", 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019671889999999998 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.631991+0000", 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5226999999999998e-05 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632028+0000", 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6480000000000003e-05 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.253 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.621424492000003, 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011461148000000001, 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.254 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 139 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:44.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5800000000000001e-07 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620657+0000", 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7180000000000001e-06 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620661+0000", 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5640000000000001e-06 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620663+0000", 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6079999999999998e-06 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626056+0000", 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053925049999999997 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626104+0000", 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8486999999999998e-05 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626179+0000", 2023-10-08T06:57:44.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4725e-05 2023-10-08T06:57:44.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.629972+0000", 2023-10-08T06:57:44.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037933670000000002 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632060+0000", 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020872460000000001 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632093+0000", 2023-10-08T06:57:44.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3314e-05 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632115+0000", 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2356000000000001e-05 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.621362918999999, 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011776666999999999, 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 140 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.263 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6199999999999999e-07 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620788+0000", 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2639999999999996e-05 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620793+0000", 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9629999999999997e-06 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620796+0000", 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0359999999999998e-06 2023-10-08T06:57:44.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626432+0000", 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056358270000000004 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626511+0000", 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8640999999999995e-05 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626653+0000", 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014228600000000001 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632155+0000", 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055017809999999999 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632438+0000", 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028323999999999998 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632471+0000", 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2484999999999998e-05 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632492+0000", 2023-10-08T06:57:44.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1506e-05 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.621276281, 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013962354, 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.270 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 141 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620803+0000", 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7000000000000001e-07 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620806+0000", 2023-10-08T06:57:44.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.676e-06 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620810+0000", 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.647e-06 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620812+0000", 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5019999999999999e-06 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627179+0000", 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0063668500000000003 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627272+0000", 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3276000000000006e-05 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627404+0000", 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131428 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632498+0000", 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005094164 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634675+0000", 2023-10-08T06:57:44.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021769570000000002 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634731+0000", 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6144999999999999e-05 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634765+0000", 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3439000000000003e-05 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.276 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.490387804999997, 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011009055, 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:44.277 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 164 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:44.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3200000000000001e-07 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751760+0000", 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9245999999999994e-05 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751767+0000", 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5740000000000001e-06 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751770+0000", 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3270000000000001e-06 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.756961+0000", 2023-10-08T06:57:44.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051907580000000002 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757016+0000", 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5041999999999999e-05 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757109+0000", 2023-10-08T06:57:44.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3183999999999994e-05 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.761179+0000", 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040696949999999999 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762655+0000", 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001476045 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762682+0000", 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6948999999999999e-05 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762700+0000", 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8003e-05 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.490302886999999, 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010965292, 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 165 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.284 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4400000000000001e-07 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751778+0000", 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0150000000000002e-06 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751781+0000", 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.433e-06 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751784+0000", 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757514+0000", 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00572983 2023-10-08T06:57:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757591+0000", 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6790000000000002e-05 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757698+0000", 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010757899999999999 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.761205+0000", 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003506866 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762703+0000", 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001497998 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762724+0000", 2023-10-08T06:57:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0818e-05 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762741+0000", 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6935999999999998e-05 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:44.290 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.909325929000001, 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01058655, 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332754+0000", 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.097e-06 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332760+0000", 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8459999999999996e-06 2023-10-08T06:57:44.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333028+0000", 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026832499999999998 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333042+0000", 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3706000000000001e-05 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337211+0000", 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041694540000000004 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337302+0000", 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1018000000000002e-05 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337439+0000", 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013716100000000001 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342181+0000", 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047421140000000004 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343237+0000", 2023-10-08T06:57:44.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001055467 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343294+0000", 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7132999999999997e-05 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343339+0000", 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5228999999999997e-05 2023-10-08T06:57:44.296 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.909020387999998, 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0105679, 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333059+0000", 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6700000000000002e-07 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333064+0000", 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3730000000000001e-06 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333083+0000", 2023-10-08T06:57:44.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8414999999999999e-05 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333089+0000", 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6649999999999997e-06 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338347+0000", 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052580420000000001 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338475+0000", 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000127126 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338606+0000", 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131839 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342403+0000", 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037962629999999998 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343515+0000", 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011117939999999999 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343580+0000", 2023-10-08T06:57:44.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5961000000000001e-05 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343626+0000", 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5555e-05 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.303 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.908977956000001, 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010644859, 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8800000000000002e-07 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333108+0000", 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7170000000000002e-06 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333117+0000", 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.431e-06 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333124+0000", 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9909999999999996e-06 2023-10-08T06:57:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339316+0000", 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061920350000000002 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339422+0000", 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105944 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339605+0000", 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018256300000000001 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342597+0000", 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029923630000000001 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343671+0000", 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001073875 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343707+0000", 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5989999999999999e-05 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343745+0000", 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8262000000000001e-05 2023-10-08T06:57:44.309 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.908938238000001, 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010707638, 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333141+0000", 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7800000000000001e-07 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333145+0000", 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.811e-06 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333152+0000", 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0979999999999996e-06 2023-10-08T06:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333159+0000", 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7970000000000003e-06 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340436+0000", 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0072776949999999998 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340523+0000", 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7148e-05 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340623+0000", 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9544999999999996e-05 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342810+0000", 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021866170000000001 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343777+0000", 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00096742699999999998 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343823+0000", 2023-10-08T06:57:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5569999999999999e-05 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343848+0000", 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5352000000000001e-05 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:44.316 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.90883191, 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010728084000000001, 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7700000000000004e-07 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333252+0000", 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3290000000000004e-06 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333259+0000", 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9070000000000007e-06 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333265+0000", 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9730000000000002e-06 2023-10-08T06:57:44.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340906+0000", 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076407360000000004 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341004+0000", 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8303999999999999e-05 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341164+0000", 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015931699999999999 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342869+0000", 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001705008 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343909+0000", 2023-10-08T06:57:44.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001040469 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343950+0000", 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0645000000000001e-05 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343975+0000", 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4819000000000001e-05 2023-10-08T06:57:44.322 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333386+0000", 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.908692885000001, 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010273635999999999, 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333386+0000", 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333386+0000", 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333387+0000", 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333390+0000", 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6669999999999998e-06 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333909+0000", 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00051829600000000001 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333917+0000", 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7320000000000004e-06 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338212+0000", 2023-10-08T06:57:44.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042944790000000004 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338351+0000", 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013899600000000001 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338483+0000", 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132755 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342632+0000", 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041486960000000003 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343564+0000", 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00093228500000000004 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343621+0000", 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343659+0000", 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8708000000000003e-05 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:12985 5.d e23/20 5:b294e292:::benchmark_data_smithi037_101035_object12984:head v 23'841, mlcod=23'838)", 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.667830+0000", 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.57424852900000001, 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010332605, 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.667830+0000", 2023-10-08T06:57:44.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.667830+0000", 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.667830+0000", 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9999999999999998e-07 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.667934+0000", 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103502 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.667947+0000", 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2546e-05 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.667953+0000", 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8190000000000003e-06 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.668010+0000", 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6490000000000003e-05 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.668028+0000", 2023-10-08T06:57:44.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7935e-05 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.678135+0000", 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010107455 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.678163+0000", 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7358000000000001e-05 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.334 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13069 5.1 5:88cd8266:::benchmark_data_smithi037_101035_object13068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.54295123499999998, 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013921543999999999, 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:44.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13069 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699128+0000", 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699202+0000", 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4029999999999994e-05 2023-10-08T06:57:44.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699211+0000", 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5620000000000004e-06 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699218+0000", 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7660000000000001e-06 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699268+0000", 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0173999999999998e-05 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699381+0000", 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113522 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699486+0000", 2023-10-08T06:57:44.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010518699999999999 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704026+0000", 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045396569999999999 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.712963+0000", 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089374120000000005 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713016+0000", 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2243000000000001e-05 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713049+0000", 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3096000000000003e-05 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13071 5.1 5:8cd03df6:::benchmark_data_smithi037_101035_object13070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.54281962699999997, 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013866906, 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.342 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13071 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3599999999999999e-07 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699354+0000", 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4691999999999994e-05 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699360+0000", 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9159999999999998e-06 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699364+0000", 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0069999999999999e-06 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700173+0000", 2023-10-08T06:57:44.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00080942500000000001 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700294+0000", 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012094 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700392+0000", 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7575e-05 2023-10-08T06:57:44.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704069+0000", 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036775950000000001 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713055+0000", 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089859989999999997 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713098+0000", 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2211e-05 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713126+0000", 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.811e-05 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:14295 5.1 5:848f3e80:::benchmark_data_smithi037_101035_object14294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.17959191699999999, 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012720018, 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 14295 2023-10-08T06:57:44.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8899999999999999e-07 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062614+0000", 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126389 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062623+0000", 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5480000000000007e-06 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062630+0000", 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8109999999999997e-06 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063015+0000", 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000385184 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063168+0000", 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015317999999999999 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063310+0000", 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014111700000000001 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.067609+0000", 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042993060000000001 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075113+0000", 2023-10-08T06:57:44.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0075037150000000002 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075165+0000", 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2695999999999998e-05 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075207+0000", 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1383e-05 2023-10-08T06:57:44.355 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14421 5.5 e23/20 5:a6068a1e:::benchmark_data_smithi037_101035_object14420:head v 23'851, mlcod=23'847)", 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.13778169500000001, 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010677636000000001, 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.356 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104360+0000", 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2458000000000004e-05 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104369+0000", 2023-10-08T06:57:44.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7509999999999997e-06 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104376+0000", 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9399999999999996e-06 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.105942+0000", 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001566581 2023-10-08T06:57:44.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.105963+0000", 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1189e-05 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.114934+0000", 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089708719999999995 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.114974+0000", 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0256000000000002e-05 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14426 5.c e23/20 5:377a7937:::benchmark_data_smithi037_101035_object14425:head v 23'997, mlcod=23'994)", 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.104798+0000", 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.137280772, 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010199744, 2023-10-08T06:57:44.361 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104798+0000", 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104798+0000", 2023-10-08T06:57:44.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104798+0000", 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7400000000000003e-07 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104863+0000", 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4527000000000001e-05 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104872+0000", 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4669999999999993e-06 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104879+0000", 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.596e-06 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104937+0000", 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8393000000000001e-05 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104956+0000", 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8495000000000002e-05 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.114945+0000", 2023-10-08T06:57:44.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0099892490000000004 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.114997+0000", 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2442999999999999e-05 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:57:44.366 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.13477781699999999, 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:57:44.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:14723 5.f 5:f1c88cf2:::benchmark_data_smithi037_101035_object14722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.199892+0000", 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.042186332, 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010348636, 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 14723 2023-10-08T06:57:44.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.199892+0000", 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.199892+0000", 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.199893+0000", 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2799999999999996e-07 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.199923+0000", 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9921e-05 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.199931+0000", 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1499999999999999e-06 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.199937+0000", 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.28e-06 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.200952+0000", 2023-10-08T06:57:44.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0010148469999999999 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.201090+0000", 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013756400000000001 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.201218+0000", 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000128627 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.202890+0000", 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001671744 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.210152+0000", 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0072624029999999997 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:44.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.210202+0000", 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9787999999999998e-05 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.210241+0000", 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8683999999999998e-05 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:44.378 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:44.379 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 4 16 15244 15228 237.92 203.312 0.00589166 0.00419821 2023-10-08T06:57:44.380 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:44.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:44.379+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:44.481 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:44.480+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:44.552 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15830 5.0 5:0bf2326e:::benchmark_data_smithi037_101035_object15829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.544338+0000", 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0073269620000000002, 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073516700000000003, 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:44.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15830 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.544338+0000", 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.544338+0000", 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.544339+0000", 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8700000000000005e-07 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.544451+0000", 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111908 2023-10-08T06:57:44.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.544458+0000", 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1779999999999997e-06 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.544462+0000", 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.704e-06 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.545324+0000", 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00086244900000000005 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.545456+0000", 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013151300000000001 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.545599+0000", 2023-10-08T06:57:44.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014352599999999999 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546528+0000", 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00092914099999999997 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.558 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15834 5.0 5:07df7181:::benchmark_data_smithi037_101035_object15833:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.546529+0000", 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00513599, 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052192569999999997, 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15834 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546529+0000", 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546529+0000", 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546530+0000", 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3200000000000004e-07 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546582+0000", 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1399e-05 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546593+0000", 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1044e-05 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546600+0000", 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7239999999999992e-06 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546633+0000", 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3201999999999998e-05 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546710+0000", 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6165e-05 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546788+0000", 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8400999999999997e-05 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.548116+0000", 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013279139999999999 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15835 5.0 5:0105bbe2:::benchmark_data_smithi037_101035_object15834:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.546617+0000", 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0050478909999999997, 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0051792699999999997, 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15835 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.565 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546617+0000", 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546617+0000", 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546618+0000", 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.75e-07 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546653+0000", 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.481e-05 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546661+0000", 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1179999999999992e-06 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.546667+0000", 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4400000000000002e-06 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.547247+0000", 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057941899999999996 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.547377+0000", 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013015699999999999 2023-10-08T06:57:44.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.547517+0000", 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014001399999999999 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.548697+0000", 2023-10-08T06:57:44.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001180188 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15841 5.8 5:1543ac04:::benchmark_data_smithi037_101035_object15840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.549090+0000", 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0025751390000000002, 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027550090000000001, 2023-10-08T06:57:44.572 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15841 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549090+0000", 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549090+0000", 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549091+0000", 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2500000000000004e-07 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549137+0000", 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6455000000000002e-05 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549149+0000", 2023-10-08T06:57:44.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1412e-05 2023-10-08T06:57:44.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549157+0000", 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1869999999999997e-06 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549197+0000", 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9659000000000001e-05 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549272+0000", 2023-10-08T06:57:44.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5199999999999998e-05 2023-10-08T06:57:44.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549359+0000", 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7515000000000005e-05 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.551020+0000", 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016604199999999999 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.579 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15842 5.8 5:14df56f8:::benchmark_data_smithi037_101035_object15841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.549177+0000", 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002487787, 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027152220000000002, 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.580 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15842 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549177+0000", 2023-10-08T06:57:44.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549177+0000", 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549178+0000", 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4600000000000004e-07 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549211+0000", 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3173999999999998e-05 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549219+0000", 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1280000000000008e-06 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549225+0000", 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9270000000000002e-06 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.550007+0000", 2023-10-08T06:57:44.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000782094 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.550162+0000", 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000154826 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.550329+0000", 2023-10-08T06:57:44.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016686699999999999 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15845 5.b 5:d57bae47:::benchmark_data_smithi037_101035_object15844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.549347+0000", 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002318156, 2023-10-08T06:57:44.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025897310000000001, 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15845 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549347+0000", 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549347+0000", 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549348+0000", 2023-10-08T06:57:44.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5400000000000001e-07 2023-10-08T06:57:44.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549447+0000", 2023-10-08T06:57:44.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9303999999999997e-05 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549456+0000", 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4210000000000001e-06 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549463+0000", 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7719999999999997e-06 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549498+0000", 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4249999999999999e-05 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549581+0000", 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3349000000000004e-05 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549665+0000", 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3974000000000006e-05 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.551334+0000", 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001669212 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.593 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:15844 5.f e24/20 5:f3b5fec4:::benchmark_data_smithi037_101035_object15843:head v 24'1013, mlcod=24'1011)", 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.549700+0000", 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001965606, 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023029180000000002, 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549700+0000", 2023-10-08T06:57:44.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549700+0000", 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549700+0000", 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5899999999999996e-07 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549761+0000", 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0739999999999998e-05 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549774+0000", 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3155e-05 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549784+0000", 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3789999999999995e-06 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549829+0000", 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5324000000000002e-05 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.549850+0000", 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1285999999999999e-05 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15850 5.b 5.cf759edb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:44.600 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.551966+0000", 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9996991, 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108616, 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15850 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.551966+0000", 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.551966+0000", 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.551967+0000", 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4099999999999997e-07 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552031+0000", 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3709999999999998e-05 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552042+0000", 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1772e-05 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552051+0000", 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4500000000000004e-06 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(client.4555.0:15841 5.8 e24/20 ondisk, result = 0)", 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.552038+0000", 2023-10-08T06:57:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9996276, 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109008, 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552038+0000", 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552038+0000", 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552038+0000", 2023-10-08T06:57:44.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2899999999999999e-07 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552041+0000", 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5600000000000001e-06 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552046+0000", 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8760000000000002e-06 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552050+0000", 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.41e-06 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552090+0000", 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0535999999999999e-05 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552097+0000", 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3210000000000001e-06 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.611 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(client.4555.0:15845 5.b e24/20)", 2023-10-08T06:57:44.611 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.552063+0000", 2023-10-08T06:57:44.611 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9996018, 2023-10-08T06:57:44.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000149636, 2023-10-08T06:57:44.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552063+0000", 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:44.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552063+0000", 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552064+0000", 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2399999999999999e-07 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:44.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552066+0000", 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.52e-06 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552073+0000", 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8109999999999997e-06 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:44.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.552077+0000", 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5090000000000004e-06 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 10 2023-10-08T06:57:44.615 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:44.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:44.617 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:44.616+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:44.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:44.716+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:44.818 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:44.818+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:44.831 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:44.831 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:57:44.832 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:57:44.832 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:57:44.832 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:44.845 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:44.919 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:44.918+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:45.007 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:45.007 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:57:45.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:57:45.007 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:45.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.676238568999999, 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013838266, 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328375+0000", 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.843e-06 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328384+0000", 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5669999999999995e-06 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328397+0000", 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2925000000000001e-05 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328411+0000", 2023-10-08T06:57:45.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.454e-05 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001114128 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329709+0000", 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018355199999999999 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329888+0000", 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179576 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332277+0000", 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023889419999999998 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342081+0000", 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098036779999999997 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342151+0000", 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0166999999999994e-05 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342208+0000", 2023-10-08T06:57:45.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7348e-05 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.675570819000001, 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013649668, 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.014 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329039+0000", 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3030000000000001e-06 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329046+0000", 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4690000000000002e-06 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329058+0000", 2023-10-08T06:57:45.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2319e-05 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329068+0000", 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0036e-05 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329696+0000", 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062830000000000004 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329836+0000", 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000139388 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329998+0000", 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016215399999999999 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333392+0000", 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033940540000000001 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342572+0000", 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091795669999999996 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342641+0000", 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9270000000000006e-05 2023-10-08T06:57:45.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342688+0000", 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6808000000000003e-05 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:45.020 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.675252277999999, 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012619155, 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329357+0000", 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2399999999999998e-07 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329361+0000", 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2590000000000002e-06 2023-10-08T06:57:45.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329370+0000", 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9719999999999998e-06 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329377+0000", 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3790000000000003e-06 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329789+0000", 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041219999999999999 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329987+0000", 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019829299999999999 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.330264+0000", 2023-10-08T06:57:45.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027674399999999999 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333231+0000", 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029667819999999998 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341872+0000", 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086410529999999992 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341935+0000", 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2928999999999993e-05 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341976+0000", 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0920000000000001e-05 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.675084906999999, 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013179840999999999, 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:45.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2079999999999999e-06 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329532+0000", 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6359999999999997e-06 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329542+0000", 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0526000000000001e-05 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329552+0000", 2023-10-08T06:57:45.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7240000000000004e-06 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.330785+0000", 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012331690000000001 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331292+0000", 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00050700099999999998 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331437+0000", 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144893 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333557+0000", 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021202690000000001 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342585+0000", 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090282239999999996 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342659+0000", 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3082000000000003e-05 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342704+0000", 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5108999999999998e-05 2023-10-08T06:57:45.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.675039167000001, 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013211446, 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.033 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3600000000000004e-07 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329575+0000", 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7639999999999996e-06 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329583+0000", 2023-10-08T06:57:45.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9859999999999994e-06 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329591+0000", 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331450+0000", 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001859716 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331623+0000", 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017258400000000001 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332251+0000", 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062847900000000004 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333691+0000", 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439959 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342718+0000", 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090267509999999995 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342751+0000", 2023-10-08T06:57:45.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3259999999999997e-05 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342781+0000", 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9771999999999999e-05 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.675001518999998, 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012542774, 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329608+0000", 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6899999999999997e-07 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329612+0000", 2023-10-08T06:57:45.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2050000000000004e-06 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329620+0000", 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5320000000000001e-06 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329638+0000", 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8070000000000001e-05 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331274+0000", 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016366970000000001 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331385+0000", 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110227 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331541+0000", 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015609099999999999 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333590+0000", 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020487790000000001 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342030+0000", 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084407719999999992 2023-10-08T06:57:45.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342089+0000", 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8576999999999998e-05 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342150+0000", 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1155000000000007e-05 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.674955009000001, 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013190815, 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329655+0000", 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1689999999999999e-06 2023-10-08T06:57:45.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329660+0000", 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3909999999999997e-06 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329669+0000", 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7399999999999993e-06 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329680+0000", 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.132e-05 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332399+0000", 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027186649999999999 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332522+0000", 2023-10-08T06:57:45.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000123156 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332791+0000", 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026831700000000001 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.334099+0000", 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013086700000000001 2023-10-08T06:57:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342753+0000", 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086533489999999994 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342812+0000", 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9348999999999997e-05 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342845+0000", 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2688999999999998e-05 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:45.052 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.674916613000001, 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012210571999999999, 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329693+0000", 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9800000000000004e-07 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329695+0000", 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6699999999999998e-06 2023-10-08T06:57:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329702+0000", 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329707+0000", 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7810000000000002e-06 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329821+0000", 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113608 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329947+0000", 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012642 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341903+0000", 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011955245 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:3494 5.e 5:7062233b:::benchmark_data_smithi037_101035_object3493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:41.161480+0000", 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.8431282969999998, 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010198842, 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3494 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161480+0000", 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161480+0000", 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161481+0000", 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6400000000000002e-07 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161601+0000", 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120078 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161611+0000", 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0115999999999999e-05 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161617+0000", 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4609999999999999e-06 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161661+0000", 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4240000000000003e-05 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.161665+0000", 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.25e-06 2023-10-08T06:57:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.168443+0000", 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067775029999999998 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.168556+0000", 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112889 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.168694+0000", 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000138462 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.170032+0000", 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013381980000000001 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.171610+0000", 2023-10-08T06:57:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001577911 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.171646+0000", 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5741999999999998e-05 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:41.171679+0000", 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3327999999999997e-05 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15722 5.b 5:d1d0063e:::benchmark_data_smithi037_101035_object15721:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.506347+0000", 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.498261919, 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098040969999999995, 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15722 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506347+0000", 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506347+0000", 2023-10-08T06:57:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506347+0000", 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-07 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506441+0000", 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3536999999999996e-05 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506451+0000", 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0071000000000001e-05 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506457+0000", 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4219999999999997e-06 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506513+0000", 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5284999999999997e-05 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506646+0000", 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000133518 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506809+0000", 2023-10-08T06:57:45.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016295099999999999 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.513050+0000", 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006241211 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.516080+0000", 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030298650000000001 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.516116+0000", 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5336999999999997e-05 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.516151+0000", 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5318999999999998e-05 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15723 5.b 5:d046316e:::benchmark_data_smithi037_101035_object15722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.506471+0000", 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.49813752900000002, 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098128360000000001, 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15723 2023-10-08T06:57:45.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506471+0000", 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506471+0000", 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506472+0000", 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3200000000000005e-07 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506501+0000", 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9737999999999999e-05 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506509+0000", 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6170000000000001e-06 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.506515+0000", 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.682e-06 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.507458+0000", 2023-10-08T06:57:45.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00094298799999999996 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.507597+0000", 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013914 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.507738+0000", 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141507 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.513405+0000", 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056668669999999999 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.516192+0000", 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027867130000000001 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.516249+0000", 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6836000000000003e-05 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.516284+0000", 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5216000000000003e-05 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.078 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15970 5.d 5:b8e023d0:::benchmark_data_smithi037_101035_object15969:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.585152+0000", 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.41945628299999999, 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010296224, 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15970 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.079 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585152+0000", 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585152+0000", 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585153+0000", 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9800000000000003e-07 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585194+0000", 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1075999999999998e-05 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585204+0000", 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7829999999999993e-06 2023-10-08T06:57:45.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585211+0000", 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8569999999999997e-06 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585249+0000", 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8287999999999997e-05 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585340+0000", 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0532999999999995e-05 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585420+0000", 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0660000000000004e-05 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.587009+0000", 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001588147 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.595341+0000", 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0083327269999999998 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.595409+0000", 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7520000000000004e-05 2023-10-08T06:57:45.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.595449+0000", 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9935000000000003e-05 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:15972 5.d 5:b12b6ba9:::benchmark_data_smithi037_101035_object15971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.585687+0000", 2023-10-08T06:57:45.085 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.418921657, 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098426940000000008, 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15972 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585687+0000", 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585687+0000", 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585688+0000", 2023-10-08T06:57:45.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7199999999999999e-07 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585734+0000", 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5909999999999999e-05 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585742+0000", 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8470000000000002e-06 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.585747+0000", 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8230000000000002e-06 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.586198+0000", 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045116699999999999 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.586329+0000", 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013034799999999999 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.586466+0000", 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013726799999999999 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.588365+0000", 2023-10-08T06:57:45.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018991360000000001 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.595456+0000", 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070911300000000002 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.595499+0000", 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2463999999999999e-05 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.595530+0000", 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1028999999999997e-05 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:16375 5.4 5:2ae55f53:::benchmark_data_smithi037_101035_object16374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.705950+0000", 2023-10-08T06:57:45.092 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.29865836899999998, 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011546762, 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 16375 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.705950+0000", 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.705950+0000", 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.705951+0000", 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4099999999999999e-07 2023-10-08T06:57:45.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.705982+0000", 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1029999999999999e-05 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.705990+0000", 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0290000000000005e-06 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.705996+0000", 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.648e-06 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706828+0000", 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083255899999999997 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706906+0000", 2023-10-08T06:57:45.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8163000000000004e-05 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706995+0000", 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8960000000000002e-05 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.709633+0000", 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026379870000000001 2023-10-08T06:57:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717414+0000", 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077810930000000002 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717455+0000", 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717497+0000", 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2036999999999997e-05 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:16379 5.8 5:182a20f7:::benchmark_data_smithi037_101035_object16378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.706428+0000", 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.298180534, 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011107351999999999, 2023-10-08T06:57:45.099 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 16379 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706428+0000", 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706428+0000", 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706429+0000", 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4000000000000001e-07 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706492+0000", 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3351999999999999e-05 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706502+0000", 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0145e-05 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706509+0000", 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1380000000000001e-06 2023-10-08T06:57:45.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706557+0000", 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7009999999999999e-05 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706688+0000", 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013187499999999999 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706830+0000", 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141459 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.709581+0000", 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002751117 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717449+0000", 2023-10-08T06:57:45.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078680739999999992 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717501+0000", 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1919999999999998e-05 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717536+0000", 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4622000000000002e-05 2023-10-08T06:57:45.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:16376 5.a e24/20 5:569ed07d:::benchmark_data_smithi037_101035_object16375:head v 24'1002, mlcod=24'999)", 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.706832+0000", 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.297776596, 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011220568, 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706832+0000", 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706832+0000", 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706833+0000", 2023-10-08T06:57:45.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4899999999999995e-07 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706910+0000", 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7107000000000006e-05 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706918+0000", 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6719999999999993e-06 2023-10-08T06:57:45.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706923+0000", 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8899999999999998e-06 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706968+0000", 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4242000000000001e-05 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.706987+0000", 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9210000000000001e-05 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.718014+0000", 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011027322000000001 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.718053+0000", 2023-10-08T06:57:45.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8575999999999998e-05 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:16381 5.0 5:0e9a5445:::benchmark_data_smithi037_101035_object16380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.707237+0000", 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.29737154300000002, 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01038042, 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 16381 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707237+0000", 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707237+0000", 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707238+0000", 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1800000000000004e-07 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707296+0000", 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8213e-05 2023-10-08T06:57:45.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707306+0000", 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9890000000000004e-06 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707314+0000", 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2169999999999997e-06 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707603+0000", 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028914899999999999 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707732+0000", 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129527 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.707875+0000", 2023-10-08T06:57:45.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000142664 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.710323+0000", 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002448591 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717545+0000", 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0072214180000000003 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717584+0000", 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9394999999999998e-05 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.717618+0000", 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3339e-05 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:17016 5.8 5:11775096:::benchmark_data_smithi037_101035_object17015:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.910595+0000", 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.094013401999999996, 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010578933, 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 17016 2023-10-08T06:57:45.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910595+0000", 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910595+0000", 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910596+0000", 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9599999999999999e-07 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910667+0000", 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0920999999999994e-05 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910677+0000", 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0297e-05 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910684+0000", 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1010000000000003e-06 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910733+0000", 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8803e-05 2023-10-08T06:57:45.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.910889+0000", 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000155344 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.911039+0000", 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000150297 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.915948+0000", 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049091819999999998 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.921073+0000", 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0051252670000000002 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.921135+0000", 2023-10-08T06:57:45.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1811999999999997e-05 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.921174+0000", 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9212999999999999e-05 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:17096 5.b 5:d97f6988:::benchmark_data_smithi037_101035_object17095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.124 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.938842+0000", 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.065766446000000006, 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010327965, 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 17096 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.938842+0000", 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.938842+0000", 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.938843+0000", 2023-10-08T06:57:45.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2300000000000001e-07 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.938921+0000", 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7803e-05 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.938926+0000", 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.938930+0000", 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.411e-06 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.938976+0000", 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6653999999999998e-05 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939101+0000", 2023-10-08T06:57:45.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012454600000000001 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939244+0000", 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014290700000000001 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.941589+0000", 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023457040000000001 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.949070+0000", 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074808699999999997 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.949131+0000", 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0325999999999998e-05 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.949170+0000", 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9719999999999999e-05 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:17097 5.b 5:dae28dfd:::benchmark_data_smithi037_101035_object17096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:44.939192+0000", 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.065416586999999998, 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010067990000000001, 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:45.131 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 17097 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939192+0000", 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939192+0000", 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939193+0000", 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9100000000000002e-07 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:45.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939264+0000", 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0876000000000004e-05 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939275+0000", 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1399999999999999e-05 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.939283+0000", 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9119999999999998e-06 2023-10-08T06:57:45.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.940055+0000", 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077151699999999999 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.940192+0000", 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000137238 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.940334+0000", 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141514 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.942637+0000", 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023032830000000002 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.949179+0000", 2023-10-08T06:57:45.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065423169999999998 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.949222+0000", 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3198000000000002e-05 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:44.949260+0000", 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7843999999999999e-05 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.138 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:45.138 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:45.138 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:45.139 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:45.140 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:45.139+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:45.239 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:45.239+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:45.242 INFO:teuthology.orchestra.run.smithi037.stderr:set 3.a pg_upmap mapping to [1,2] 2023-10-08T06:57:45.320 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:45.320 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:45.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:18249 5.6 5:6868d305:::benchmark_data_smithi037_101035_object18248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.313937+0000", 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0053446600000000002, 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053717010000000004, 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 18249 2023-10-08T06:57:45.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.313937+0000", 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.313937+0000", 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.313937+0000", 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9100000000000004e-07 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314045+0000", 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000107965 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314058+0000", 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2897e-05 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314064+0000", 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1310000000000003e-06 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.324 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314116+0000", 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2258e-05 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314238+0000", 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000121667 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.325 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314335+0000", 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7338999999999998e-05 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.317734+0000", 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003398224 2023-10-08T06:57:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:18251 5.5 5:a1a46a59:::benchmark_data_smithi037_101035_object18250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.314075+0000", 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0052066919999999997, 2023-10-08T06:57:45.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053007840000000002, 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 18251 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314075+0000", 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314075+0000", 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314075+0000", 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314105+0000", 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0324e-05 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.331 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314113+0000", 2023-10-08T06:57:45.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9340000000000006e-06 2023-10-08T06:57:45.331 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.331 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.331 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.331 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314119+0000", 2023-10-08T06:57:45.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6169999999999998e-06 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314163+0000", 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3940999999999998e-05 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314288+0000", 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000125332 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314434+0000", 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014572000000000001 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.333 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318069+0000", 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003634829 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:18254 5.3 5:cf1131ce:::benchmark_data_smithi037_101035_object18253:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.334 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.314324+0000", 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0049576510000000004, 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0051104669999999996, 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 18254 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.336 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314324+0000", 2023-10-08T06:57:45.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.336 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.336 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.336 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.336 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314324+0000", 2023-10-08T06:57:45.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314324+0000", 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1799999999999995e-07 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314386+0000", 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2113000000000007e-05 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314392+0000", 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5040000000000002e-06 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.338 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314396+0000", 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.72e-06 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314446+0000", 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0219999999999997e-05 2023-10-08T06:57:45.339 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314576+0000", 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013055099999999999 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.314734+0000", 2023-10-08T06:57:45.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015743199999999999 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318086+0000", 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033524399999999999 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.341 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.342 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:18256 5.a 5:506d0497:::benchmark_data_smithi037_101035_object18255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.342 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.316010+0000", 2023-10-08T06:57:45.342 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.003271716, 2023-10-08T06:57:45.343 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035757639999999999, 2023-10-08T06:57:45.343 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.343 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:45.343 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.343 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.344 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.344 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 18256 2023-10-08T06:57:45.344 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.344 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.344 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.345 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.345 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316010+0000", 2023-10-08T06:57:45.345 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.345 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.345 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.346 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.346 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316010+0000", 2023-10-08T06:57:45.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.346 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.346 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.347 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316010+0000", 2023-10-08T06:57:45.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2399999999999998e-07 2023-10-08T06:57:45.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316064+0000", 2023-10-08T06:57:45.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3674999999999997e-05 2023-10-08T06:57:45.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316075+0000", 2023-10-08T06:57:45.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1422e-05 2023-10-08T06:57:45.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316080+0000", 2023-10-08T06:57:45.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7589999999999997e-06 2023-10-08T06:57:45.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316118+0000", 2023-10-08T06:57:45.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7771999999999997e-05 2023-10-08T06:57:45.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316194+0000", 2023-10-08T06:57:45.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6297000000000005e-05 2023-10-08T06:57:45.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.316273+0000", 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9145000000000002e-05 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318162+0000", 2023-10-08T06:57:45.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00188876 2023-10-08T06:57:45.353 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.353 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.353 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.353 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:18262 5.4 e25/20 5:24fdf73b:::benchmark_data_smithi037_101035_object18261:head v 25'1130, mlcod=25'1126)", 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.318490+0000", 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00079109500000000001, 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011737360000000001, 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318490+0000", 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318490+0000", 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318491+0000", 2023-10-08T06:57:45.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:57:45.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318580+0000", 2023-10-08T06:57:45.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9650999999999999e-05 2023-10-08T06:57:45.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318590+0000", 2023-10-08T06:57:45.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4169999999999998e-06 2023-10-08T06:57:45.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318599+0000", 2023-10-08T06:57:45.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9649999999999997e-06 2023-10-08T06:57:45.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318649+0000", 2023-10-08T06:57:45.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9903e-05 2023-10-08T06:57:45.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.318673+0000", 2023-10-08T06:57:45.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3998999999999998e-05 2023-10-08T06:57:45.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.360 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319639+0000", 2023-10-08T06:57:45.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00096626100000000005 2023-10-08T06:57:45.360 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.360 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.361 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.361 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:18265 5.c 5:36e6a3ab:::benchmark_data_smithi037_101035_object18264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.361 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.319505+0000", 2023-10-08T06:57:45.361 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9997764, 2023-10-08T06:57:45.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00024492300000000003, 2023-10-08T06:57:45.362 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.362 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:45.362 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.362 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 18265 2023-10-08T06:57:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319505+0000", 2023-10-08T06:57:45.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319505+0000", 2023-10-08T06:57:45.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319506+0000", 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1429999999999999e-06 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319586+0000", 2023-10-08T06:57:45.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9814000000000005e-05 2023-10-08T06:57:45.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.366 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319597+0000", 2023-10-08T06:57:45.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0635000000000001e-05 2023-10-08T06:57:45.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319604+0000", 2023-10-08T06:57:45.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4460000000000004e-06 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319648+0000", 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3930000000000001e-05 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319746+0000", 2023-10-08T06:57:45.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7910000000000003e-05 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:18266 5.a 5:5ceaccd2:::benchmark_data_smithi037_101035_object18265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.319623+0000", 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9996586, 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00022785700000000001, 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:45.369 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 18266 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319623+0000", 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319623+0000", 2023-10-08T06:57:45.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319623+0000", 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5700000000000002e-07 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319655+0000", 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1850999999999997e-05 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319663+0000", 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2930000000000001e-06 2023-10-08T06:57:45.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319670+0000", 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.302e-06 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319714+0000", 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3936000000000001e-05 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.319834+0000", 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012091600000000001 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: ], 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 7 2023-10-08T06:57:45.374 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:45.376 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 5 16 18409 18393 229.896 197.812 0.00219495 0.00434514 2023-10-08T06:57:45.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:45.374+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:45.377 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:45.476 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:45.476+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:45.561 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:45.561 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:57:45.561 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2023-10-08T06:57:45.561 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2023-10-08T06:57:45.561 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:45.574 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:45.577 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:45.577+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:45.677 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:45.677+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:45.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:57:45.760 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:45.760 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:57:45.760 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:57:45.760 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:45.760 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.760 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.760 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.427560279000001, 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012193371999999999, 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.761 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330209+0000", 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9219999999999992e-06 2023-10-08T06:57:45.762 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330217+0000", 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9049999999999997e-06 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330228+0000", 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.763 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.764 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.764 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330242+0000", 2023-10-08T06:57:45.764 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3141e-05 2023-10-08T06:57:45.764 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.764 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.764 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331761+0000", 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015191009999999999 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331881+0000", 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000120701 2023-10-08T06:57:45.765 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332370+0000", 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048859900000000004 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336444+0000", 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040740780000000001 2023-10-08T06:57:45.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342335+0000", 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058908399999999996 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.767 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342370+0000", 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4993999999999997e-05 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342393+0000", 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2736999999999999e-05 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.768 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.427494859999999, 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012275207999999999, 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.770 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2099999999999996e-07 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330270+0000", 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2509999999999996e-06 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.771 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330279+0000", 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1409999999999994e-06 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330286+0000", 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332713+0000", 2023-10-08T06:57:45.772 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024269370000000001 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332918+0000", 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020486300000000001 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333021+0000", 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001032 2023-10-08T06:57:45.773 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336451+0000", 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003429578 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342439+0000", 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059881639999999998 2023-10-08T06:57:45.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342500+0000", 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0723000000000001e-05 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342540+0000", 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9950999999999997e-05 2023-10-08T06:57:45.775 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.427403339000001, 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012552061999999999, 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.776 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:45.777 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330357+0000", 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6800000000000001e-07 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330362+0000", 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2580000000000003e-06 2023-10-08T06:57:45.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330370+0000", 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330376+0000", 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8599999999999998e-06 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334003+0000", 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003627473 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334126+0000", 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012268899999999999 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334291+0000", 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000165582 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.338174+0000", 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0038830750000000002 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342831+0000", 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0046565549999999997 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342871+0000", 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9614999999999999e-05 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342908+0000", 2023-10-08T06:57:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7703999999999997e-05 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.427332082, 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012140507, 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330428+0000", 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.44e-07 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330432+0000", 2023-10-08T06:57:45.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6270000000000002e-06 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330440+0000", 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4449999999999996e-06 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330447+0000", 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9920000000000001e-06 2023-10-08T06:57:45.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332674+0000", 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002227003 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332817+0000", 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000142385 2023-10-08T06:57:45.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342568+0000", 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0097514109999999998 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:45.788 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.427301887999999, 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012554457, 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.789 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8599999999999998e-07 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330461+0000", 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1140000000000002e-06 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330890+0000", 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042921399999999997 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330901+0000", 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0664e-05 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334897+0000", 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039962260000000003 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.335028+0000", 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013081400000000001 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.343012+0000", 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079839390000000007 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14417 5.5 5:a8532c62:::benchmark_data_smithi037_101035_object14416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.101522+0000", 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.6562378369999999, 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010672743, 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.794 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14417 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.101522+0000", 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.101522+0000", 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.101522+0000", 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7300000000000002e-07 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.101545+0000", 2023-10-08T06:57:45.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3105e-05 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.101552+0000", 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6120000000000004e-06 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.101556+0000", 2023-10-08T06:57:45.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7249999999999997e-06 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.102453+0000", 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089625000000000002 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.102541+0000", 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8188000000000003e-05 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.102628+0000", 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7146999999999998e-05 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.799 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.105974+0000", 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033462180000000002 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.112113+0000", 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006138676 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.800 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.112161+0000", 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7667999999999998e-05 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.112194+0000", 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3781000000000001e-05 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.801 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14421 5.5 5:a6068a1e:::benchmark_data_smithi037_101035_object14420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.103908+0000", 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.6538512440000002, 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011283912, 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.802 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14421 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.103908+0000", 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.103908+0000", 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.103909+0000", 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2600000000000002e-07 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104016+0000", 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010702 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104027+0000", 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0811e-05 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104034+0000", 2023-10-08T06:57:45.805 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.939e-06 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104068+0000", 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3982000000000001e-05 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104137+0000", 2023-10-08T06:57:45.806 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9386000000000003e-05 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104220+0000", 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2495000000000002e-05 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108511+0000", 2023-10-08T06:57:45.807 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0042914859999999997 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.115095+0000", 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065842490000000004 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.808 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.115153+0000", 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7538999999999999e-05 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.115192+0000", 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9279000000000001e-05 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.809 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14426 5.c 5:377a7937:::benchmark_data_smithi037_101035_object14425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.104200+0000", 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.6535590099999999, 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011007037000000001, 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.810 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14426 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104200+0000", 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104200+0000", 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104201+0000", 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104337+0000", 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013570100000000001 2023-10-08T06:57:45.812 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104346+0000", 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8519999999999993e-06 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104352+0000", 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4289999999999998e-06 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.813 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104402+0000", 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0010999999999999e-05 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104553+0000", 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015063399999999999 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.814 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.104688+0000", 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013540899999999999 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108599+0000", 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039111329999999998 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.115115+0000", 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065155129999999997 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.115171+0000", 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6270999999999997e-05 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.115208+0000", 2023-10-08T06:57:45.816 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6473999999999997e-05 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14433 5.6 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.6508552349999999, 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017532516000000001, 2023-10-08T06:57:45.817 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14433 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.818 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.819 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106905+0000", 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106971+0000", 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5945000000000006e-05 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.820 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106979+0000", 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8739999999999995e-06 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106983+0000", 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3660000000000002e-06 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.821 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107023+0000", 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9634e-05 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107137+0000", 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114747 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107229+0000", 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1775999999999997e-05 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108887+0000", 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016575100000000001 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124321+0000", 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015434128 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124374+0000", 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2899000000000003e-05 2023-10-08T06:57:45.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124437+0000", 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3016999999999997e-05 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:16376 5.a 5:569ed07d:::benchmark_data_smithi037_101035_object16375:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.706153+0000", 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.051606257, 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01210693, 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.826 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 16376 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706153+0000", 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.827 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706153+0000", 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706154+0000", 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7599999999999996e-07 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.828 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706220+0000", 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5839000000000004e-05 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706229+0000", 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4320000000000005e-06 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706236+0000", 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4409999999999998e-06 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706524+0000", 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00028784299999999997 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706622+0000", 2023-10-08T06:57:45.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8397e-05 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706715+0000", 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2831999999999995e-05 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.709287+0000", 2023-10-08T06:57:45.831 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002571851 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.718198+0000", 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0089114610000000007 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.718236+0000", 2023-10-08T06:57:45.832 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8287000000000001e-05 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.718260+0000", 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3771e-05 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.833 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:16982 5.c 5:3accd78e:::benchmark_data_smithi037_101035_object16981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.896118+0000", 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.86164168200000002, 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010928807, 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.834 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 16982 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896118+0000", 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.835 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896118+0000", 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896119+0000", 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.23e-07 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896229+0000", 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000110207 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896236+0000", 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896241+0000", 2023-10-08T06:57:45.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0300000000000001e-06 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896283+0000", 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2296999999999998e-05 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896380+0000", 2023-10-08T06:57:45.838 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6402000000000003e-05 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.896524+0000", 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014465100000000001 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.839 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.903327+0000", 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068024080000000002 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.906973+0000", 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036465999999999998 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.907023+0000", 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9966999999999998e-05 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.907047+0000", 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3374999999999999e-05 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:18138 5.b e25/20 5:d5d1e877:::benchmark_data_smithi037_101035_object18137:head v 25'1136, mlcod=25'1133)", 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.273812+0000", 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.48394726799999999, 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010380453, 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.273812+0000", 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.273812+0000", 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.273813+0000", 2023-10-08T06:57:45.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.51e-07 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.273991+0000", 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000178312 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.274000+0000", 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8489999999999995e-06 2023-10-08T06:57:45.844 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.274007+0000", 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1029999999999996e-06 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.274689+0000", 2023-10-08T06:57:45.845 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00068191900000000001 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.274706+0000", 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.702e-05 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.284157+0000", 2023-10-08T06:57:45.846 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094511270000000001 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.284193+0000", 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5571999999999998e-05 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.847 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19485 5.c 5:31c60dc6:::benchmark_data_smithi037_101035_object19484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.044944014999999997, 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014907449999999999, 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19485 2023-10-08T06:57:45.848 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.849 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712816+0000", 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3399999999999998e-07 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.850 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712854+0000", 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7591e-05 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712862+0000", 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4309999999999994e-06 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712869+0000", 2023-10-08T06:57:45.851 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3520000000000003e-06 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.714984+0000", 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002115638 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715161+0000", 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017632800000000001 2023-10-08T06:57:45.852 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715296+0000", 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013528300000000001 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718545+0000", 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032489569999999998 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.853 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727623+0000", 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0090785859999999996 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727684+0000", 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0278999999999997e-05 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.854 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727723+0000", 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9270999999999997e-05 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19486 5.c 5:3f8361ed:::benchmark_data_smithi037_101035_object19485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:45.855 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.044877403000000003, 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014972698, 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19486 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.857 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712883+0000", 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712916+0000", 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3052999999999997e-05 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.858 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712925+0000", 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.38e-06 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712931+0000", 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0240000000000003e-06 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716123+0000", 2023-10-08T06:57:45.859 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031922399999999998 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716228+0000", 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010487 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716365+0000", 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000136303 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.860 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718584+0000", 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022193239999999999 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727789+0000", 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092049030000000004 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.861 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727822+0000", 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2848999999999997e-05 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727855+0000", 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3160000000000001e-05 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.862 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:19492 5.4 e25/20 5:20e452e2:::benchmark_data_smithi037_101035_object19491:head v 25'1194, mlcod=25'1190)", 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.715449+0000", 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.042310501, 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012321818, 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715449+0000", 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715449+0000", 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715450+0000", 2023-10-08T06:57:45.864 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9400000000000005e-07 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715538+0000", 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8302999999999998e-05 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.865 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715546+0000", 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3289999999999994e-06 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715553+0000", 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5849999999999996e-06 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716076+0000", 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00052322299999999996 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716094+0000", 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7813999999999999e-05 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727730+0000", 2023-10-08T06:57:45.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011636374 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727771+0000", 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0496e-05 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.868 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19500 5.c 5:37b53ca0:::benchmark_data_smithi037_101035_object19499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.716221+0000", 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.041538074000000001, 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012167575, 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19500 2023-10-08T06:57:45.869 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716221+0000", 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716221+0000", 2023-10-08T06:57:45.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716222+0000", 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6899999999999998e-07 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716254+0000", 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2122000000000002e-05 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716261+0000", 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8589999999999999e-06 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716266+0000", 2023-10-08T06:57:45.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2279999999999998e-06 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718616+0000", 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002349819 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718736+0000", 2023-10-08T06:57:45.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000119919 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718906+0000", 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016982499999999999 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727752+0000", 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088460899999999992 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728317+0000", 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00056571900000000001 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728355+0000", 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7234000000000003e-05 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728389+0000", 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4291000000000001e-05 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.877 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19501 5.a 5:53347358:::benchmark_data_smithi037_101035_object19500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.877 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.716273+0000", 2023-10-08T06:57:45.877 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.041486426, 2023-10-08T06:57:45.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01178092, 2023-10-08T06:57:45.878 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.878 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.878 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.878 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19501 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716273+0000", 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716273+0000", 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716273+0000", 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9099999999999999e-07 2023-10-08T06:57:45.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.881 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.881 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.881 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716305+0000", 2023-10-08T06:57:45.881 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1176000000000001e-05 2023-10-08T06:57:45.881 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.881 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.882 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716311+0000", 2023-10-08T06:57:45.882 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5189999999999998e-06 2023-10-08T06:57:45.882 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.882 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.882 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716317+0000", 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7440000000000004e-06 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717288+0000", 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00097132200000000005 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.884 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717415+0000", 2023-10-08T06:57:45.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012698700000000001 2023-10-08T06:57:45.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:45.884 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717551+0000", 2023-10-08T06:57:45.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013558900000000001 2023-10-08T06:57:45.885 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.885 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.885 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.885 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727601+0000", 2023-10-08T06:57:45.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010049788 2023-10-08T06:57:45.885 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727972+0000", 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037114500000000003 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728020+0000", 2023-10-08T06:57:45.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8248999999999998e-05 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728054+0000", 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4010000000000001e-05 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19502 5.c 5:3037d788:::benchmark_data_smithi037_101035_object19501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.041432812999999999, 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012270903999999999, 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:45.888 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19502 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0800000000000005e-07 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716400+0000", 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2807999999999998e-05 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716407+0000", 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3220000000000004e-06 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716417+0000", 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6059999999999992e-06 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.719792+0000", 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033753569999999998 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.719888+0000", 2023-10-08T06:57:45.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5785000000000005e-05 2023-10-08T06:57:45.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.893 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:45.893 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.720033+0000", 2023-10-08T06:57:45.893 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014530000000000001 2023-10-08T06:57:45.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727772+0000", 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077390330000000002 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728519+0000", 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00074656500000000003 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728566+0000", 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6734999999999999e-05 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728598+0000", 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1884999999999997e-05 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.895 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:19493 5.4 e25/20 5:2e527024:::benchmark_data_smithi037_101035_object19492:head v 25'1195, mlcod=25'1190)", 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.716342+0000", 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.041417163999999999, 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011639105, 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.896 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716342+0000", 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716342+0000", 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716343+0000", 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0499999999999999e-07 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716470+0000", 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000127372 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716477+0000", 2023-10-08T06:57:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7229999999999998e-06 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716482+0000", 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9919999999999998e-06 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717793+0000", 2023-10-08T06:57:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0013108519999999999 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717812+0000", 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9372e-05 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727953+0000", 2023-10-08T06:57:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010140968 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727981+0000", 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8521e-05 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:19503 5.0 e25/20 5:0c097611:::benchmark_data_smithi037_101035_object19502:head v 25'1162, mlcod=25'1160)", 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.717700+0000", 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.040059309000000001, 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010285786, 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:45.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717700+0000", 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717700+0000", 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.903 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717701+0000", 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8699999999999995e-07 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717749+0000", 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7856999999999999e-05 2023-10-08T06:57:45.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717758+0000", 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8890000000000008e-06 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717764+0000", 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9020000000000002e-06 2023-10-08T06:57:45.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717810+0000", 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5182000000000002e-05 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.717832+0000", 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2055000000000001e-05 2023-10-08T06:57:45.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727939+0000", 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010107494 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727986+0000", 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6820000000000002e-05 2023-10-08T06:57:45.907 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.908 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.908 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.908 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:45.908 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:45.908 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:45.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:45.908+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:45.910 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:45.910 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:45.910 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:45.911 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:57:45.911 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:57:45.911 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:57:45.911 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:46.010 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:46.009+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:46.080 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:46.080 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:46.095 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:46.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:46.138+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:46.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:57:46.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:46.210+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:46.267 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:46.267 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:46.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:46.313 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:46.312+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:46.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 6 16 21445 21429 223.203 189.75 0.00554839 0.00447674 2023-10-08T06:57:46.413 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:46.413+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:46.496 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:46.510 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:46.514 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:46.513+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:46.614 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:46.614+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:46.680 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:46.680 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:46.693 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:46.734 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:46.734+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:46.816 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:46.816+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:46.909 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:46.909 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:46.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:46.916+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:46.924 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:47.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:47.017+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:47.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:47.118+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:47.133 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:47.134 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:47.147 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:47.220 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:47.221+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:47.252 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:57:47.321 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:47.321+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:47.328 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:47.328 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:47.345 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:47.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 7 16 24382 24366 217.537 183.562 0.0079092 0.00459346 2023-10-08T06:57:47.423 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:47.423+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:47.523 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:47.524+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:47.562 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:47.563 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:47.578 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:47.624 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:47.624+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:47.724 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:47.725+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:47.766 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:47.766 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:47.779 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:47.826 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:47.826+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:47.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:57:47.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:47.926+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:47.948 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:47.948 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:47.963 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:48.028 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:48.028+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:48.076 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:48.095 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:48.115 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:48.116 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:57:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:57:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:57:48.129 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:48.128+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:48.181 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:57:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:57:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:57:48.182 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:48.196 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:48.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:48.239+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:48.330 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:48.330+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:48.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 8 16 27278 27262 212.968 181 0.00365909 0.00469215 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.742214900999997, 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011390189, 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 138 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620638+0000", 2023-10-08T06:57:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620642+0000", 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.172e-06 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620646+0000", 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6380000000000002e-06 2023-10-08T06:57:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620648+0000", 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6199999999999999e-06 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625513+0000", 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004864635 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625565+0000", 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1842000000000003e-05 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.625656+0000", 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0928999999999996e-05 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.629969+0000", 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043131350000000001 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.631936+0000", 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019671889999999998 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.631991+0000", 2023-10-08T06:57:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5226999999999998e-05 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632028+0000", 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6480000000000003e-05 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.742198485999999, 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011461148000000001, 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 139 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620654+0000", 2023-10-08T06:57:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5800000000000001e-07 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620657+0000", 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7180000000000001e-06 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620661+0000", 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5640000000000001e-06 2023-10-08T06:57:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620663+0000", 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6079999999999998e-06 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626056+0000", 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053925049999999997 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626104+0000", 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8486999999999998e-05 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626179+0000", 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4725e-05 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.629972+0000", 2023-10-08T06:57:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037933670000000002 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632060+0000", 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020872460000000001 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632093+0000", 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3314e-05 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632115+0000", 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2356000000000001e-05 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.742136913000003, 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011776666999999999, 2023-10-08T06:57:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 140 2023-10-08T06:57:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6199999999999999e-07 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620788+0000", 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2639999999999996e-05 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620793+0000", 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9629999999999997e-06 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620796+0000", 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0359999999999998e-06 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626432+0000", 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056358270000000004 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626511+0000", 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8640999999999995e-05 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626653+0000", 2023-10-08T06:57:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014228600000000001 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632155+0000", 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055017809999999999 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632438+0000", 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028323999999999998 2023-10-08T06:57:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632471+0000", 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2484999999999998e-05 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632492+0000", 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1506e-05 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.742050274999997, 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013962354, 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 141 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620803+0000", 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7000000000000001e-07 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620806+0000", 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.676e-06 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620810+0000", 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.647e-06 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620812+0000", 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5019999999999999e-06 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627179+0000", 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0063668500000000003 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627272+0000", 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3276000000000006e-05 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627404+0000", 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131428 2023-10-08T06:57:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632498+0000", 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005094164 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634675+0000", 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021769570000000002 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634731+0000", 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6144999999999999e-05 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634765+0000", 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3439000000000003e-05 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.611161799000001, 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011009055, 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 164 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751691+0000", 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3200000000000001e-07 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751760+0000", 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9245999999999994e-05 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751767+0000", 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5740000000000001e-06 2023-10-08T06:57:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751770+0000", 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3270000000000001e-06 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.756961+0000", 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051907580000000002 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757016+0000", 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5041999999999999e-05 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757109+0000", 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3183999999999994e-05 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.761179+0000", 2023-10-08T06:57:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040696949999999999 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762655+0000", 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001476045 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762682+0000", 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6948999999999999e-05 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762700+0000", 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8003e-05 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.611076881000002, 2023-10-08T06:57:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010965292, 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 165 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751776+0000", 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4400000000000001e-07 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751778+0000", 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0150000000000002e-06 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751781+0000", 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.433e-06 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.751784+0000", 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757514+0000", 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00572983 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757591+0000", 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6790000000000002e-05 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.757698+0000", 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010757899999999999 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.761205+0000", 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003506866 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762703+0000", 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001497998 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762724+0000", 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0818e-05 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.762741+0000", 2023-10-08T06:57:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6935999999999998e-05 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.030099923000002, 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01058655, 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332753+0000", 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332754+0000", 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.097e-06 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.332760+0000", 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8459999999999996e-06 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333028+0000", 2023-10-08T06:57:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026832499999999998 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333042+0000", 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3706000000000001e-05 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337211+0000", 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041694540000000004 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337302+0000", 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1018000000000002e-05 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.337439+0000", 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013716100000000001 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342181+0000", 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047421140000000004 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343237+0000", 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001055467 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343294+0000", 2023-10-08T06:57:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7132999999999997e-05 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343339+0000", 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5228999999999997e-05 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.029794381999999, 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0105679, 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333058+0000", 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333059+0000", 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6700000000000002e-07 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333064+0000", 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3730000000000001e-06 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333083+0000", 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8414999999999999e-05 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333089+0000", 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6649999999999997e-06 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338347+0000", 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052580420000000001 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338475+0000", 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000127126 2023-10-08T06:57:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.338606+0000", 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131839 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342403+0000", 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037962629999999998 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343515+0000", 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011117939999999999 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343580+0000", 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5961000000000001e-05 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343626+0000", 2023-10-08T06:57:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5555e-05 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.029751950000001, 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010644859, 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333101+0000", 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8800000000000002e-07 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333108+0000", 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7170000000000002e-06 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333117+0000", 2023-10-08T06:57:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.431e-06 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333124+0000", 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9909999999999996e-06 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339316+0000", 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061920350000000002 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339422+0000", 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105944 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.339605+0000", 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018256300000000001 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342597+0000", 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029923630000000001 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343671+0000", 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001073875 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343707+0000", 2023-10-08T06:57:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5989999999999999e-05 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343745+0000", 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8262000000000001e-05 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.029712232000001, 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010707638, 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333140+0000", 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333141+0000", 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7800000000000001e-07 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333145+0000", 2023-10-08T06:57:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.811e-06 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333152+0000", 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0979999999999996e-06 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333159+0000", 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7970000000000003e-06 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340436+0000", 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0072776949999999998 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340523+0000", 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7148e-05 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340623+0000", 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9544999999999996e-05 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342810+0000", 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021866170000000001 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343777+0000", 2023-10-08T06:57:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00096742699999999998 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343823+0000", 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5569999999999999e-05 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343848+0000", 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5352000000000001e-05 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.029605904, 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010728084000000001, 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333247+0000", 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7700000000000004e-07 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333252+0000", 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3290000000000004e-06 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333259+0000", 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9070000000000007e-06 2023-10-08T06:57:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.333265+0000", 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9730000000000002e-06 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.340906+0000", 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076407360000000004 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341004+0000", 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8303999999999999e-05 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.341164+0000", 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015931699999999999 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.342869+0000", 2023-10-08T06:57:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001705008 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343909+0000", 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001040469 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343950+0000", 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0645000000000001e-05 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:17.343975+0000", 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4819000000000001e-05 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13069 5.1 5:88cd8266:::benchmark_data_smithi037_101035_object13068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.6637252289999998, 2023-10-08T06:57:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013921543999999999, 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13069 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699128+0000", 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699202+0000", 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4029999999999994e-05 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699211+0000", 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5620000000000004e-06 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699218+0000", 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7660000000000001e-06 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699268+0000", 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0173999999999998e-05 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699381+0000", 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113522 2023-10-08T06:57:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699486+0000", 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010518699999999999 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704026+0000", 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045396569999999999 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.712963+0000", 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089374120000000005 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713016+0000", 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2243000000000001e-05 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713049+0000", 2023-10-08T06:57:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3096000000000003e-05 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13071 5.1 5:8cd03df6:::benchmark_data_smithi037_101035_object13070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.6635936210000004, 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013866906, 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13071 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3599999999999999e-07 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699354+0000", 2023-10-08T06:57:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4691999999999994e-05 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699360+0000", 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9159999999999998e-06 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699364+0000", 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0069999999999999e-06 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700173+0000", 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00080942500000000001 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700294+0000", 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012094 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700392+0000", 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7575e-05 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704069+0000", 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036775950000000001 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713055+0000", 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089859989999999997 2023-10-08T06:57:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713098+0000", 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2211e-05 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713126+0000", 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.811e-05 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:14295 5.1 5:848f3e80:::benchmark_data_smithi037_101035_object14294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.3003659110000001, 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012720018, 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 14295 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8899999999999999e-07 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062614+0000", 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126389 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062623+0000", 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5480000000000007e-06 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062630+0000", 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8109999999999997e-06 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063015+0000", 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000385184 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063168+0000", 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015317999999999999 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063310+0000", 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014111700000000001 2023-10-08T06:57:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.067609+0000", 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042993060000000001 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075113+0000", 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0075037150000000002 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075165+0000", 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2695999999999998e-05 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075207+0000", 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1383e-05 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14421 5.5 e23/20 5:a6068a1e:::benchmark_data_smithi037_101035_object14420:head v 23'851, mlcod=23'847)", 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.2585556889999996, 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010677636000000001, 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104297+0000", 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104360+0000", 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2458000000000004e-05 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104369+0000", 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7509999999999997e-06 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.104376+0000", 2023-10-08T06:57:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9399999999999996e-06 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.105942+0000", 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001566581 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.105963+0000", 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1189e-05 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.114934+0000", 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089708719999999995 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.114974+0000", 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0256000000000002e-05 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.2555518110000001, 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:57:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:57:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:15041 5.9 5:96019209:::benchmark_data_smithi037_101035_object15040:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.298869+0000", 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0639836899999997, 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011696735999999999, 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 15041 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.298869+0000", 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.298869+0000", 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.298869+0000", 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8200000000000001e-07 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.298910+0000", 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0309000000000003e-05 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.298914+0000", 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7090000000000001e-06 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.298918+0000", 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3969999999999998e-06 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.302112+0000", 2023-10-08T06:57:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031944 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.302253+0000", 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140808 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.302400+0000", 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014688200000000001 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.310071+0000", 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.007671214 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.310502+0000", 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00043058000000000001 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.310540+0000", 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8738000000000001e-05 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.310566+0000", 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5316999999999998e-05 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:18187 5.f 5:f96864ac:::benchmark_data_smithi037_101035_object18186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:48.477 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:45.291512+0000", 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.0713402489999999, 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010485059, 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 18187 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.291512+0000", 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.291512+0000", 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.291513+0000", 2023-10-08T06:57:48.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-07 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.291560+0000", 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7077999999999999e-05 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.291566+0000", 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5100000000000004e-06 2023-10-08T06:57:48.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.291569+0000", 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3349999999999998e-06 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.295521+0000", 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039516610000000004 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.295628+0000", 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000106947 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.295729+0000", 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000100645 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.299354+0000", 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036257049999999999 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.301943+0000", 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025890230000000002 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.301976+0000", 2023-10-08T06:57:48.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2969999999999998e-05 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:45.301997+0000", 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0874999999999999e-05 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:26900 5.3 e27/20 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head v 27'1703, mlcod=27'1700)", 2023-10-08T06:57:48.484 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.13422276399999999, 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016375165000000001, 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6699999999999999e-07 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228688+0000", 2023-10-08T06:57:48.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8009e-05 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228694+0000", 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3690000000000003e-06 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228705+0000", 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0019e-05 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228746+0000", 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1140000000000003e-05 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228766+0000", 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0310999999999999e-05 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.244952+0000", 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016186158999999999 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245005+0000", 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2791000000000003e-05 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:26906 5.3 e27/20 5:c1cb740d:::benchmark_data_smithi037_101035_object26905:head v 27'1704, mlcod=27'1701)", 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.231381+0000", 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.131471279, 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013662163999999999, 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231381+0000", 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231381+0000", 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231382+0000", 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7199999999999999e-07 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:48.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231432+0000", 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0445999999999998e-05 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231441+0000", 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8519999999999993e-06 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231448+0000", 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4939999999999997e-06 2023-10-08T06:57:48.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231491+0000", 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2814e-05 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231507+0000", 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5248e-05 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245009+0000", 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013502310999999999 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245043+0000", 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4527000000000003e-05 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:48.494 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:48.495 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:48.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:48.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:48.495+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:48.597 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:48.597+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28116 5.8 5:1f98c93f:::benchmark_data_smithi037_101035_object28115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.659344+0000", 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0023575480000000001, 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023787959999999999, 2023-10-08T06:57:48.662 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:48.663 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:48.663 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:48.663 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:48.663 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:48.663 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28116 2023-10-08T06:57:48.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.663 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:48.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:48.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659344+0000", 2023-10-08T06:57:48.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:48.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659344+0000", 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659345+0000", 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0729999999999999e-06 2023-10-08T06:57:48.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659431+0000", 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6773000000000004e-05 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659441+0000", 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4509999999999998e-06 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659447+0000", 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9340000000000003e-06 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659494+0000", 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6910999999999999e-05 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659620+0000", 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012601100000000001 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.659741+0000", 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012142300000000001 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.661015+0000", 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012740379999999999 2023-10-08T06:57:48.668 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:48.669 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:48.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:48.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:48.669 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:57:48.669 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 1 2023-10-08T06:57:48.669 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:48.677 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:48.721 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:48.721+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:48.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:48.798+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:48.851 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:48.851 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:57:48.851 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:57:48.851 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:57:48.851 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:48.864 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:48.905 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:48.905+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:49.001 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:49.001+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:49.078 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:57:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:57:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.747577502999999, 2023-10-08T06:57:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013838266, 2023-10-08T06:57:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328375+0000", 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.843e-06 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328384+0000", 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5669999999999995e-06 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328397+0000", 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2925000000000001e-05 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328411+0000", 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.454e-05 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001114128 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329709+0000", 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018355199999999999 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329888+0000", 2023-10-08T06:57:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179576 2023-10-08T06:57:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332277+0000", 2023-10-08T06:57:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023889419999999998 2023-10-08T06:57:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342081+0000", 2023-10-08T06:57:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098036779999999997 2023-10-08T06:57:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342151+0000", 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0166999999999994e-05 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342208+0000", 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7348e-05 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.746909753000001, 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013649668, 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329039+0000", 2023-10-08T06:57:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3030000000000001e-06 2023-10-08T06:57:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329046+0000", 2023-10-08T06:57:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4690000000000002e-06 2023-10-08T06:57:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329058+0000", 2023-10-08T06:57:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2319e-05 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329068+0000", 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0036e-05 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329696+0000", 2023-10-08T06:57:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062830000000000004 2023-10-08T06:57:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329836+0000", 2023-10-08T06:57:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000139388 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329998+0000", 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016215399999999999 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333392+0000", 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033940540000000001 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342572+0000", 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091795669999999996 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342641+0000", 2023-10-08T06:57:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9270000000000006e-05 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342688+0000", 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6808000000000003e-05 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.746591211999998, 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012619155, 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329356+0000", 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329357+0000", 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2399999999999998e-07 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329361+0000", 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2590000000000002e-06 2023-10-08T06:57:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329370+0000", 2023-10-08T06:57:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9719999999999998e-06 2023-10-08T06:57:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329377+0000", 2023-10-08T06:57:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3790000000000003e-06 2023-10-08T06:57:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329789+0000", 2023-10-08T06:57:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041219999999999999 2023-10-08T06:57:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329987+0000", 2023-10-08T06:57:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019829299999999999 2023-10-08T06:57:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.330264+0000", 2023-10-08T06:57:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027674399999999999 2023-10-08T06:57:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333231+0000", 2023-10-08T06:57:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029667819999999998 2023-10-08T06:57:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341872+0000", 2023-10-08T06:57:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086410529999999992 2023-10-08T06:57:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341935+0000", 2023-10-08T06:57:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2928999999999993e-05 2023-10-08T06:57:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341976+0000", 2023-10-08T06:57:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0920000000000001e-05 2023-10-08T06:57:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.746423840999999, 2023-10-08T06:57:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013179840999999999, 2023-10-08T06:57:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329524+0000", 2023-10-08T06:57:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2079999999999999e-06 2023-10-08T06:57:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329532+0000", 2023-10-08T06:57:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6359999999999997e-06 2023-10-08T06:57:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329542+0000", 2023-10-08T06:57:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0526000000000001e-05 2023-10-08T06:57:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329552+0000", 2023-10-08T06:57:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7240000000000004e-06 2023-10-08T06:57:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.330785+0000", 2023-10-08T06:57:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012331690000000001 2023-10-08T06:57:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331292+0000", 2023-10-08T06:57:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00050700099999999998 2023-10-08T06:57:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331437+0000", 2023-10-08T06:57:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144893 2023-10-08T06:57:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333557+0000", 2023-10-08T06:57:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021202690000000001 2023-10-08T06:57:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342585+0000", 2023-10-08T06:57:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090282239999999996 2023-10-08T06:57:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342659+0000", 2023-10-08T06:57:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3082000000000003e-05 2023-10-08T06:57:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342704+0000", 2023-10-08T06:57:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5108999999999998e-05 2023-10-08T06:57:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.746378101000001, 2023-10-08T06:57:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013211446, 2023-10-08T06:57:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329570+0000", 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3600000000000004e-07 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329575+0000", 2023-10-08T06:57:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7639999999999996e-06 2023-10-08T06:57:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329583+0000", 2023-10-08T06:57:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9859999999999994e-06 2023-10-08T06:57:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329591+0000", 2023-10-08T06:57:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:57:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331450+0000", 2023-10-08T06:57:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001859716 2023-10-08T06:57:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331623+0000", 2023-10-08T06:57:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017258400000000001 2023-10-08T06:57:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332251+0000", 2023-10-08T06:57:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062847900000000004 2023-10-08T06:57:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333691+0000", 2023-10-08T06:57:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439959 2023-10-08T06:57:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342718+0000", 2023-10-08T06:57:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090267509999999995 2023-10-08T06:57:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342751+0000", 2023-10-08T06:57:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3259999999999997e-05 2023-10-08T06:57:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342781+0000", 2023-10-08T06:57:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9771999999999999e-05 2023-10-08T06:57:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.746340452999998, 2023-10-08T06:57:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012542774, 2023-10-08T06:57:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329607+0000", 2023-10-08T06:57:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329608+0000", 2023-10-08T06:57:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6899999999999997e-07 2023-10-08T06:57:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329612+0000", 2023-10-08T06:57:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2050000000000004e-06 2023-10-08T06:57:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329620+0000", 2023-10-08T06:57:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5320000000000001e-06 2023-10-08T06:57:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329638+0000", 2023-10-08T06:57:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8070000000000001e-05 2023-10-08T06:57:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331274+0000", 2023-10-08T06:57:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016366970000000001 2023-10-08T06:57:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331385+0000", 2023-10-08T06:57:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110227 2023-10-08T06:57:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.331541+0000", 2023-10-08T06:57:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015609099999999999 2023-10-08T06:57:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333590+0000", 2023-10-08T06:57:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020487790000000001 2023-10-08T06:57:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342030+0000", 2023-10-08T06:57:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084407719999999992 2023-10-08T06:57:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342089+0000", 2023-10-08T06:57:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8576999999999998e-05 2023-10-08T06:57:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342150+0000", 2023-10-08T06:57:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1155000000000007e-05 2023-10-08T06:57:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.746293943000001, 2023-10-08T06:57:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013190815, 2023-10-08T06:57:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329654+0000", 2023-10-08T06:57:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329655+0000", 2023-10-08T06:57:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1689999999999999e-06 2023-10-08T06:57:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329660+0000", 2023-10-08T06:57:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3909999999999997e-06 2023-10-08T06:57:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329669+0000", 2023-10-08T06:57:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7399999999999993e-06 2023-10-08T06:57:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329680+0000", 2023-10-08T06:57:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.132e-05 2023-10-08T06:57:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332399+0000", 2023-10-08T06:57:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027186649999999999 2023-10-08T06:57:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332522+0000", 2023-10-08T06:57:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000123156 2023-10-08T06:57:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332791+0000", 2023-10-08T06:57:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026831700000000001 2023-10-08T06:57:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.334099+0000", 2023-10-08T06:57:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013086700000000001 2023-10-08T06:57:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342753+0000", 2023-10-08T06:57:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086533489999999994 2023-10-08T06:57:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342812+0000", 2023-10-08T06:57:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9348999999999997e-05 2023-10-08T06:57:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342845+0000", 2023-10-08T06:57:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2688999999999998e-05 2023-10-08T06:57:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.746255547000001, 2023-10-08T06:57:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012210571999999999, 2023-10-08T06:57:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:57:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329692+0000", 2023-10-08T06:57:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329693+0000", 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9800000000000004e-07 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329695+0000", 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6699999999999998e-06 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329702+0000", 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329707+0000", 2023-10-08T06:57:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7810000000000002e-06 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329821+0000", 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113608 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329947+0000", 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012642 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.341903+0000", 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011955245 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:19492 5.4 5:20e452e2:::benchmark_data_smithi037_101035_object19491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:45.715031+0000", 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.3609167900000001, 2023-10-08T06:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012977295, 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 19492 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715031+0000", 2023-10-08T06:57:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715031+0000", 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715032+0000", 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.33e-07 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715088+0000", 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6446999999999997e-05 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715100+0000", 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1769e-05 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715109+0000", 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6889999999999993e-06 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715164+0000", 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4950000000000001e-05 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715252+0000", 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8517000000000006e-05 2023-10-08T06:57:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715353+0000", 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100431 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.717059+0000", 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00170597 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.727912+0000", 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010853107000000001 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.727971+0000", 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9106e-05 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.728008+0000", 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7376000000000003e-05 2023-10-08T06:57:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:19493 5.4 5:2e527024:::benchmark_data_smithi037_101035_object19492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:45.715321+0000", 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.3606271400000001, 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01281347, 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 19493 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715321+0000", 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715321+0000", 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715321+0000", 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4e-07 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715373+0000", 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1035999999999997e-05 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715381+0000", 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9039999999999998e-06 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715389+0000", 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2590000000000003e-06 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.715953+0000", 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00056424100000000005 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.716080+0000", 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012677899999999999 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.716235+0000", 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000155539 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.717507+0000", 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012714639999999999 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.728061+0000", 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01055411 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.728105+0000", 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3816999999999997e-05 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:45.728134+0000", 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9380999999999999e-05 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:27851 5.b 5:d5f0ff2a:::benchmark_data_smithi037_101035_object27850:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.563133+0000", 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.51281495200000005, 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012826156999999999, 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 27851 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.563133+0000", 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.563133+0000", 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.563133+0000", 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9100000000000004e-07 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.563159+0000", 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5199999999999999e-05 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.563166+0000", 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1189999999999999e-06 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.563171+0000", 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0119999999999996e-06 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.565579+0000", 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024078490000000001 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.565691+0000", 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011293099999999999 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.565832+0000", 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014076 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.569946+0000", 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041133869999999996 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.575877+0000", 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059312569999999997 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.575935+0000", 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8131999999999998e-05 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.575959+0000", 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3918999999999999e-05 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.21073033599999999, 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:57:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:57:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.20829558000000001, 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:57:49.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.20802211700000001, 2023-10-08T06:57:49.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:49.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:57:49.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.207882346, 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:57:49.208 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:57:49.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:57:49.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.214 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.207795491, 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:49.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:57:49.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.207734583, 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.222 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:57:49.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:57:49.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.207625385, 2023-10-08T06:57:49.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:49.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:57:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:57:49.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.205029827, 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:57:49.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:57:49.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.20245307900000001, 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:57:49.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:49.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:49.247 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:49.247 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:49.248 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:49.248 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:49.248+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:49.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:57:49.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:49.347+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:49.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 9 16 30007 29991 208.256 170.562 0.00448668 0.00479687 2023-10-08T06:57:49.433 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:49.433 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:49.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.434 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30180 5.6 5:60394faf:::benchmark_data_smithi037_101035_object30179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.434 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.425211+0000", 2023-10-08T06:57:49.434 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0069185339999999996, 2023-10-08T06:57:49.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006939003, 2023-10-08T06:57:49.435 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.435 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:49.435 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:49.435 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:49.435 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.436 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30180 2023-10-08T06:57:49.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.436 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.437 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425211+0000", 2023-10-08T06:57:49.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.438 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425211+0000", 2023-10-08T06:57:49.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.439 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.439 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425212+0000", 2023-10-08T06:57:49.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2500000000000001e-07 2023-10-08T06:57:49.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.440 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425378+0000", 2023-10-08T06:57:49.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016637999999999999 2023-10-08T06:57:49.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425387+0000", 2023-10-08T06:57:49.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1169999999999993e-06 2023-10-08T06:57:49.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425391+0000", 2023-10-08T06:57:49.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0080000000000004e-06 2023-10-08T06:57:49.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.426404+0000", 2023-10-08T06:57:49.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010127179999999999 2023-10-08T06:57:49.444 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.444 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.444 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.426566+0000", 2023-10-08T06:57:49.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000161566 2023-10-08T06:57:49.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.426756+0000", 2023-10-08T06:57:49.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00019028200000000001 2023-10-08T06:57:49.446 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.446 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.446 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.447 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30183 5.6 5:697a35c4:::benchmark_data_smithi037_101035_object30182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.447 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.425419+0000", 2023-10-08T06:57:49.447 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0067108630000000001, 2023-10-08T06:57:49.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067826900000000001, 2023-10-08T06:57:49.448 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.448 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:49.448 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:49.448 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:49.449 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.449 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30183 2023-10-08T06:57:49.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.449 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425419+0000", 2023-10-08T06:57:49.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425419+0000", 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425419+0000", 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6300000000000001e-07 2023-10-08T06:57:49.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425497+0000", 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7788999999999997e-05 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425502+0000", 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9400000000000001e-06 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.425507+0000", 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1699999999999996e-06 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427790+0000", 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022828079999999999 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427885+0000", 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4817999999999999e-05 2023-10-08T06:57:49.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427973+0000", 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8295999999999996e-05 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30185 5.e e27/20 5:735b3ec7:::benchmark_data_smithi037_101035_object30184:head v 27'1910, mlcod=27'1908)", 2023-10-08T06:57:49.454 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.427847+0000", 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.004283401, 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0044002260000000001, 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427847+0000", 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427847+0000", 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427847+0000", 2023-10-08T06:57:49.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4899999999999995e-07 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427900+0000", 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3177000000000003e-05 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427906+0000", 2023-10-08T06:57:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0680000000000002e-06 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427911+0000", 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9049999999999996e-06 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427955+0000", 2023-10-08T06:57:49.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4094000000000002e-05 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.427979+0000", 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3224e-05 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30187 5.1 e27/20 5:8cfbd7bd:::benchmark_data_smithi037_101035_object30186:head v 27'1868, mlcod=27'1865)", 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.428271+0000", 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0038586760000000001, 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040110880000000003, 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428271+0000", 2023-10-08T06:57:49.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428271+0000", 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428272+0000", 2023-10-08T06:57:49.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7999999999999995e-07 2023-10-08T06:57:49.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428374+0000", 2023-10-08T06:57:49.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000101567 2023-10-08T06:57:49.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428385+0000", 2023-10-08T06:57:49.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1572e-05 2023-10-08T06:57:49.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428394+0000", 2023-10-08T06:57:49.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9590000000000001e-06 2023-10-08T06:57:49.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428442+0000", 2023-10-08T06:57:49.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8328000000000002e-05 2023-10-08T06:57:49.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428454+0000", 2023-10-08T06:57:49.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1775e-05 2023-10-08T06:57:49.468 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.468 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.468 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.468 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30188 5.0 e27/20 5:0e572280:::benchmark_data_smithi037_101035_object30187:head v 27'1852, mlcod=27'1850)", 2023-10-08T06:57:49.469 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.428292+0000", 2023-10-08T06:57:49.469 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0038379019999999998, 2023-10-08T06:57:49.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040240780000000004, 2023-10-08T06:57:49.469 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.469 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.469 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428292+0000", 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428292+0000", 2023-10-08T06:57:49.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428293+0000", 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4499999999999997e-07 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428393+0000", 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010032800000000001 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428400+0000", 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8560000000000001e-06 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428404+0000", 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5959999999999997e-06 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428452+0000", 2023-10-08T06:57:49.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7942000000000003e-05 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428478+0000", 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5660000000000002e-05 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.474 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.475 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30190 5.2 e27/20 5:412fc1f5:::benchmark_data_smithi037_101035_object30189:head v 27'1850, mlcod=27'1847)", 2023-10-08T06:57:49.475 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.428587+0000", 2023-10-08T06:57:49.475 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0035432010000000002, 2023-10-08T06:57:49.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037618619999999999, 2023-10-08T06:57:49.476 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.476 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.476 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428587+0000", 2023-10-08T06:57:49.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428587+0000", 2023-10-08T06:57:49.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428587+0000", 2023-10-08T06:57:49.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9599999999999999e-07 2023-10-08T06:57:49.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428672+0000", 2023-10-08T06:57:49.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4515e-05 2023-10-08T06:57:49.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428683+0000", 2023-10-08T06:57:49.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0925e-05 2023-10-08T06:57:49.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428690+0000", 2023-10-08T06:57:49.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9829999999999999e-06 2023-10-08T06:57:49.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428744+0000", 2023-10-08T06:57:49.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4178999999999997e-05 2023-10-08T06:57:49.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.428766+0000", 2023-10-08T06:57:49.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2186000000000001e-05 2023-10-08T06:57:49.482 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.482 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.482 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.483 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30186 5.e e27/20 5:7ec7e2cc:::benchmark_data_smithi037_101035_object30185:head v 27'1911, mlcod=27'1908)", 2023-10-08T06:57:49.483 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.429254+0000", 2023-10-08T06:57:49.484 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0028763450000000002, 2023-10-08T06:57:49.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031277879999999998, 2023-10-08T06:57:49.484 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.484 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.484 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429254+0000", 2023-10-08T06:57:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429254+0000", 2023-10-08T06:57:49.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.486 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.486 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.486 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429254+0000", 2023-10-08T06:57:49.487 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9299999999999998e-07 2023-10-08T06:57:49.487 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.487 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.488 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429304+0000", 2023-10-08T06:57:49.488 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9391000000000002e-05 2023-10-08T06:57:49.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429315+0000", 2023-10-08T06:57:49.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.155e-05 2023-10-08T06:57:49.489 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429324+0000", 2023-10-08T06:57:49.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6989999999999992e-06 2023-10-08T06:57:49.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429373+0000", 2023-10-08T06:57:49.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8851999999999999e-05 2023-10-08T06:57:49.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.493 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.429395+0000", 2023-10-08T06:57:49.493 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2700999999999998e-05 2023-10-08T06:57:49.493 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.493 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.493 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.494 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.494 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30192 5.1 e27/20 5:8b904a37:::benchmark_data_smithi037_101035_object30191:head v 27'1869, mlcod=27'1865)", 2023-10-08T06:57:49.494 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.430092+0000", 2023-10-08T06:57:49.494 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0020380020000000001, 2023-10-08T06:57:49.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002333164, 2023-10-08T06:57:49.495 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.495 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.495 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430092+0000", 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430092+0000", 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430093+0000", 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6899999999999997e-07 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430152+0000", 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9110000000000002e-05 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430162+0000", 2023-10-08T06:57:49.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0393e-05 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430169+0000", 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.097e-06 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430213+0000", 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3733000000000003e-05 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430225+0000", 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2303999999999999e-05 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.499 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30189 5.e e27/20 5:71d10284:::benchmark_data_smithi037_101035_object30188:head v 27'1912, mlcod=27'1908)", 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.430263+0000", 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0018670270000000001, 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0021979199999999999, 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430263+0000", 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430263+0000", 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430264+0000", 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9599999999999999e-07 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430326+0000", 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2909000000000004e-05 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430336+0000", 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3249999999999997e-06 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430343+0000", 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.827e-06 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430379+0000", 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.625e-05 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430395+0000", 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6388999999999998e-05 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.504 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30194 5.6 5:60c2b91e:::benchmark_data_smithi037_101035_object30193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.430541+0000", 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0015894850000000001, 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019562609999999999, 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:49.505 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30194 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430541+0000", 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430541+0000", 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430542+0000", 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1969999999999999e-06 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430601+0000", 2023-10-08T06:57:49.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9583999999999997e-05 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430610+0000", 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0589999999999992e-06 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430618+0000", 2023-10-08T06:57:49.508 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1640000000000004e-06 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430673+0000", 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5797999999999997e-05 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430844+0000", 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017063700000000001 2023-10-08T06:57:49.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431031+0000", 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000186734 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30193 5.8 e27/20 5:1c6bb07f:::benchmark_data_smithi037_101035_object30192:head v 27'1871, mlcod=27'1869)", 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.430949+0000", 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.001181391, 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001605392, 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430949+0000", 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430949+0000", 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.430949+0000", 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5600000000000001e-07 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431007+0000", 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7454000000000003e-05 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.513 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431014+0000", 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.046e-06 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431018+0000", 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5739999999999997e-06 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.514 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431060+0000", 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1810000000000001e-05 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431074+0000", 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3628000000000001e-05 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.515 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:30195 5.e e27/20 5:704c5a18:::benchmark_data_smithi037_101035_object30194:head v 27'1913, mlcod=27'1908)", 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.431765+0000", 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.000364502, 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00084438500000000001, 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.516 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431765+0000", 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431765+0000", 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.517 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431766+0000", 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7800000000000001e-07 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431832+0000", 2023-10-08T06:57:49.518 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5728000000000005e-05 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431838+0000", 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2620000000000004e-06 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431843+0000", 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0429999999999998e-06 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.519 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431886+0000", 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2843000000000003e-05 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.431911+0000", 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5452e-05 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.520 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.521 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.521 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.521 INFO:teuthology.orchestra.run.smithi183.stdout: ], 2023-10-08T06:57:49.521 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 12 2023-10-08T06:57:49.521 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:49.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:49.521+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:49.523 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:49.623 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:49.623+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:49.704 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:57:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2023-10-08T06:57:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2023-10-08T06:57:49.705 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:49.718 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:49.759 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:49.759+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:49.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:49.824+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:49.925 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:49.925+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:49.948 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:49.948 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:57:49.948 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.615802637999998, 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012193371999999999, 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330199+0000", 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330209+0000", 2023-10-08T06:57:49.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9219999999999992e-06 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330217+0000", 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9049999999999997e-06 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330228+0000", 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330242+0000", 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3141e-05 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331761+0000", 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015191009999999999 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.331881+0000", 2023-10-08T06:57:49.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000120701 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332370+0000", 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048859900000000004 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336444+0000", 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040740780000000001 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342335+0000", 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058908399999999996 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342370+0000", 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4993999999999997e-05 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342393+0000", 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2736999999999999e-05 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.615737219000003, 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012275207999999999, 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.955 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330265+0000", 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2099999999999996e-07 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330270+0000", 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2509999999999996e-06 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.957 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330279+0000", 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1409999999999994e-06 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330286+0000", 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332713+0000", 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024269370000000001 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332918+0000", 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020486300000000001 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.333021+0000", 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001032 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:49.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.336451+0000", 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003429578 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342439+0000", 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059881639999999998 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342500+0000", 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0723000000000001e-05 2023-10-08T06:57:49.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342540+0000", 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9950999999999997e-05 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:49.961 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.615645698000002, 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012552061999999999, 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.962 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330356+0000", 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330357+0000", 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6800000000000001e-07 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330362+0000", 2023-10-08T06:57:49.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2580000000000003e-06 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330370+0000", 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330376+0000", 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8599999999999998e-06 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334003+0000", 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003627473 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334126+0000", 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012268899999999999 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334291+0000", 2023-10-08T06:57:49.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000165582 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.338174+0000", 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0038830750000000002 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342831+0000", 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0046565549999999997 2023-10-08T06:57:49.966 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342871+0000", 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9614999999999999e-05 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342908+0000", 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7703999999999997e-05 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.615574441, 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012140507, 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:49.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330427+0000", 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330428+0000", 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.44e-07 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330432+0000", 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6270000000000002e-06 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330440+0000", 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4449999999999996e-06 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.970 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330447+0000", 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9920000000000001e-06 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332674+0000", 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002227003 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.332817+0000", 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000142385 2023-10-08T06:57:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.342568+0000", 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0097514109999999998 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:49.972 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.615544247000003, 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012554457, 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.973 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330458+0000", 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8599999999999998e-07 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330461+0000", 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1140000000000002e-06 2023-10-08T06:57:49.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330890+0000", 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042921399999999997 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.330901+0000", 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0664e-05 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.975 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.334897+0000", 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039962260000000003 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.335028+0000", 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013081400000000001 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:17.343012+0000", 2023-10-08T06:57:49.976 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079839390000000007 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14433 5.6 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.8390975940000001, 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017532516000000001, 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.977 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14433 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.978 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106905+0000", 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106971+0000", 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5945000000000006e-05 2023-10-08T06:57:49.979 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106979+0000", 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8739999999999995e-06 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106983+0000", 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3660000000000002e-06 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.980 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107023+0000", 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9634e-05 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107137+0000", 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114747 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107229+0000", 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1775999999999997e-05 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108887+0000", 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016575100000000001 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124321+0000", 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015434128 2023-10-08T06:57:49.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124374+0000", 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2899000000000003e-05 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124437+0000", 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3016999999999997e-05 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.983 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:16376 5.a 5:569ed07d:::benchmark_data_smithi037_101035_object16375:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.706153+0000", 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.2398486159999997, 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01210693, 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.984 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 16376 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706153+0000", 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706153+0000", 2023-10-08T06:57:49.985 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706154+0000", 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7599999999999996e-07 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706220+0000", 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5839000000000004e-05 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706229+0000", 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4320000000000005e-06 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706236+0000", 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4409999999999998e-06 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706524+0000", 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00028784299999999997 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706622+0000", 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8397e-05 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.706715+0000", 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2831999999999995e-05 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.709287+0000", 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002571851 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.718198+0000", 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0089114610000000007 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.989 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.718236+0000", 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8287000000000001e-05 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.718260+0000", 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3771e-05 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.990 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19485 5.c 5:31c60dc6:::benchmark_data_smithi037_101035_object19484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2331863739999998, 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014907449999999999, 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19485 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.991 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712816+0000", 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3399999999999998e-07 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712854+0000", 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7591e-05 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712862+0000", 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4309999999999994e-06 2023-10-08T06:57:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712869+0000", 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3520000000000003e-06 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.714984+0000", 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002115638 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715161+0000", 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017632800000000001 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715296+0000", 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013528300000000001 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:49.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718545+0000", 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032489569999999998 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727623+0000", 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0090785859999999996 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727684+0000", 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0278999999999997e-05 2023-10-08T06:57:49.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727723+0000", 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9270999999999997e-05 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19486 5.c 5:3f8361ed:::benchmark_data_smithi037_101035_object19485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:49.997 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2331197620000003, 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014972698, 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19486 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.998 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:49.999 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712883+0000", 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712916+0000", 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3052999999999997e-05 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712925+0000", 2023-10-08T06:57:50.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.38e-06 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712931+0000", 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0240000000000003e-06 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716123+0000", 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031922399999999998 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716228+0000", 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010487 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716365+0000", 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000136303 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.002 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718584+0000", 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022193239999999999 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727789+0000", 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092049030000000004 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727822+0000", 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2848999999999997e-05 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727855+0000", 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3160000000000001e-05 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:19492 5.4 e25/20 5:20e452e2:::benchmark_data_smithi037_101035_object19491:head v 25'1194, mlcod=25'1190)", 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.715449+0000", 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2305528600000004, 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012321818, 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715449+0000", 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.005 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715449+0000", 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715450+0000", 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9400000000000005e-07 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715538+0000", 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8302999999999998e-05 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715546+0000", 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3289999999999994e-06 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715553+0000", 2023-10-08T06:57:50.007 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5849999999999996e-06 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716076+0000", 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00052322299999999996 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716094+0000", 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7813999999999999e-05 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.008 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727730+0000", 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011636374 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727771+0000", 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0496e-05 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19500 5.c 5:37b53ca0:::benchmark_data_smithi037_101035_object19499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.716221+0000", 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2297804330000002, 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012167575, 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19500 2023-10-08T06:57:50.010 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716221+0000", 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716221+0000", 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716222+0000", 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6899999999999998e-07 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716254+0000", 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2122000000000002e-05 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.012 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716261+0000", 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8589999999999999e-06 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716266+0000", 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2279999999999998e-06 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718616+0000", 2023-10-08T06:57:50.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002349819 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718736+0000", 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000119919 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718906+0000", 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016982499999999999 2023-10-08T06:57:50.014 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727752+0000", 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088460899999999992 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728317+0000", 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00056571900000000001 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728355+0000", 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7234000000000003e-05 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728389+0000", 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4291000000000001e-05 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.016 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19502 5.c 5:3037d788:::benchmark_data_smithi037_101035_object19501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2296751720000003, 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012270903999999999, 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19502 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716327+0000", 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0800000000000005e-07 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716400+0000", 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2807999999999998e-05 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.019 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716407+0000", 2023-10-08T06:57:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3220000000000004e-06 2023-10-08T06:57:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716417+0000", 2023-10-08T06:57:50.022 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6059999999999992e-06 2023-10-08T06:57:50.022 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.022 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.719792+0000", 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033753569999999998 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.719888+0000", 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5785000000000005e-05 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.023 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.720033+0000", 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014530000000000001 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727772+0000", 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077390330000000002 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728519+0000", 2023-10-08T06:57:50.025 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00074656500000000003 2023-10-08T06:57:50.025 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.025 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.025 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.025 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728566+0000", 2023-10-08T06:57:50.025 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6734999999999999e-05 2023-10-08T06:57:50.025 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.026 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.026 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.026 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.728598+0000", 2023-10-08T06:57:50.026 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1884999999999997e-05 2023-10-08T06:57:50.026 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.026 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:26900 5.3 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.717831976, 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017031261999999998, 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.027 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 26900 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:50.028 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228171+0000", 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.37e-07 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228232+0000", 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1746000000000001e-05 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.029 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228242+0000", 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0040999999999999e-05 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228250+0000", 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9140000000000008e-06 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.030 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228299+0000", 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8273999999999999e-05 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228429+0000", 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129956 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228557+0000", 2023-10-08T06:57:50.031 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012801199999999999 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.232147+0000", 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035903879999999999 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245130+0000", 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012982570000000001 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245177+0000", 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7830000000000001e-05 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245201+0000", 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3794e-05 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.033 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:26906 5.3 5:c1cb740d:::benchmark_data_smithi037_101035_object26905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.231036+0000", 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.7149660230000001, 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014250792, 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 26906 2023-10-08T06:57:50.034 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231036+0000", 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231036+0000", 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.035 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231037+0000", 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8999999999999995e-07 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231093+0000", 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6530999999999998e-05 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.036 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231106+0000", 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2376e-05 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231113+0000", 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7610000000000007e-06 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231151+0000", 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8021000000000001e-05 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231235+0000", 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3404000000000003e-05 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231318+0000", 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3293000000000004e-05 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.038 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.235989+0000", 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.004670581 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245237+0000", 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092482020000000005 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245267+0000", 2023-10-08T06:57:50.039 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0392e-05 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245287+0000", 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9341e-05 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28676 5.5 5:a1aacf0d:::benchmark_data_smithi037_101035_object28675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.040 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.861003+0000", 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.0849987109999999, 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01223688, 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28676 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.041 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861003+0000", 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861003+0000", 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861004+0000", 2023-10-08T06:57:50.042 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1429999999999999e-06 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861071+0000", 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6767999999999995e-05 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861079+0000", 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4030000000000007e-06 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.043 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861085+0000", 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5060000000000003e-06 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861131+0000", 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6511000000000002e-05 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.044 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861214+0000", 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2924999999999996e-05 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.861316+0000", 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000102088 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.863422+0000", 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002105207 2023-10-08T06:57:50.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873179+0000", 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0097575619999999991 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873215+0000", 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5593999999999998e-05 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873240+0000", 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5173000000000001e-05 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28697 5.a 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.07552983, 2023-10-08T06:57:50.047 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.029866567, 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28697 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:50.048 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870473+0000", 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3200000000000005e-07 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870533+0000", 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9941000000000001e-05 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870549+0000", 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6688e-05 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870555+0000", 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9059999999999999e-06 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870617+0000", 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1309999999999994e-05 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870732+0000", 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115198 2023-10-08T06:57:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870813+0000", 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1542e-05 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.874939+0000", 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041253219999999998 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.052 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900278+0000", 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025339897 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900315+0000", 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6229999999999997e-05 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.053 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900339+0000", 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3901e-05 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28699 5.a 5:5b28870b:::benchmark_data_smithi037_101035_object28698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.072606181, 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.027162454999999999, 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28699 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.06e-07 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873473+0000", 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6679000000000002e-05 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873487+0000", 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3597999999999999e-05 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873491+0000", 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.916e-06 2023-10-08T06:57:50.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873529+0000", 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7598000000000002e-05 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873626+0000", 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7367000000000005e-05 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.058 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873729+0000", 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010220799999999999 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880045+0000", 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063162089999999997 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900391+0000", 2023-10-08T06:57:50.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020346212999999998 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900514+0000", 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012279700000000001 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900558+0000", 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4264000000000002e-05 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.060 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28704 5.a 5:576041a3:::benchmark_data_smithi037_101035_object28703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.069729862, 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.024376907999999999, 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.061 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28704 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:50.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876273+0000", 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1099999999999995e-07 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876333+0000", 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0281000000000001e-05 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.063 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876341+0000", 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2859999999999999e-06 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876346+0000", 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9099999999999996e-06 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876382+0000", 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6164000000000001e-05 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876493+0000", 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001111 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876609+0000", 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000116128 2023-10-08T06:57:50.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880067+0000", 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003457304 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900600+0000", 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020532749999999999 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900629+0000", 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9323e-05 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900649+0000", 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0051000000000002e-05 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30811 5.c 5:33193cdf:::benchmark_data_smithi037_101035_object30810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.28634209399999999, 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018643812999999999, 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30811 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.068 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9500000000000002e-07 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659715+0000", 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659724+0000", 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7280000000000007e-06 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659732+0000", 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664288+0000", 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045555680000000003 2023-10-08T06:57:50.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664434+0000", 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014595400000000001 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664590+0000", 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156599 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666251+0000", 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016600549999999999 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678240+0000", 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011989145999999999 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678278+0000", 2023-10-08T06:57:50.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8389000000000001e-05 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678304+0000", 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5531e-05 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30820 5.c 5:33a03318:::benchmark_data_smithi037_101035_object30819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.074 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.665229+0000", 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.28077307800000001, 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013125075, 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30820 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.665229+0000", 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.665229+0000", 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.665230+0000", 2023-10-08T06:57:50.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8599999999999997e-07 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.665387+0000", 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015744000000000001 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.665393+0000", 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7379999999999999e-06 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.665397+0000", 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1139999999999999e-06 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666276+0000", 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00087882499999999996 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:50.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666366+0000", 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0270000000000001e-05 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666503+0000", 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013731600000000001 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.668958+0000", 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024547330000000002 2023-10-08T06:57:50.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678310+0000", 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0093514640000000003 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678336+0000", 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6162000000000001e-05 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:50.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678354+0000", 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8127000000000001e-05 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:50.081 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:50.083 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:50.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:50.081+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:50.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:57:50.183 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:50.183+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:50.253 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32337 5.9 5:9b4a982d:::benchmark_data_smithi037_101035_object32336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.244167+0000", 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0091877369999999996, 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092182859999999991, 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:50.254 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32337 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244167+0000", 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244167+0000", 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244168+0000", 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244205+0000", 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7107999999999998e-05 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244216+0000", 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1011e-05 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244224+0000", 2023-10-08T06:57:50.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244357+0000", 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013363700000000001 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244483+0000", 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012559100000000001 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244619+0000", 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000135601 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.247280+0000", 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026617170000000001 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32338 5.f 5:f1f6f105:::benchmark_data_smithi037_101035_object32337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.244237+0000", 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0091175079999999999, 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092075209999999998, 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32338 2023-10-08T06:57:50.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244237+0000", 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244237+0000", 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244238+0000", 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244270+0000", 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2197999999999999e-05 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244280+0000", 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6940000000000007e-06 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.244286+0000", 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7780000000000002e-06 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.246707+0000", 2023-10-08T06:57:50.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024205820000000001 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.246796+0000", 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8640999999999994e-05 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.246883+0000", 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7243999999999993e-05 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.248460+0000", 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015770840000000001 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32348 5.9 5:9d828ec8:::benchmark_data_smithi037_101035_object32347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.250592+0000", 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0027622110000000001, 2023-10-08T06:57:50.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029005720000000001, 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32348 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250592+0000", 2023-10-08T06:57:50.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250592+0000", 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250594+0000", 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2049999999999999e-06 2023-10-08T06:57:50.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250647+0000", 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2988999999999997e-05 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250654+0000", 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7950000000000008e-06 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250659+0000", 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1120000000000004e-06 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250703+0000", 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3729000000000001e-05 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250835+0000", 2023-10-08T06:57:50.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013191799999999999 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250983+0000", 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000147696 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.252647+0000", 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001664577 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.270 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32352 5.f 5:f4f1eb6d:::benchmark_data_smithi037_101035_object32351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.250898+0000", 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0024567259999999998, 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026424270000000001, 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:50.271 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32352 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250898+0000", 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250898+0000", 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:50.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.250898+0000", 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4300000000000003e-07 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.251066+0000", 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168006 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.251073+0000", 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5359999999999998e-06 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.251077+0000", 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5109999999999997e-06 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.251130+0000", 2023-10-08T06:57:50.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2469999999999997e-05 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.251256+0000", 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012642999999999999 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.251345+0000", 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8654999999999997e-05 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:50.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.253377+0000", 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002032028 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 4 2023-10-08T06:57:50.276 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:50.276 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T06:57:50.277 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T06:57:50.277 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-10-08T06:57:50.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-10-08T06:57:50.279 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:57:50.279 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:50.284 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:50.284+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:50.293 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:50.315 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:50.337 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:57:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:57:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:57:50.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 10 16 32635 32619 203.854 164.25 0.0124504 0.00490113 2023-10-08T06:57:50.385 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:50.385+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:50.452 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:50.452 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:50.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:50.486 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:50.486+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:50.587 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:50.587+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:50.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:50.639 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T06:57:50.640 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2023-10-08T06:57:50.640 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "a28386aa-6313-4530-b2e8-fd7736a43dc5", 2023-10-08T06:57:50.640 INFO:teuthology.orchestra.run.smithi037.stdout: "created": "2023-10-08T06:56:54.481679+0000", 2023-10-08T06:57:50.641 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2023-10-08T06:57:50.250112+0000", 2023-10-08T06:57:50.641 INFO:teuthology.orchestra.run.smithi037.stdout: "last_up_change": "2023-10-08T06:57:03.011095+0000", 2023-10-08T06:57:50.641 INFO:teuthology.orchestra.run.smithi037.stdout: "last_in_change": "2023-10-08T06:56:55.385351+0000", 2023-10-08T06:57:50.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T06:57:50.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_num": 5801984, 2023-10-08T06:57:50.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_set": [ 2023-10-08T06:57:50.641 INFO:teuthology.orchestra.run.smithi037.stdout: "noscrub", 2023-10-08T06:57:50.642 INFO:teuthology.orchestra.run.smithi037.stdout: "pglog_hardlimit", 2023-10-08T06:57:50.642 INFO:teuthology.orchestra.run.smithi037.stdout: "purged_snapdirs", 2023-10-08T06:57:50.642 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_deletes", 2023-10-08T06:57:50.642 INFO:teuthology.orchestra.run.smithi037.stdout: "sortbitwise" 2023-10-08T06:57:50.642 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:50.643 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_version": 4, 2023-10-08T06:57:50.643 INFO:teuthology.orchestra.run.smithi037.stdout: "full_ratio": 0.94999998807907104, 2023-10-08T06:57:50.643 INFO:teuthology.orchestra.run.smithi037.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-08T06:57:50.643 INFO:teuthology.orchestra.run.smithi037.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-08T06:57:50.643 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_snapshot": "", 2023-10-08T06:57:50.644 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_max": 5, 2023-10-08T06:57:50.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd": 3, 2023-10-08T06:57:50.644 INFO:teuthology.orchestra.run.smithi037.stdout: "require_min_compat_client": "luminous", 2023-10-08T06:57:50.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min_compat_client": "luminous", 2023-10-08T06:57:50.644 INFO:teuthology.orchestra.run.smithi037.stdout: "require_osd_release": "reef", 2023-10-08T06:57:50.644 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_crimson": false, 2023-10-08T06:57:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: "pools": [ 2023-10-08T06:57:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 1, 2023-10-08T06:57:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": ".mgr", 2023-10-08T06:57:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:04.997403+0000", 2023-10-08T06:57:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 1, 2023-10-08T06:57:50.646 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 1, 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 1, 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 1, 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 1, 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:50.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "12", 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:50.648 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:50.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_max": 32, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 1 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": {} 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 2.9900000095367432, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 2.9900000095367432, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 2, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 2, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:50.652 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 2, 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "rbd", 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:09.831792+0000", 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:50.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 8, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 8, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 8, 2023-10-08T06:57:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 8, 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 8, 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "15", 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:50.655 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:50.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:50.657 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "options": {}, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd": {} 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.5, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.5, 2023-10-08T06:57:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.5, 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.5, 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.660 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 3, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_metadata", 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:14.549981+0000", 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:50.661 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 32, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 32, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 32, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 32, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 32, 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:50.662 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "18", 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:50.663 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:50.664 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:50.665 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:50.666 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_bias": 4, 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 16, 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_priority": 5 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": "cephfs" 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:50.667 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 4, 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_data", 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:15.701169+0000", 2023-10-08T06:57:50.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:50.669 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 64, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 64, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 64, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 64, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 64, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:50.670 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "19", 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:50.671 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:50.672 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:50.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 64, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.674 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "data": "cephfs" 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:50.675 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 5, 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "unique_pool_0", 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:37.183131+0000", 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:57:50.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 16, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 16, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 16, 2023-10-08T06:57:50.677 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 16, 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 16, 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "22", 2023-10-08T06:57:50.678 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:57:50.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:57:50.680 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:57:50.681 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "options": {}, 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "rados": {} 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:57:50.682 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 1, 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 1, 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 1 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "osds": [ 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:50.683 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06", 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 20, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:50.684 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6800", 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6801", 2023-10-08T06:57:50.685 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6802", 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6803", 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.687 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6806", 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6807", 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.688 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6804", 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6805", 2023-10-08T06:57:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.163:6801/2190327034", 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.163:6803/2190327034", 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.163:6807/2190327034", 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.163:6805/2190327034", 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:50.690 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "da732e65-55c2-489e-bec4-ce4124704896", 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:50.691 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 25, 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6800", 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6801", 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.693 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6802", 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6803", 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6806", 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.695 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6807", 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6804", 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6805", 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.169:6801/3772527464", 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.169:6803/3772527464", 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.169:6807/3772527464", 2023-10-08T06:57:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.169:6805/3772527464", 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1", 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:57:50.698 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 20, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6800", 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6801", 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.700 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6802", 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6803", 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6806", 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6807", 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6804", 2023-10-08T06:57:50.703 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6805", 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.183:6801/1488347209", 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.183:6803/1488347209", 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.183:6807/1488347209", 2023-10-08T06:57:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.183:6805/1488347209", 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_xinfo": [ 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:50.705 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.463792+0000", 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:50.706 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.488920+0000", 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:57:50.707 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.516673+0000", 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap": [ 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: "pgid": "3.a", 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: "osds": [ 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.708 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_items": [], 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_primaries": [], 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_temp": [], 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_temp": [], 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklist": {}, 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "range_blocklist": {}, 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profiles": { 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default": { 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-failure-domain": "osd", 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "k": "2", 2023-10-08T06:57:50.709 INFO:teuthology.orchestra.run.smithi037.stdout: "m": "1", 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin": "jerasure", 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "technique": "reed_sol_van" 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps_queue": [], 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "new_removed_snaps": [], 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "new_purged_snaps": [], 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_node_flags": {}, 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "device_class_flags": {}, 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode": { 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_enabled": false, 2023-10-08T06:57:50.710 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_bucket_count": 0, 2023-10-08T06:57:50.711 INFO:teuthology.orchestra.run.smithi037.stdout: "degraded_stretch_mode": 0, 2023-10-08T06:57:50.711 INFO:teuthology.orchestra.run.smithi037.stdout: "recovering_stretch_mode": 0, 2023-10-08T06:57:50.711 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_bucket": 0 2023-10-08T06:57:50.711 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:57:50.711 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T06:57:50.713 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:50.713 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:50.714 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': 'a28386aa-6313-4530-b2e8-fd7736a43dc5', 'created': '2023-10-08T06:56:54.481679+0000', 'modified': '2023-10-08T06:57:50.250112+0000', 'last_up_change': '2023-10-08T06:57:03.011095+0000', 'last_in_change': '2023-10-08T06:56:55.385351+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:57:14.549981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:57:15.701169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-10-08T06:57:37.183131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 2190327034}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 2190327034}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 2190327034}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 2190327034}]}, 'public_addr': '172.21.15.163:6801/2190327034', 'cluster_addr': '172.21.15.163:6803/2190327034', 'heartbeat_back_addr': '172.21.15.163:6807/2190327034', 'heartbeat_front_addr': '172.21.15.163:6805/2190327034', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'da732e65-55c2-489e-bec4-ce4124704896', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 25, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 3772527464}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 3772527464}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 3772527464}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 3772527464}]}, 'public_addr': '172.21.15.169:6801/3772527464', 'cluster_addr': '172.21.15.169:6803/3772527464', 'heartbeat_back_addr': '172.21.15.169:6807/3772527464', 'heartbeat_front_addr': '172.21.15.169:6805/3772527464', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6800', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6801', 'nonce': 1488347209}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6802', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6803', 'nonce': 1488347209}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6806', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6807', 'nonce': 1488347209}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6804', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6805', 'nonce': 1488347209}]}, 'public_addr': '172.21.15.183:6801/1488347209', 'cluster_addr': '172.21.15.183:6803/1488347209', 'heartbeat_back_addr': '172.21.15.183:6807/1488347209', 'heartbeat_front_addr': '172.21.15.183:6805/1488347209', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.463792+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.488920+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.516673+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-10-08T06:57:50.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:57:50.715 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:50.715 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:50.712+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:50.813 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:50.813+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:50.872 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:50.872 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:50.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:50.913 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:50.913+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:51.015 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:51.015+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:51.084 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:51.084 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:51.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:57:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T06:57:51.116 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2023-10-08T06:57:50.948714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1894058890,"num_objects":28916,"num_object_clones":0,"num_object_copies":57832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28916,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":29140,"num_write_kb":1852562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29088,"ondisk_log_size":29088,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":362408,"kb_used_data":223040,"kb_used_omap":4,"kb_used_meta":139323,"kb_avail":282753112,"statfs":{"total":289910292480,"available":289539186688,"internally_reserved":0,"allocated":228392960,"data_stored":3640292920,"data_compressed":17432288,"data_compressed_allocated":227500032,"data_compressed_original":3639967744,"omap_allocated":4781,"internal_metadata":142667091},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":980680704,"num_objects":14964,"num_object_clones":0,"num_object_copies":29928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14964,"num_write_kb":957696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.713642"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249272+0000","last_change":"2023-10-08T06:57:17.335864+0000","last_active":"2023-10-08T06:57:46.249272+0000","last_peered":"2023-10-08T06:57:46.249272+0000","last_clean":"2023-10-08T06:57:46.249272+0000","last_became_active":"2023-10-08T06:57:17.335553+0000","last_became_peered":"2023-10-08T06:57:17.335553+0000","last_unstale":"2023-10-08T06:57:46.249272+0000","last_undegraded":"2023-10-08T06:57:46.249272+0000","last_fullsized":"2023-10-08T06:57:46.249272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248817+0000","last_change":"2023-10-08T06:57:17.335336+0000","last_active":"2023-10-08T06:57:46.248817+0000","last_peered":"2023-10-08T06:57:46.248817+0000","last_clean":"2023-10-08T06:57:46.248817+0000","last_became_active":"2023-10-08T06:57:17.334845+0000","last_became_peered":"2023-10-08T06:57:17.334845+0000","last_unstale":"2023-10-08T06:57:46.248817+0000","last_undegraded":"2023-10-08T06:57:46.248817+0000","last_fullsized":"2023-10-08T06:57:46.248817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252072+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T06:57:46.252072+0000","last_peered":"2023-10-08T06:57:46.252072+0000","last_clean":"2023-10-08T06:57:46.252072+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T06:57:46.252072+0000","last_undegraded":"2023-10-08T06:57:46.252072+0000","last_fullsized":"2023-10-08T06:57:46.252072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251877+0000","last_change":"2023-10-08T06:57:17.330053+0000","last_active":"2023-10-08T06:57:46.251877+0000","last_peered":"2023-10-08T06:57:46.251877+0000","last_clean":"2023-10-08T06:57:46.251877+0000","last_became_active":"2023-10-08T06:57:17.329227+0000","last_became_peered":"2023-10-08T06:57:17.329227+0000","last_unstale":"2023-10-08T06:57:46.251877+0000","last_undegraded":"2023-10-08T06:57:46.251877+0000","last_fullsized":"2023-10-08T06:57:46.251877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:17.336620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248128+0000","last_change":"2023-10-08T06:57:17.335377+0000","last_active":"2023-10-08T06:57:46.248128+0000","last_peered":"2023-10-08T06:57:46.248128+0000","last_clean":"2023-10-08T06:57:46.248128+0000","last_became_active":"2023-10-08T06:57:17.334998+0000","last_became_peered":"2023-10-08T06:57:17.334998+0000","last_unstale":"2023-10-08T06:57:46.248128+0000","last_undegraded":"2023-10-08T06:57:46.248128+0000","last_fullsized":"2023-10-08T06:57:46.248128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251407+0000","last_change":"2023-10-08T06:57:17.334551+0000","last_active":"2023-10-08T06:57:46.251407+0000","last_peered":"2023-10-08T06:57:46.251407+0000","last_clean":"2023-10-08T06:57:46.251407+0000","last_became_active":"2023-10-08T06:57:17.333964+0000","last_became_peered":"2023-10-08T06:57:17.333964+0000","last_unstale":"2023-10-08T06:57:46.251407+0000","last_undegraded":"2023-10-08T06:57:46.251407+0000","last_fullsized":"2023-10-08T06:57:46.251407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250755+0000","last_change":"2023-10-08T06:57:17.335951+0000","last_active":"2023-10-08T06:57:46.250755+0000","last_peered":"2023-10-08T06:57:46.250755+0000","last_clean":"2023-10-08T06:57:46.250755+0000","last_became_active":"2023-10-08T06:57:17.334815+0000","last_became_peered":"2023-10-08T06:57:17.334815+0000","last_unstale":"2023-10-08T06:57:46.250755+0000","last_undegraded":"2023-10-08T06:57:46.250755+0000","last_fullsized":"2023-10-08T06:57:46.250755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250583+0000","last_change":"2023-10-08T06:57:17.337105+0000","last_active":"2023-10-08T06:57:46.250583+0000","last_peered":"2023-10-08T06:57:46.250583+0000","last_clean":"2023-10-08T06:57:46.250583+0000","last_became_active":"2023-10-08T06:57:17.336019+0000","last_became_peered":"2023-10-08T06:57:17.336019+0000","last_unstale":"2023-10-08T06:57:46.250583+0000","last_undegraded":"2023-10-08T06:57:46.250583+0000","last_fullsized":"2023-10-08T06:57:46.250583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250517+0000","last_change":"2023-10-08T06:57:17.331590+0000","last_active":"2023-10-08T06:57:46.250517+0000","last_peered":"2023-10-08T06:57:46.250517+0000","last_clean":"2023-10-08T06:57:46.250517+0000","last_became_active":"2023-10-08T06:57:17.330380+0000","last_became_peered":"2023-10-08T06:57:17.330380+0000","last_unstale":"2023-10-08T06:57:46.250517+0000","last_undegraded":"2023-10-08T06:57:46.250517+0000","last_fullsized":"2023-10-08T06:57:46.250517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248947+0000","last_change":"2023-10-08T06:57:17.332843+0000","last_active":"2023-10-08T06:57:46.248947+0000","last_peered":"2023-10-08T06:57:46.248947+0000","last_clean":"2023-10-08T06:57:46.248947+0000","last_became_active":"2023-10-08T06:57:17.332472+0000","last_became_peered":"2023-10-08T06:57:17.332472+0000","last_unstale":"2023-10-08T06:57:46.248947+0000","last_undegraded":"2023-10-08T06:57:46.248947+0000","last_fullsized":"2023-10-08T06:57:46.248947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251577+0000","last_change":"2023-10-08T06:57:17.340538+0000","last_active":"2023-10-08T06:57:46.251577+0000","last_peered":"2023-10-08T06:57:46.251577+0000","last_clean":"2023-10-08T06:57:46.251577+0000","last_became_active":"2023-10-08T06:57:17.339725+0000","last_became_peered":"2023-10-08T06:57:17.339725+0000","last_unstale":"2023-10-08T06:57:46.251577+0000","last_undegraded":"2023-10-08T06:57:46.251577+0000","last_fullsized":"2023-10-08T06:57:46.251577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248408+0000","last_change":"2023-10-08T06:57:17.336746+0000","last_active":"2023-10-08T06:57:46.248408+0000","last_peered":"2023-10-08T06:57:46.248408+0000","last_clean":"2023-10-08T06:57:46.248408+0000","last_became_active":"2023-10-08T06:57:17.336320+0000","last_became_peered":"2023-10-08T06:57:17.336320+0000","last_unstale":"2023-10-08T06:57:46.248408+0000","last_undegraded":"2023-10-08T06:57:46.248408+0000","last_fullsized":"2023-10-08T06:57:46.248408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248284+0000","last_change":"2023-10-08T06:57:17.335322+0000","last_active":"2023-10-08T06:57:46.248284+0000","last_peered":"2023-10-08T06:57:46.248284+0000","last_clean":"2023-10-08T06:57:46.248284+0000","last_became_active":"2023-10-08T06:57:17.334907+0000","last_became_peered":"2023-10-08T06:57:17.334907+0000","last_unstale":"2023-10-08T06:57:46.248284+0000","last_undegraded":"2023-10-08T06:57:46.248284+0000","last_fullsized":"2023-10-08T06:57:46.248284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251531+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T06:57:46.251531+0000","last_peered":"2023-10-08T06:57:46.251531+0000","last_clean":"2023-10-08T06:57:46.251531+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T06:57:46.251531+0000","last_undegraded":"2023-10-08T06:57:46.251531+0000","last_fullsized":"2023-10-08T06:57:46.251531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250896+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T06:57:46.250896+0000","last_peered":"2023-10-08T06:57:46.250896+0000","last_clean":"2023-10-08T06:57:46.250896+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T06:57:46.250896+0000","last_undegraded":"2023-10-08T06:57:46.250896+0000","last_fullsized":"2023-10-08T06:57:46.250896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250609+0000","last_change":"2023-10-08T06:57:17.333941+0000","last_active":"2023-10-08T06:57:46.250609+0000","last_peered":"2023-10-08T06:57:46.250609+0000","last_clean":"2023-10-08T06:57:46.250609+0000","last_became_active":"2023-10-08T06:57:17.332821+0000","last_became_peered":"2023-10-08T06:57:17.332821+0000","last_unstale":"2023-10-08T06:57:46.250609+0000","last_undegraded":"2023-10-08T06:57:46.250609+0000","last_fullsized":"2023-10-08T06:57:46.250609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251385+0000","last_change":"2023-10-08T06:57:17.331092+0000","last_active":"2023-10-08T06:57:46.251385+0000","last_peered":"2023-10-08T06:57:46.251385+0000","last_clean":"2023-10-08T06:57:46.251385+0000","last_became_active":"2023-10-08T06:57:17.329479+0000","last_became_peered":"2023-10-08T06:57:17.329479+0000","last_unstale":"2023-10-08T06:57:46.251385+0000","last_undegraded":"2023-10-08T06:57:46.251385+0000","last_fullsized":"2023-10-08T06:57:46.251385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249023+0000","last_change":"2023-10-08T06:57:17.332293+0000","last_active":"2023-10-08T06:57:46.249023+0000","last_peered":"2023-10-08T06:57:46.249023+0000","last_clean":"2023-10-08T06:57:46.249023+0000","last_became_active":"2023-10-08T06:57:17.331604+0000","last_became_peered":"2023-10-08T06:57:17.331604+0000","last_unstale":"2023-10-08T06:57:46.249023+0000","last_undegraded":"2023-10-08T06:57:46.249023+0000","last_fullsized":"2023-10-08T06:57:46.249023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250378+0000","last_change":"2023-10-08T06:57:17.330966+0000","last_active":"2023-10-08T06:57:46.250378+0000","last_peered":"2023-10-08T06:57:46.250378+0000","last_clean":"2023-10-08T06:57:46.250378+0000","last_became_active":"2023-10-08T06:57:17.330207+0000","last_became_peered":"2023-10-08T06:57:17.330207+0000","last_unstale":"2023-10-08T06:57:46.250378+0000","last_undegraded":"2023-10-08T06:57:46.250378+0000","last_fullsized":"2023-10-08T06:57:46.250378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251800+0000","last_change":"2023-10-08T06:57:17.332884+0000","last_active":"2023-10-08T06:57:46.251800+0000","last_peered":"2023-10-08T06:57:46.251800+0000","last_clean":"2023-10-08T06:57:46.251800+0000","last_became_active":"2023-10-08T06:57:17.331615+0000","last_became_peered":"2023-10-08T06:57:17.331615+0000","last_unstale":"2023-10-08T06:57:46.251800+0000","last_undegraded":"2023-10-08T06:57:46.251800+0000","last_fullsized":"2023-10-08T06:57:46.251800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:28.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251304+0000","last_change":"2023-10-08T06:57:17.334709+0000","last_active":"2023-10-08T06:57:46.251304+0000","last_peered":"2023-10-08T06:57:46.251304+0000","last_clean":"2023-10-08T06:57:46.251304+0000","last_became_active":"2023-10-08T06:57:17.332958+0000","last_became_peered":"2023-10-08T06:57:17.332958+0000","last_unstale":"2023-10-08T06:57:46.251304+0000","last_undegraded":"2023-10-08T06:57:46.251304+0000","last_fullsized":"2023-10-08T06:57:46.251304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248471+0000","last_change":"2023-10-08T06:57:17.337026+0000","last_active":"2023-10-08T06:57:46.248471+0000","last_peered":"2023-10-08T06:57:46.248471+0000","last_clean":"2023-10-08T06:57:46.248471+0000","last_became_active":"2023-10-08T06:57:17.336454+0000","last_became_peered":"2023-10-08T06:57:17.336454+0000","last_unstale":"2023-10-08T06:57:46.248471+0000","last_undegraded":"2023-10-08T06:57:46.248471+0000","last_fullsized":"2023-10-08T06:57:46.248471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:15.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249953+0000","last_change":"2023-10-08T06:57:17.332570+0000","last_active":"2023-10-08T06:57:46.249953+0000","last_peered":"2023-10-08T06:57:46.249953+0000","last_clean":"2023-10-08T06:57:46.249953+0000","last_became_active":"2023-10-08T06:57:17.331832+0000","last_became_peered":"2023-10-08T06:57:17.331832+0000","last_unstale":"2023-10-08T06:57:46.249953+0000","last_undegraded":"2023-10-08T06:57:46.249953+0000","last_fullsized":"2023-10-08T06:57:46.249953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248371+0000","last_change":"2023-10-08T06:57:17.330971+0000","last_active":"2023-10-08T06:57:46.248371+0000","last_peered":"2023-10-08T06:57:46.248371+0000","last_clean":"2023-10-08T06:57:46.248371+0000","last_became_active":"2023-10-08T06:57:17.330275+0000","last_became_peered":"2023-10-08T06:57:17.330275+0000","last_unstale":"2023-10-08T06:57:46.248371+0000","last_undegraded":"2023-10-08T06:57:46.248371+0000","last_fullsized":"2023-10-08T06:57:46.248371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249233+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T06:57:46.249233+0000","last_peered":"2023-10-08T06:57:46.249233+0000","last_clean":"2023-10-08T06:57:46.249233+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T06:57:46.249233+0000","last_undegraded":"2023-10-08T06:57:46.249233+0000","last_fullsized":"2023-10-08T06:57:46.249233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250272+0000","last_change":"2023-10-08T06:57:17.333191+0000","last_active":"2023-10-08T06:57:46.250272+0000","last_peered":"2023-10-08T06:57:46.250272+0000","last_clean":"2023-10-08T06:57:46.250272+0000","last_became_active":"2023-10-08T06:57:17.332353+0000","last_became_peered":"2023-10-08T06:57:17.332353+0000","last_unstale":"2023-10-08T06:57:46.250272+0000","last_undegraded":"2023-10-08T06:57:46.250272+0000","last_fullsized":"2023-10-08T06:57:46.250272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251911+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T06:57:46.251911+0000","last_peered":"2023-10-08T06:57:46.251911+0000","last_clean":"2023-10-08T06:57:46.251911+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T06:57:46.251911+0000","last_undegraded":"2023-10-08T06:57:46.251911+0000","last_fullsized":"2023-10-08T06:57:46.251911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248400+0000","last_change":"2023-10-08T06:57:16.322982+0000","last_active":"2023-10-08T06:57:46.248400+0000","last_peered":"2023-10-08T06:57:46.248400+0000","last_clean":"2023-10-08T06:57:46.248400+0000","last_became_active":"2023-10-08T06:57:16.322673+0000","last_became_peered":"2023-10-08T06:57:16.322673+0000","last_unstale":"2023-10-08T06:57:46.248400+0000","last_undegraded":"2023-10-08T06:57:46.248400+0000","last_fullsized":"2023-10-08T06:57:46.248400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:30.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249024+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T06:57:46.249024+0000","last_peered":"2023-10-08T06:57:46.249024+0000","last_clean":"2023-10-08T06:57:46.249024+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T06:57:46.249024+0000","last_undegraded":"2023-10-08T06:57:46.249024+0000","last_fullsized":"2023-10-08T06:57:46.249024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250054+0000","last_change":"2023-10-08T06:57:16.318988+0000","last_active":"2023-10-08T06:57:46.250054+0000","last_peered":"2023-10-08T06:57:46.250054+0000","last_clean":"2023-10-08T06:57:46.250054+0000","last_became_active":"2023-10-08T06:57:16.318743+0000","last_became_peered":"2023-10-08T06:57:16.318743+0000","last_unstale":"2023-10-08T06:57:46.250054+0000","last_undegraded":"2023-10-08T06:57:46.250054+0000","last_fullsized":"2023-10-08T06:57:46.250054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:06.476356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250718+0000","last_change":"2023-10-08T06:57:17.335492+0000","last_active":"2023-10-08T06:57:46.250718+0000","last_peered":"2023-10-08T06:57:46.250718+0000","last_clean":"2023-10-08T06:57:46.250718+0000","last_became_active":"2023-10-08T06:57:17.334966+0000","last_became_peered":"2023-10-08T06:57:17.334966+0000","last_unstale":"2023-10-08T06:57:46.250718+0000","last_undegraded":"2023-10-08T06:57:46.250718+0000","last_fullsized":"2023-10-08T06:57:46.250718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249878+0000","last_change":"2023-10-08T06:57:16.320695+0000","last_active":"2023-10-08T06:57:46.249878+0000","last_peered":"2023-10-08T06:57:46.249878+0000","last_clean":"2023-10-08T06:57:46.249878+0000","last_became_active":"2023-10-08T06:57:16.320076+0000","last_became_peered":"2023-10-08T06:57:16.320076+0000","last_unstale":"2023-10-08T06:57:46.249878+0000","last_undegraded":"2023-10-08T06:57:46.249878+0000","last_fullsized":"2023-10-08T06:57:46.249878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:33:51.588585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249192+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T06:57:46.249192+0000","last_peered":"2023-10-08T06:57:46.249192+0000","last_clean":"2023-10-08T06:57:46.249192+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T06:57:46.249192+0000","last_undegraded":"2023-10-08T06:57:46.249192+0000","last_fullsized":"2023-10-08T06:57:46.249192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251549+0000","last_change":"2023-10-08T06:57:16.321746+0000","last_active":"2023-10-08T06:57:46.251549+0000","last_peered":"2023-10-08T06:57:46.251549+0000","last_clean":"2023-10-08T06:57:46.251549+0000","last_became_active":"2023-10-08T06:57:16.321484+0000","last_became_peered":"2023-10-08T06:57:16.321484+0000","last_unstale":"2023-10-08T06:57:46.251549+0000","last_undegraded":"2023-10-08T06:57:46.251549+0000","last_fullsized":"2023-10-08T06:57:46.251549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249897+0000","last_change":"2023-10-08T06:57:17.331254+0000","last_active":"2023-10-08T06:57:46.249897+0000","last_peered":"2023-10-08T06:57:46.249897+0000","last_clean":"2023-10-08T06:57:46.249897+0000","last_became_active":"2023-10-08T06:57:17.329812+0000","last_became_peered":"2023-10-08T06:57:17.329812+0000","last_unstale":"2023-10-08T06:57:46.249897+0000","last_undegraded":"2023-10-08T06:57:46.249897+0000","last_fullsized":"2023-10-08T06:57:46.249897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251959+0000","last_change":"2023-10-08T06:57:16.317427+0000","last_active":"2023-10-08T06:57:46.251959+0000","last_peered":"2023-10-08T06:57:46.251959+0000","last_clean":"2023-10-08T06:57:46.251959+0000","last_became_active":"2023-10-08T06:57:16.316995+0000","last_became_peered":"2023-10-08T06:57:16.316995+0000","last_unstale":"2023-10-08T06:57:46.251959+0000","last_undegraded":"2023-10-08T06:57:46.251959+0000","last_fullsized":"2023-10-08T06:57:46.251959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:19.232592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250158+0000","last_change":"2023-10-08T06:57:17.328459+0000","last_active":"2023-10-08T06:57:46.250158+0000","last_peered":"2023-10-08T06:57:46.250158+0000","last_clean":"2023-10-08T06:57:46.250158+0000","last_became_active":"2023-10-08T06:57:17.327990+0000","last_became_peered":"2023-10-08T06:57:17.327990+0000","last_unstale":"2023-10-08T06:57:46.250158+0000","last_undegraded":"2023-10-08T06:57:46.250158+0000","last_fullsized":"2023-10-08T06:57:46.250158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:24.361129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248819+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T06:57:46.248819+0000","last_peered":"2023-10-08T06:57:46.248819+0000","last_clean":"2023-10-08T06:57:46.248819+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T06:57:46.248819+0000","last_undegraded":"2023-10-08T06:57:46.248819+0000","last_fullsized":"2023-10-08T06:57:46.248819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250080+0000","last_change":"2023-10-08T06:57:17.330543+0000","last_active":"2023-10-08T06:57:46.250080+0000","last_peered":"2023-10-08T06:57:46.250080+0000","last_clean":"2023-10-08T06:57:46.250080+0000","last_became_active":"2023-10-08T06:57:17.329732+0000","last_became_peered":"2023-10-08T06:57:17.329732+0000","last_unstale":"2023-10-08T06:57:46.250080+0000","last_undegraded":"2023-10-08T06:57:46.250080+0000","last_fullsized":"2023-10-08T06:57:46.250080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251716+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T06:57:46.251716+0000","last_peered":"2023-10-08T06:57:46.251716+0000","last_clean":"2023-10-08T06:57:46.251716+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T06:57:46.251716+0000","last_undegraded":"2023-10-08T06:57:46.251716+0000","last_fullsized":"2023-10-08T06:57:46.251716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251814+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T06:57:46.251814+0000","last_peered":"2023-10-08T06:57:46.251814+0000","last_clean":"2023-10-08T06:57:46.251814+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T06:57:46.251814+0000","last_undegraded":"2023-10-08T06:57:46.251814+0000","last_fullsized":"2023-10-08T06:57:46.251814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251596+0000","last_change":"2023-10-08T06:57:16.317333+0000","last_active":"2023-10-08T06:57:46.251596+0000","last_peered":"2023-10-08T06:57:46.251596+0000","last_clean":"2023-10-08T06:57:46.251596+0000","last_became_active":"2023-10-08T06:57:16.316976+0000","last_became_peered":"2023-10-08T06:57:16.316976+0000","last_unstale":"2023-10-08T06:57:46.251596+0000","last_undegraded":"2023-10-08T06:57:46.251596+0000","last_fullsized":"2023-10-08T06:57:46.251596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:59.981155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248490+0000","last_change":"2023-10-08T06:57:17.335537+0000","last_active":"2023-10-08T06:57:46.248490+0000","last_peered":"2023-10-08T06:57:46.248490+0000","last_clean":"2023-10-08T06:57:46.248490+0000","last_became_active":"2023-10-08T06:57:17.335055+0000","last_became_peered":"2023-10-08T06:57:17.335055+0000","last_unstale":"2023-10-08T06:57:46.248490+0000","last_undegraded":"2023-10-08T06:57:46.248490+0000","last_fullsized":"2023-10-08T06:57:46.248490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:51.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250209+0000","last_change":"2023-10-08T06:57:16.319692+0000","last_active":"2023-10-08T06:57:46.250209+0000","last_peered":"2023-10-08T06:57:46.250209+0000","last_clean":"2023-10-08T06:57:46.250209+0000","last_became_active":"2023-10-08T06:57:16.319316+0000","last_became_peered":"2023-10-08T06:57:16.319316+0000","last_unstale":"2023-10-08T06:57:46.250209+0000","last_undegraded":"2023-10-08T06:57:46.250209+0000","last_fullsized":"2023-10-08T06:57:46.250209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:00.066944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248940+0000","last_change":"2023-10-08T06:57:17.331135+0000","last_active":"2023-10-08T06:57:46.248940+0000","last_peered":"2023-10-08T06:57:46.248940+0000","last_clean":"2023-10-08T06:57:46.248940+0000","last_became_active":"2023-10-08T06:57:17.330567+0000","last_became_peered":"2023-10-08T06:57:17.330567+0000","last_unstale":"2023-10-08T06:57:46.248940+0000","last_undegraded":"2023-10-08T06:57:46.248940+0000","last_fullsized":"2023-10-08T06:57:46.248940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248064+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T06:57:46.248064+0000","last_peered":"2023-10-08T06:57:46.248064+0000","last_clean":"2023-10-08T06:57:46.248064+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T06:57:46.248064+0000","last_undegraded":"2023-10-08T06:57:46.248064+0000","last_fullsized":"2023-10-08T06:57:46.248064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250496+0000","last_change":"2023-10-08T06:57:17.336340+0000","last_active":"2023-10-08T06:57:46.250496+0000","last_peered":"2023-10-08T06:57:46.250496+0000","last_clean":"2023-10-08T06:57:46.250496+0000","last_became_active":"2023-10-08T06:57:17.335631+0000","last_became_peered":"2023-10-08T06:57:17.335631+0000","last_unstale":"2023-10-08T06:57:46.250496+0000","last_undegraded":"2023-10-08T06:57:46.250496+0000","last_fullsized":"2023-10-08T06:57:46.250496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250781+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T06:57:46.250781+0000","last_peered":"2023-10-08T06:57:46.250781+0000","last_clean":"2023-10-08T06:57:46.250781+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T06:57:46.250781+0000","last_undegraded":"2023-10-08T06:57:46.250781+0000","last_fullsized":"2023-10-08T06:57:46.250781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251703+0000","last_change":"2023-10-08T06:57:17.336324+0000","last_active":"2023-10-08T06:57:46.251703+0000","last_peered":"2023-10-08T06:57:46.251703+0000","last_clean":"2023-10-08T06:57:46.251703+0000","last_became_active":"2023-10-08T06:57:17.335307+0000","last_became_peered":"2023-10-08T06:57:17.335307+0000","last_unstale":"2023-10-08T06:57:46.251703+0000","last_undegraded":"2023-10-08T06:57:46.251703+0000","last_fullsized":"2023-10-08T06:57:46.251703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"27'1814","reported_seq":1829,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.954186+0000","last_change":"2023-10-08T06:57:39.155458+0000","last_active":"2023-10-08T06:57:48.954186+0000","last_peered":"2023-10-08T06:57:48.954186+0000","last_clean":"2023-10-08T06:57:48.954186+0000","last_became_active":"2023-10-08T06:57:39.154739+0000","last_became_peered":"2023-10-08T06:57:39.154739+0000","last_unstale":"2023-10-08T06:57:48.954186+0000","last_undegraded":"2023-10-08T06:57:48.954186+0000","last_fullsized":"2023-10-08T06:57:48.954186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1814,"log_dups_size":0,"ondisk_log_size":1814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:38.627979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118882304,"num_objects":1814,"num_object_clones":0,"num_object_copies":3628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1814,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1814,"num_write_kb":116096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252702+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T06:57:46.252702+0000","last_peered":"2023-10-08T06:57:46.252702+0000","last_clean":"2023-10-08T06:57:46.252702+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T06:57:46.252702+0000","last_undegraded":"2023-10-08T06:57:46.252702+0000","last_fullsized":"2023-10-08T06:57:46.252702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.247944+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T06:57:46.247944+0000","last_peered":"2023-10-08T06:57:46.247944+0000","last_clean":"2023-10-08T06:57:46.247944+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T06:57:46.247944+0000","last_undegraded":"2023-10-08T06:57:46.247944+0000","last_fullsized":"2023-10-08T06:57:46.247944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"27'1780","reported_seq":1796,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.960223+0000","last_change":"2023-10-08T06:57:39.154564+0000","last_active":"2023-10-08T06:57:48.960223+0000","last_peered":"2023-10-08T06:57:48.960223+0000","last_clean":"2023-10-08T06:57:48.960223+0000","last_became_active":"2023-10-08T06:57:39.154365+0000","last_became_peered":"2023-10-08T06:57:39.154365+0000","last_unstale":"2023-10-08T06:57:48.960223+0000","last_undegraded":"2023-10-08T06:57:48.960223+0000","last_fullsized":"2023-10-08T06:57:48.960223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:29:01.279954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116654080,"num_objects":1780,"num_object_clones":0,"num_object_copies":3560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1780,"num_write_kb":113920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248855+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T06:57:46.248855+0000","last_peered":"2023-10-08T06:57:46.248855+0000","last_clean":"2023-10-08T06:57:46.248855+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T06:57:46.248855+0000","last_undegraded":"2023-10-08T06:57:46.248855+0000","last_fullsized":"2023-10-08T06:57:46.248855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248180+0000","last_change":"2023-10-08T06:57:17.331620+0000","last_active":"2023-10-08T06:57:46.248180+0000","last_peered":"2023-10-08T06:57:46.248180+0000","last_clean":"2023-10-08T06:57:46.248180+0000","last_became_active":"2023-10-08T06:57:17.330740+0000","last_became_peered":"2023-10-08T06:57:17.330740+0000","last_unstale":"2023-10-08T06:57:46.248180+0000","last_undegraded":"2023-10-08T06:57:46.248180+0000","last_fullsized":"2023-10-08T06:57:46.248180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:20.238263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"27'1779","reported_seq":1795,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.936779+0000","last_change":"2023-10-08T06:57:39.154532+0000","last_active":"2023-10-08T06:57:48.936779+0000","last_peered":"2023-10-08T06:57:48.936779+0000","last_clean":"2023-10-08T06:57:48.936779+0000","last_became_active":"2023-10-08T06:57:39.154247+0000","last_became_peered":"2023-10-08T06:57:39.154247+0000","last_unstale":"2023-10-08T06:57:48.936779+0000","last_undegraded":"2023-10-08T06:57:48.936779+0000","last_fullsized":"2023-10-08T06:57:48.936779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:38.627979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116588544,"num_objects":1779,"num_object_clones":0,"num_object_copies":3558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1779,"num_write_kb":113856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251986+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T06:57:46.251986+0000","last_peered":"2023-10-08T06:57:46.251986+0000","last_clean":"2023-10-08T06:57:46.251986+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T06:57:46.251986+0000","last_undegraded":"2023-10-08T06:57:46.251986+0000","last_fullsized":"2023-10-08T06:57:46.251986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251365+0000","last_change":"2023-10-08T06:57:17.332801+0000","last_active":"2023-10-08T06:57:46.251365+0000","last_peered":"2023-10-08T06:57:46.251365+0000","last_clean":"2023-10-08T06:57:46.251365+0000","last_became_active":"2023-10-08T06:57:17.331122+0000","last_became_peered":"2023-10-08T06:57:17.331122+0000","last_unstale":"2023-10-08T06:57:46.251365+0000","last_undegraded":"2023-10-08T06:57:46.251365+0000","last_fullsized":"2023-10-08T06:57:46.251365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"27'1717","reported_seq":1733,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.939807+0000","last_change":"2023-10-08T06:57:39.155962+0000","last_active":"2023-10-08T06:57:48.939807+0000","last_peered":"2023-10-08T06:57:48.939807+0000","last_clean":"2023-10-08T06:57:48.939807+0000","last_became_active":"2023-10-08T06:57:39.155708+0000","last_became_peered":"2023-10-08T06:57:39.155708+0000","last_unstale":"2023-10-08T06:57:48.939807+0000","last_undegraded":"2023-10-08T06:57:48.939807+0000","last_fullsized":"2023-10-08T06:57:48.939807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:53:30.571251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112525312,"num_objects":1717,"num_object_clones":0,"num_object_copies":3434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1717,"num_write_kb":109888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251286+0000","last_change":"2023-10-08T06:57:16.315403+0000","last_active":"2023-10-08T06:57:46.251286+0000","last_peered":"2023-10-08T06:57:46.251286+0000","last_clean":"2023-10-08T06:57:46.251286+0000","last_became_active":"2023-10-08T06:57:16.314864+0000","last_became_peered":"2023-10-08T06:57:16.314864+0000","last_unstale":"2023-10-08T06:57:46.251286+0000","last_undegraded":"2023-10-08T06:57:46.251286+0000","last_fullsized":"2023-10-08T06:57:46.251286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:19.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250179+0000","last_change":"2023-10-08T06:57:17.340333+0000","last_active":"2023-10-08T06:57:46.250179+0000","last_peered":"2023-10-08T06:57:46.250179+0000","last_clean":"2023-10-08T06:57:46.250179+0000","last_became_active":"2023-10-08T06:57:17.339970+0000","last_became_peered":"2023-10-08T06:57:17.339970+0000","last_unstale":"2023-10-08T06:57:46.250179+0000","last_undegraded":"2023-10-08T06:57:46.250179+0000","last_fullsized":"2023-10-08T06:57:46.250179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"27'1809","reported_seq":1823,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.956668+0000","last_change":"2023-10-08T06:57:39.157387+0000","last_active":"2023-10-08T06:57:48.956668+0000","last_peered":"2023-10-08T06:57:48.956668+0000","last_clean":"2023-10-08T06:57:48.956668+0000","last_became_active":"2023-10-08T06:57:39.157160+0000","last_became_peered":"2023-10-08T06:57:39.157160+0000","last_unstale":"2023-10-08T06:57:48.956668+0000","last_undegraded":"2023-10-08T06:57:48.956668+0000","last_fullsized":"2023-10-08T06:57:48.956668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1809,"log_dups_size":0,"ondisk_log_size":1809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:31.452901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118554624,"num_objects":1809,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1809,"num_write_kb":115776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249950+0000","last_change":"2023-10-08T06:57:16.320583+0000","last_active":"2023-10-08T06:57:46.249950+0000","last_peered":"2023-10-08T06:57:46.249950+0000","last_clean":"2023-10-08T06:57:46.249950+0000","last_became_active":"2023-10-08T06:57:16.320001+0000","last_became_peered":"2023-10-08T06:57:16.320001+0000","last_unstale":"2023-10-08T06:57:46.249950+0000","last_undegraded":"2023-10-08T06:57:46.249950+0000","last_fullsized":"2023-10-08T06:57:46.249950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251303+0000","last_change":"2023-10-08T06:57:17.333272+0000","last_active":"2023-10-08T06:57:46.251303+0000","last_peered":"2023-10-08T06:57:46.251303+0000","last_clean":"2023-10-08T06:57:46.251303+0000","last_became_active":"2023-10-08T06:57:17.332823+0000","last_became_peered":"2023-10-08T06:57:17.332823+0000","last_unstale":"2023-10-08T06:57:46.251303+0000","last_undegraded":"2023-10-08T06:57:46.251303+0000","last_fullsized":"2023-10-08T06:57:46.251303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:44.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"27'1924","reported_seq":1940,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.937021+0000","last_change":"2023-10-08T06:57:39.157432+0000","last_active":"2023-10-08T06:57:48.937021+0000","last_peered":"2023-10-08T06:57:48.937021+0000","last_clean":"2023-10-08T06:57:48.937021+0000","last_became_active":"2023-10-08T06:57:39.157165+0000","last_became_peered":"2023-10-08T06:57:39.157165+0000","last_unstale":"2023-10-08T06:57:48.937021+0000","last_undegraded":"2023-10-08T06:57:48.937021+0000","last_fullsized":"2023-10-08T06:57:48.937021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:29:01.279954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126091264,"num_objects":1924,"num_object_clones":0,"num_object_copies":3848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1924,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1924,"num_write_kb":123136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:47.252999+0000","last_change":"2023-10-08T06:57:46.249947+0000","last_active":"2023-10-08T06:57:47.252999+0000","last_peered":"2023-10-08T06:57:47.252999+0000","last_clean":"2023-10-08T06:57:47.252999+0000","last_became_active":"2023-10-08T06:57:46.249629+0000","last_became_peered":"2023-10-08T06:57:46.249629+0000","last_unstale":"2023-10-08T06:57:47.252999+0000","last_undegraded":"2023-10-08T06:57:47.252999+0000","last_fullsized":"2023-10-08T06:57:47.252999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:09:20.219584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252302+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T06:57:46.252302+0000","last_peered":"2023-10-08T06:57:46.252302+0000","last_clean":"2023-10-08T06:57:46.252302+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T06:57:46.252302+0000","last_undegraded":"2023-10-08T06:57:46.252302+0000","last_fullsized":"2023-10-08T06:57:46.252302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"27'1882","reported_seq":1898,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.954112+0000","last_change":"2023-10-08T06:57:39.157059+0000","last_active":"2023-10-08T06:57:48.954112+0000","last_peered":"2023-10-08T06:57:48.954112+0000","last_clean":"2023-10-08T06:57:48.954112+0000","last_became_active":"2023-10-08T06:57:39.156884+0000","last_became_peered":"2023-10-08T06:57:39.156884+0000","last_unstale":"2023-10-08T06:57:48.954112+0000","last_undegraded":"2023-10-08T06:57:48.954112+0000","last_fullsized":"2023-10-08T06:57:48.954112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:31.452901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123338752,"num_objects":1882,"num_object_clones":0,"num_object_copies":3764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1882,"num_write_kb":120448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.247948+0000","last_change":"2023-10-08T06:57:16.322763+0000","last_active":"2023-10-08T06:57:46.247948+0000","last_peered":"2023-10-08T06:57:46.247948+0000","last_clean":"2023-10-08T06:57:46.247948+0000","last_became_active":"2023-10-08T06:57:16.322416+0000","last_became_peered":"2023-10-08T06:57:16.322416+0000","last_unstale":"2023-10-08T06:57:46.247948+0000","last_undegraded":"2023-10-08T06:57:46.247948+0000","last_fullsized":"2023-10-08T06:57:46.247948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:59.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252030+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T06:57:46.252030+0000","last_peered":"2023-10-08T06:57:46.252030+0000","last_clean":"2023-10-08T06:57:46.252030+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T06:57:46.252030+0000","last_undegraded":"2023-10-08T06:57:46.252030+0000","last_fullsized":"2023-10-08T06:57:46.252030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"27'1839","reported_seq":1855,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.960208+0000","last_change":"2023-10-08T06:57:39.154534+0000","last_active":"2023-10-08T06:57:48.960208+0000","last_peered":"2023-10-08T06:57:48.960208+0000","last_clean":"2023-10-08T06:57:48.960208+0000","last_became_active":"2023-10-08T06:57:39.154294+0000","last_became_peered":"2023-10-08T06:57:39.154294+0000","last_unstale":"2023-10-08T06:57:48.960208+0000","last_undegraded":"2023-10-08T06:57:48.960208+0000","last_fullsized":"2023-10-08T06:57:48.960208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1839,"log_dups_size":0,"ondisk_log_size":1839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:52.786548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120520704,"num_objects":1839,"num_object_clones":0,"num_object_copies":3678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1839,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":117696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248096+0000","last_change":"2023-10-08T06:57:16.320380+0000","last_active":"2023-10-08T06:57:46.248096+0000","last_peered":"2023-10-08T06:57:46.248096+0000","last_clean":"2023-10-08T06:57:46.248096+0000","last_became_active":"2023-10-08T06:57:16.320051+0000","last_became_peered":"2023-10-08T06:57:16.320051+0000","last_unstale":"2023-10-08T06:57:46.248096+0000","last_undegraded":"2023-10-08T06:57:46.248096+0000","last_fullsized":"2023-10-08T06:57:46.248096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:23.394610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251473+0000","last_change":"2023-10-08T06:57:17.331324+0000","last_active":"2023-10-08T06:57:46.251473+0000","last_peered":"2023-10-08T06:57:46.251473+0000","last_clean":"2023-10-08T06:57:46.251473+0000","last_became_active":"2023-10-08T06:57:17.329881+0000","last_became_peered":"2023-10-08T06:57:17.329881+0000","last_unstale":"2023-10-08T06:57:46.251473+0000","last_undegraded":"2023-10-08T06:57:46.251473+0000","last_fullsized":"2023-10-08T06:57:46.251473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:21.163785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"27'1829","reported_seq":1845,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.943637+0000","last_change":"2023-10-08T06:57:39.157419+0000","last_active":"2023-10-08T06:57:48.943637+0000","last_peered":"2023-10-08T06:57:48.943637+0000","last_clean":"2023-10-08T06:57:48.943637+0000","last_became_active":"2023-10-08T06:57:39.157158+0000","last_became_peered":"2023-10-08T06:57:39.157158+0000","last_unstale":"2023-10-08T06:57:48.943637+0000","last_undegraded":"2023-10-08T06:57:48.943637+0000","last_fullsized":"2023-10-08T06:57:48.943637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1829,"log_dups_size":0,"ondisk_log_size":1829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:21.765406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119865344,"num_objects":1829,"num_object_clones":0,"num_object_copies":3658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1829,"num_write_kb":117056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250593+0000","last_change":"2023-10-08T06:57:11.300853+0000","last_active":"2023-10-08T06:57:46.250593+0000","last_peered":"2023-10-08T06:57:46.250593+0000","last_clean":"2023-10-08T06:57:46.250593+0000","last_became_active":"2023-10-08T06:57:11.300496+0000","last_became_peered":"2023-10-08T06:57:11.300496+0000","last_unstale":"2023-10-08T06:57:46.250593+0000","last_undegraded":"2023-10-08T06:57:46.250593+0000","last_fullsized":"2023-10-08T06:57:46.250593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:36.886985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252147+0000","last_change":"2023-10-08T06:57:16.319835+0000","last_active":"2023-10-08T06:57:46.252147+0000","last_peered":"2023-10-08T06:57:46.252147+0000","last_clean":"2023-10-08T06:57:46.252147+0000","last_became_active":"2023-10-08T06:57:16.318756+0000","last_became_peered":"2023-10-08T06:57:16.318756+0000","last_unstale":"2023-10-08T06:57:46.252147+0000","last_undegraded":"2023-10-08T06:57:46.252147+0000","last_fullsized":"2023-10-08T06:57:46.252147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:14.117279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248484+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T06:57:46.248484+0000","last_peered":"2023-10-08T06:57:46.248484+0000","last_clean":"2023-10-08T06:57:46.248484+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T06:57:46.248484+0000","last_undegraded":"2023-10-08T06:57:46.248484+0000","last_fullsized":"2023-10-08T06:57:46.248484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'1741","reported_seq":1756,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.952494+0000","last_change":"2023-10-08T06:57:39.157402+0000","last_active":"2023-10-08T06:57:48.952494+0000","last_peered":"2023-10-08T06:57:48.952494+0000","last_clean":"2023-10-08T06:57:48.952494+0000","last_became_active":"2023-10-08T06:57:39.157178+0000","last_became_peered":"2023-10-08T06:57:39.157178+0000","last_unstale":"2023-10-08T06:57:48.952494+0000","last_undegraded":"2023-10-08T06:57:48.952494+0000","last_fullsized":"2023-10-08T06:57:48.952494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:58:03.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114098176,"num_objects":1741,"num_object_clones":0,"num_object_copies":3482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1741,"num_write_kb":111424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251482+0000","last_change":"2023-10-08T06:57:11.301991+0000","last_active":"2023-10-08T06:57:46.251482+0000","last_peered":"2023-10-08T06:57:46.251482+0000","last_clean":"2023-10-08T06:57:46.251482+0000","last_became_active":"2023-10-08T06:57:11.301729+0000","last_became_peered":"2023-10-08T06:57:11.301729+0000","last_unstale":"2023-10-08T06:57:46.251482+0000","last_undegraded":"2023-10-08T06:57:46.251482+0000","last_fullsized":"2023-10-08T06:57:46.251482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251473+0000","last_change":"2023-10-08T06:57:16.317845+0000","last_active":"2023-10-08T06:57:46.251473+0000","last_peered":"2023-10-08T06:57:46.251473+0000","last_clean":"2023-10-08T06:57:46.251473+0000","last_became_active":"2023-10-08T06:57:16.316912+0000","last_became_peered":"2023-10-08T06:57:16.316912+0000","last_unstale":"2023-10-08T06:57:46.251473+0000","last_undegraded":"2023-10-08T06:57:46.251473+0000","last_fullsized":"2023-10-08T06:57:46.251473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250410+0000","last_change":"2023-10-08T06:57:17.331008+0000","last_active":"2023-10-08T06:57:46.250410+0000","last_peered":"2023-10-08T06:57:46.250410+0000","last_clean":"2023-10-08T06:57:46.250410+0000","last_became_active":"2023-10-08T06:57:17.329935+0000","last_became_peered":"2023-10-08T06:57:17.329935+0000","last_unstale":"2023-10-08T06:57:46.250410+0000","last_undegraded":"2023-10-08T06:57:46.250410+0000","last_fullsized":"2023-10-08T06:57:46.250410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"27'1848","reported_seq":1864,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.948606+0000","last_change":"2023-10-08T06:57:39.160076+0000","last_active":"2023-10-08T06:57:48.948606+0000","last_peered":"2023-10-08T06:57:48.948606+0000","last_clean":"2023-10-08T06:57:48.948606+0000","last_became_active":"2023-10-08T06:57:39.159850+0000","last_became_peered":"2023-10-08T06:57:39.159850+0000","last_unstale":"2023-10-08T06:57:48.948606+0000","last_undegraded":"2023-10-08T06:57:48.948606+0000","last_fullsized":"2023-10-08T06:57:48.948606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1848,"log_dups_size":0,"ondisk_log_size":1848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:38.627979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121110528,"num_objects":1848,"num_object_clones":0,"num_object_copies":3696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1848,"num_write_kb":118272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249869+0000","last_change":"2023-10-08T06:57:11.300691+0000","last_active":"2023-10-08T06:57:46.249869+0000","last_peered":"2023-10-08T06:57:46.249869+0000","last_clean":"2023-10-08T06:57:46.249869+0000","last_became_active":"2023-10-08T06:57:11.300379+0000","last_became_peered":"2023-10-08T06:57:11.300379+0000","last_unstale":"2023-10-08T06:57:46.249869+0000","last_undegraded":"2023-10-08T06:57:46.249869+0000","last_fullsized":"2023-10-08T06:57:46.249869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:47:06.398923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248033+0000","last_change":"2023-10-08T06:57:16.321710+0000","last_active":"2023-10-08T06:57:46.248033+0000","last_peered":"2023-10-08T06:57:46.248033+0000","last_clean":"2023-10-08T06:57:46.248033+0000","last_became_active":"2023-10-08T06:57:16.321375+0000","last_became_peered":"2023-10-08T06:57:16.321375+0000","last_unstale":"2023-10-08T06:57:46.248033+0000","last_undegraded":"2023-10-08T06:57:46.248033+0000","last_fullsized":"2023-10-08T06:57:46.248033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:50.398991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252329+0000","last_change":"2023-10-08T06:57:17.331795+0000","last_active":"2023-10-08T06:57:46.252329+0000","last_peered":"2023-10-08T06:57:46.252329+0000","last_clean":"2023-10-08T06:57:46.252329+0000","last_became_active":"2023-10-08T06:57:17.330571+0000","last_became_peered":"2023-10-08T06:57:17.330571+0000","last_unstale":"2023-10-08T06:57:46.252329+0000","last_undegraded":"2023-10-08T06:57:46.252329+0000","last_fullsized":"2023-10-08T06:57:46.252329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"27'1796","reported_seq":1812,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.957373+0000","last_change":"2023-10-08T06:57:39.153128+0000","last_active":"2023-10-08T06:57:48.957373+0000","last_peered":"2023-10-08T06:57:48.957373+0000","last_clean":"2023-10-08T06:57:48.957373+0000","last_became_active":"2023-10-08T06:57:39.152958+0000","last_became_peered":"2023-10-08T06:57:39.152958+0000","last_unstale":"2023-10-08T06:57:48.957373+0000","last_undegraded":"2023-10-08T06:57:48.957373+0000","last_fullsized":"2023-10-08T06:57:48.957373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1796,"log_dups_size":0,"ondisk_log_size":1796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:36.914466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117702656,"num_objects":1796,"num_object_clones":0,"num_object_copies":3592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1796,"num_write_kb":114944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251547+0000","last_change":"2023-10-08T06:57:11.301992+0000","last_active":"2023-10-08T06:57:46.251547+0000","last_peered":"2023-10-08T06:57:46.251547+0000","last_clean":"2023-10-08T06:57:46.251547+0000","last_became_active":"2023-10-08T06:57:11.301736+0000","last_became_peered":"2023-10-08T06:57:11.301736+0000","last_unstale":"2023-10-08T06:57:46.251547+0000","last_undegraded":"2023-10-08T06:57:46.251547+0000","last_fullsized":"2023-10-08T06:57:46.251547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:13.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250671+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T06:57:46.250671+0000","last_peered":"2023-10-08T06:57:46.250671+0000","last_clean":"2023-10-08T06:57:46.250671+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T06:57:46.250671+0000","last_undegraded":"2023-10-08T06:57:46.250671+0000","last_fullsized":"2023-10-08T06:57:46.250671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249997+0000","last_change":"2023-10-08T06:57:16.320449+0000","last_active":"2023-10-08T06:57:46.249997+0000","last_peered":"2023-10-08T06:57:46.249997+0000","last_clean":"2023-10-08T06:57:46.249997+0000","last_became_active":"2023-10-08T06:57:16.319556+0000","last_became_peered":"2023-10-08T06:57:16.319556+0000","last_unstale":"2023-10-08T06:57:46.249997+0000","last_undegraded":"2023-10-08T06:57:46.249997+0000","last_fullsized":"2023-10-08T06:57:46.249997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:21.652977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252222+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T06:57:46.252222+0000","last_peered":"2023-10-08T06:57:46.252222+0000","last_clean":"2023-10-08T06:57:46.252222+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T06:57:46.252222+0000","last_undegraded":"2023-10-08T06:57:46.252222+0000","last_fullsized":"2023-10-08T06:57:46.252222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"27'1814","reported_seq":1830,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.957575+0000","last_change":"2023-10-08T06:57:39.160209+0000","last_active":"2023-10-08T06:57:48.957575+0000","last_peered":"2023-10-08T06:57:48.957575+0000","last_clean":"2023-10-08T06:57:48.957575+0000","last_became_active":"2023-10-08T06:57:39.160013+0000","last_became_peered":"2023-10-08T06:57:39.160013+0000","last_unstale":"2023-10-08T06:57:48.957575+0000","last_undegraded":"2023-10-08T06:57:48.957575+0000","last_fullsized":"2023-10-08T06:57:48.957575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1814,"log_dups_size":0,"ondisk_log_size":1814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:50.596224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118882304,"num_objects":1814,"num_object_clones":0,"num_object_copies":3628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1814,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1814,"num_write_kb":116096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250687+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T06:57:46.250687+0000","last_peered":"2023-10-08T06:57:46.250687+0000","last_clean":"2023-10-08T06:57:46.250687+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T06:57:46.250687+0000","last_undegraded":"2023-10-08T06:57:46.250687+0000","last_fullsized":"2023-10-08T06:57:46.250687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249677+0000","last_change":"2023-10-08T06:57:16.319467+0000","last_active":"2023-10-08T06:57:46.249677+0000","last_peered":"2023-10-08T06:57:46.249677+0000","last_clean":"2023-10-08T06:57:46.249677+0000","last_became_active":"2023-10-08T06:57:16.319091+0000","last_became_peered":"2023-10-08T06:57:16.319091+0000","last_unstale":"2023-10-08T06:57:46.249677+0000","last_undegraded":"2023-10-08T06:57:46.249677+0000","last_fullsized":"2023-10-08T06:57:46.249677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:56.233873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248967+0000","last_change":"2023-10-08T06:57:17.331162+0000","last_active":"2023-10-08T06:57:46.248967+0000","last_peered":"2023-10-08T06:57:46.248967+0000","last_clean":"2023-10-08T06:57:46.248967+0000","last_became_active":"2023-10-08T06:57:17.330773+0000","last_became_peered":"2023-10-08T06:57:17.330773+0000","last_unstale":"2023-10-08T06:57:46.248967+0000","last_undegraded":"2023-10-08T06:57:46.248967+0000","last_fullsized":"2023-10-08T06:57:46.248967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:36:38.949924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"27'1780","reported_seq":1796,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.943318+0000","last_change":"2023-10-08T06:57:39.158122+0000","last_active":"2023-10-08T06:57:48.943318+0000","last_peered":"2023-10-08T06:57:48.943318+0000","last_clean":"2023-10-08T06:57:48.943318+0000","last_became_active":"2023-10-08T06:57:39.157828+0000","last_became_peered":"2023-10-08T06:57:39.157828+0000","last_unstale":"2023-10-08T06:57:48.943318+0000","last_undegraded":"2023-10-08T06:57:48.943318+0000","last_fullsized":"2023-10-08T06:57:48.943318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:36.914466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116654080,"num_objects":1780,"num_object_clones":0,"num_object_copies":3560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1780,"num_write_kb":113920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248852+0000","last_change":"2023-10-08T06:57:11.302100+0000","last_active":"2023-10-08T06:57:46.248852+0000","last_peered":"2023-10-08T06:57:46.248852+0000","last_clean":"2023-10-08T06:57:46.248852+0000","last_became_active":"2023-10-08T06:57:11.301806+0000","last_became_peered":"2023-10-08T06:57:11.301806+0000","last_unstale":"2023-10-08T06:57:46.248852+0000","last_undegraded":"2023-10-08T06:57:46.248852+0000","last_fullsized":"2023-10-08T06:57:46.248852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:45.035589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250376+0000","last_change":"2023-10-08T06:57:16.320258+0000","last_active":"2023-10-08T06:57:46.250376+0000","last_peered":"2023-10-08T06:57:46.250376+0000","last_clean":"2023-10-08T06:57:46.250376+0000","last_became_active":"2023-10-08T06:57:16.319698+0000","last_became_peered":"2023-10-08T06:57:16.319698+0000","last_unstale":"2023-10-08T06:57:46.250376+0000","last_undegraded":"2023-10-08T06:57:46.250376+0000","last_fullsized":"2023-10-08T06:57:46.250376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:45.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248228+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T06:57:46.248228+0000","last_peered":"2023-10-08T06:57:46.248228+0000","last_clean":"2023-10-08T06:57:46.248228+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T06:57:46.248228+0000","last_undegraded":"2023-10-08T06:57:46.248228+0000","last_fullsized":"2023-10-08T06:57:46.248228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"27'1785","reported_seq":1801,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.950847+0000","last_change":"2023-10-08T06:57:39.157907+0000","last_active":"2023-10-08T06:57:48.950847+0000","last_peered":"2023-10-08T06:57:48.950847+0000","last_clean":"2023-10-08T06:57:48.950847+0000","last_became_active":"2023-10-08T06:57:39.157721+0000","last_became_peered":"2023-10-08T06:57:39.157721+0000","last_unstale":"2023-10-08T06:57:48.950847+0000","last_undegraded":"2023-10-08T06:57:48.950847+0000","last_fullsized":"2023-10-08T06:57:48.950847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1785,"log_dups_size":0,"ondisk_log_size":1785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:52.786548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116981760,"num_objects":1785,"num_object_clones":0,"num_object_copies":3570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1785,"num_write_kb":114240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251476+0000","last_change":"2023-10-08T06:57:16.321492+0000","last_active":"2023-10-08T06:57:46.251476+0000","last_peered":"2023-10-08T06:57:46.251476+0000","last_clean":"2023-10-08T06:57:46.251476+0000","last_became_active":"2023-10-08T06:57:16.320728+0000","last_became_peered":"2023-10-08T06:57:16.320728+0000","last_unstale":"2023-10-08T06:57:46.251476+0000","last_undegraded":"2023-10-08T06:57:46.251476+0000","last_fullsized":"2023-10-08T06:57:46.251476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250774+0000","last_change":"2023-10-08T06:57:11.300726+0000","last_active":"2023-10-08T06:57:46.250774+0000","last_peered":"2023-10-08T06:57:46.250774+0000","last_clean":"2023-10-08T06:57:46.250774+0000","last_became_active":"2023-10-08T06:57:11.300410+0000","last_became_peered":"2023-10-08T06:57:11.300410+0000","last_unstale":"2023-10-08T06:57:46.250774+0000","last_undegraded":"2023-10-08T06:57:46.250774+0000","last_fullsized":"2023-10-08T06:57:46.250774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:28.154023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249783+0000","last_change":"2023-10-08T06:57:17.340378+0000","last_active":"2023-10-08T06:57:46.249783+0000","last_peered":"2023-10-08T06:57:46.249783+0000","last_clean":"2023-10-08T06:57:46.249783+0000","last_became_active":"2023-10-08T06:57:17.340058+0000","last_became_peered":"2023-10-08T06:57:17.340058+0000","last_unstale":"2023-10-08T06:57:46.249783+0000","last_undegraded":"2023-10-08T06:57:46.249783+0000","last_fullsized":"2023-10-08T06:57:46.249783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:38.451178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"27'1755","reported_seq":1771,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T06:57:48.950914+0000","last_change":"2023-10-08T06:57:39.154630+0000","last_active":"2023-10-08T06:57:48.950914+0000","last_peered":"2023-10-08T06:57:48.950914+0000","last_clean":"2023-10-08T06:57:48.950914+0000","last_became_active":"2023-10-08T06:57:39.154358+0000","last_became_peered":"2023-10-08T06:57:39.154358+0000","last_unstale":"2023-10-08T06:57:48.950914+0000","last_undegraded":"2023-10-08T06:57:48.950914+0000","last_fullsized":"2023-10-08T06:57:48.950914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:38.139123+0000","last_clean_scrub_stamp":"2023-10-08T06:57:38.139123+0000","objects_scrubbed":0,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:58:03.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115015680,"num_objects":1755,"num_object_clones":0,"num_object_copies":3510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1755,"num_write_kb":112320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.252711+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T06:57:46.252711+0000","last_peered":"2023-10-08T06:57:46.252711+0000","last_clean":"2023-10-08T06:57:46.252711+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T06:57:46.252711+0000","last_undegraded":"2023-10-08T06:57:46.252711+0000","last_fullsized":"2023-10-08T06:57:46.252711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250402+0000","last_change":"2023-10-08T06:57:16.321525+0000","last_active":"2023-10-08T06:57:46.250402+0000","last_peered":"2023-10-08T06:57:46.250402+0000","last_clean":"2023-10-08T06:57:46.250402+0000","last_became_active":"2023-10-08T06:57:16.320754+0000","last_became_peered":"2023-10-08T06:57:16.320754+0000","last_unstale":"2023-10-08T06:57:46.250402+0000","last_undegraded":"2023-10-08T06:57:46.250402+0000","last_fullsized":"2023-10-08T06:57:46.250402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:03.778450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248154+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T06:57:46.248154+0000","last_peered":"2023-10-08T06:57:46.248154+0000","last_clean":"2023-10-08T06:57:46.248154+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T06:57:46.248154+0000","last_undegraded":"2023-10-08T06:57:46.248154+0000","last_fullsized":"2023-10-08T06:57:46.248154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248280+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T06:57:46.248280+0000","last_peered":"2023-10-08T06:57:46.248280+0000","last_clean":"2023-10-08T06:57:46.248280+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T06:57:46.248280+0000","last_undegraded":"2023-10-08T06:57:46.248280+0000","last_fullsized":"2023-10-08T06:57:46.248280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248569+0000","last_change":"2023-10-08T06:57:17.335051+0000","last_active":"2023-10-08T06:57:46.248569+0000","last_peered":"2023-10-08T06:57:46.248569+0000","last_clean":"2023-10-08T06:57:46.248569+0000","last_became_active":"2023-10-08T06:57:17.334707+0000","last_became_peered":"2023-10-08T06:57:17.334707+0000","last_unstale":"2023-10-08T06:57:46.248569+0000","last_undegraded":"2023-10-08T06:57:46.248569+0000","last_fullsized":"2023-10-08T06:57:46.248569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:09.129324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251520+0000","last_change":"2023-10-08T06:57:16.318351+0000","last_active":"2023-10-08T06:57:46.251520+0000","last_peered":"2023-10-08T06:57:46.251520+0000","last_clean":"2023-10-08T06:57:46.251520+0000","last_became_active":"2023-10-08T06:57:16.317987+0000","last_became_peered":"2023-10-08T06:57:16.317987+0000","last_unstale":"2023-10-08T06:57:46.251520+0000","last_undegraded":"2023-10-08T06:57:46.251520+0000","last_fullsized":"2023-10-08T06:57:46.251520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:13.097582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251390+0000","last_change":"2023-10-08T06:57:17.334129+0000","last_active":"2023-10-08T06:57:46.251390+0000","last_peered":"2023-10-08T06:57:46.251390+0000","last_clean":"2023-10-08T06:57:46.251390+0000","last_became_active":"2023-10-08T06:57:17.331385+0000","last_became_peered":"2023-10-08T06:57:17.331385+0000","last_unstale":"2023-10-08T06:57:46.251390+0000","last_undegraded":"2023-10-08T06:57:46.251390+0000","last_fullsized":"2023-10-08T06:57:46.251390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248913+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T06:57:46.248913+0000","last_peered":"2023-10-08T06:57:46.248913+0000","last_clean":"2023-10-08T06:57:46.248913+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T06:57:46.248913+0000","last_undegraded":"2023-10-08T06:57:46.248913+0000","last_fullsized":"2023-10-08T06:57:46.248913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251274+0000","last_change":"2023-10-08T06:57:17.333270+0000","last_active":"2023-10-08T06:57:46.251274+0000","last_peered":"2023-10-08T06:57:46.251274+0000","last_clean":"2023-10-08T06:57:46.251274+0000","last_became_active":"2023-10-08T06:57:17.331477+0000","last_became_peered":"2023-10-08T06:57:17.331477+0000","last_unstale":"2023-10-08T06:57:46.251274+0000","last_undegraded":"2023-10-08T06:57:46.251274+0000","last_fullsized":"2023-10-08T06:57:46.251274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:55:28.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250594+0000","last_change":"2023-10-08T06:57:16.321371+0000","last_active":"2023-10-08T06:57:46.250594+0000","last_peered":"2023-10-08T06:57:46.250594+0000","last_clean":"2023-10-08T06:57:46.250594+0000","last_became_active":"2023-10-08T06:57:16.320698+0000","last_became_peered":"2023-10-08T06:57:16.320698+0000","last_unstale":"2023-10-08T06:57:46.250594+0000","last_undegraded":"2023-10-08T06:57:46.250594+0000","last_fullsized":"2023-10-08T06:57:46.250594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248288+0000","last_change":"2023-10-08T06:57:17.330307+0000","last_active":"2023-10-08T06:57:46.248288+0000","last_peered":"2023-10-08T06:57:46.248288+0000","last_clean":"2023-10-08T06:57:46.248288+0000","last_became_active":"2023-10-08T06:57:17.329927+0000","last_became_peered":"2023-10-08T06:57:17.329927+0000","last_unstale":"2023-10-08T06:57:46.248288+0000","last_undegraded":"2023-10-08T06:57:46.248288+0000","last_fullsized":"2023-10-08T06:57:46.248288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:36.087067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.251558+0000","last_change":"2023-10-08T06:57:16.321727+0000","last_active":"2023-10-08T06:57:46.251558+0000","last_peered":"2023-10-08T06:57:46.251558+0000","last_clean":"2023-10-08T06:57:46.251558+0000","last_became_active":"2023-10-08T06:57:16.320761+0000","last_became_peered":"2023-10-08T06:57:16.320761+0000","last_unstale":"2023-10-08T06:57:46.251558+0000","last_undegraded":"2023-10-08T06:57:46.251558+0000","last_fullsized":"2023-10-08T06:57:46.251558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250852+0000","last_change":"2023-10-08T06:57:17.331663+0000","last_active":"2023-10-08T06:57:46.250852+0000","last_peered":"2023-10-08T06:57:46.250852+0000","last_clean":"2023-10-08T06:57:46.250852+0000","last_became_active":"2023-10-08T06:57:17.331047+0000","last_became_peered":"2023-10-08T06:57:17.331047+0000","last_unstale":"2023-10-08T06:57:46.250852+0000","last_undegraded":"2023-10-08T06:57:46.250852+0000","last_fullsized":"2023-10-08T06:57:46.250852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250766+0000","last_change":"2023-10-08T06:57:17.331752+0000","last_active":"2023-10-08T06:57:46.250766+0000","last_peered":"2023-10-08T06:57:46.250766+0000","last_clean":"2023-10-08T06:57:46.250766+0000","last_became_active":"2023-10-08T06:57:17.331398+0000","last_became_peered":"2023-10-08T06:57:17.331398+0000","last_unstale":"2023-10-08T06:57:46.250766+0000","last_undegraded":"2023-10-08T06:57:46.250766+0000","last_fullsized":"2023-10-08T06:57:46.250766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:05.862932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.249791+0000","last_change":"2023-10-08T06:57:17.330546+0000","last_active":"2023-10-08T06:57:46.249791+0000","last_peered":"2023-10-08T06:57:46.249791+0000","last_clean":"2023-10-08T06:57:46.249791+0000","last_became_active":"2023-10-08T06:57:17.330052+0000","last_became_peered":"2023-10-08T06:57:17.330052+0000","last_unstale":"2023-10-08T06:57:46.249791+0000","last_undegraded":"2023-10-08T06:57:46.249791+0000","last_fullsized":"2023-10-08T06:57:46.249791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248560+0000","last_change":"2023-10-08T06:57:17.336558+0000","last_active":"2023-10-08T06:57:46.248560+0000","last_peered":"2023-10-08T06:57:46.248560+0000","last_clean":"2023-10-08T06:57:46.248560+0000","last_became_active":"2023-10-08T06:57:17.336077+0000","last_became_peered":"2023-10-08T06:57:17.336077+0000","last_unstale":"2023-10-08T06:57:46.248560+0000","last_undegraded":"2023-10-08T06:57:46.248560+0000","last_fullsized":"2023-10-08T06:57:46.248560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:51.412786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.250192+0000","last_change":"2023-10-08T06:57:17.330211+0000","last_active":"2023-10-08T06:57:46.250192+0000","last_peered":"2023-10-08T06:57:46.250192+0000","last_clean":"2023-10-08T06:57:46.250192+0000","last_became_active":"2023-10-08T06:57:17.329507+0000","last_became_peered":"2023-10-08T06:57:17.329507+0000","last_unstale":"2023-10-08T06:57:46.250192+0000","last_undegraded":"2023-10-08T06:57:46.250192+0000","last_fullsized":"2023-10-08T06:57:46.250192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:24:57.767053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-08T06:57:46.248599+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T06:57:46.248599+0000","last_peered":"2023-10-08T06:57:46.248599+0000","last_clean":"2023-10-08T06:57:46.248599+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T06:57:46.248599+0000","last_undegraded":"2023-10-08T06:57:46.248599+0000","last_fullsized":"2023-10-08T06:57:46.248599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1893466112,"num_objects":28892,"num_object_clones":0,"num_object_copies":57784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28892,"num_write_kb":1849088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":236748800,"data_stored":3787980800,"data_compressed":18126980,"data_compressed_allocated":236748800,"data_compressed_original":3787980800,"omap_allocated":0,"internal_metadata":0},"log_size":28892,"ondisk_log_size":28892,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136292,"kb_used_data":91224,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94235548,"statfs":{"total":96636764160,"available":96497201152,"internally_reserved":0,"allocated":93413376,"data_stored":1490384756,"data_compressed":7131408,"data_compressed_allocated":93143040,"data_compressed_original":1490288640,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119956,"kb_used_data":70728,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94251884,"statfs":{"total":96636764160,"available":96513929216,"internally_reserved":0,"allocated":72425472,"data_stored":1153859734,"data_compressed":5528129,"data_compressed_allocated":72110080,"data_compressed_original":1153744896,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106160,"kb_used_data":61088,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94265680,"statfs":{"total":96636764160,"available":96528056320,"internally_reserved":0,"allocated":62554112,"data_stored":996048430,"data_compressed":4772751,"data_compressed_allocated":62246912,"data_compressed_original":995934208,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":74690560,"data_stored":1195048960,"data_compressed":5718789,"data_compressed_allocated":74690560,"data_compressed_original":1195048960,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":66248704,"data_stored":1059979264,"data_compressed":5072369,"data_compressed_allocated":66248704,"data_compressed_original":1059979264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":95809536,"data_stored":1532952576,"data_compressed":7335822,"data_compressed_allocated":95809536,"data_compressed_original":1532952576,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:57:51.123 INFO:tasks.thrashosds.thrasher:Setting 4.3f to [1, 2] 2023-10-08T06:57:51.123 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.3f', '1', '2'] 2023-10-08T06:57:51.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.3f 1 2 2023-10-08T06:57:51.124 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:51.116+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:51.217 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:51.217+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:51.318 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:51.317+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:51.322 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:51.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 11 16 34993 34977 198.718 147.375 0.00938101 0.00502843 2023-10-08T06:57:51.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:51.418+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:51.505 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:51.506 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:51.516 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:51.560 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:51.559+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:51.620 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:51.620+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:51.705 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:51.705 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:51.718 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:51.758 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:51.757+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:51.822 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:51.821+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:51.923 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:51.922+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:51.941 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:51.942 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:51.956 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:52.026 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:52.024+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:52.126 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:52.125+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:52.131 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:52.131 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:52.145 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:52.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:52.226+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:set 4.3f pg_upmap mapping to [1,2] 2023-10-08T06:57:52.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:57:52.322 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:52.323 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:52.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:52.327+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:52.336 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:52.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:57:52.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 12 16 37570 37554 195.579 161.062 0.0039378 0.00510952 2023-10-08T06:57:52.429 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:52.428+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:52.523 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:52.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:52.529+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:52.543 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:52.553 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:52.553 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:57:52.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.930058682999999, 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011776666999999999, 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:52.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 140 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620716+0000", 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6199999999999999e-07 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620788+0000", 2023-10-08T06:57:52.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2639999999999996e-05 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620793+0000", 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9629999999999997e-06 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620796+0000", 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0359999999999998e-06 2023-10-08T06:57:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626432+0000", 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056358270000000004 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626511+0000", 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8640999999999995e-05 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.626653+0000", 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014228600000000001 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632155+0000", 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055017809999999999 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632438+0000", 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028323999999999998 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632471+0000", 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2484999999999998e-05 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632492+0000", 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1506e-05 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:52.561 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:52.562 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.929972045, 2023-10-08T06:57:52.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013962354, 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 141 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620803+0000", 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7000000000000001e-07 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620806+0000", 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.676e-06 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620810+0000", 2023-10-08T06:57:52.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.647e-06 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620812+0000", 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5019999999999999e-06 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627179+0000", 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0063668500000000003 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627272+0000", 2023-10-08T06:57:52.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3276000000000006e-05 2023-10-08T06:57:52.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627404+0000", 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131428 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632498+0000", 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005094164 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634675+0000", 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021769570000000002 2023-10-08T06:57:52.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634731+0000", 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6144999999999999e-05 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634765+0000", 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3439000000000003e-05 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13069 5.1 5:88cd8266:::benchmark_data_smithi037_101035_object13068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8516469989999997, 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013921543999999999, 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.575 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13069 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699128+0000", 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699202+0000", 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4029999999999994e-05 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699211+0000", 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5620000000000004e-06 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699218+0000", 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7660000000000001e-06 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699268+0000", 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0173999999999998e-05 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699381+0000", 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113522 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699486+0000", 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010518699999999999 2023-10-08T06:57:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704026+0000", 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045396569999999999 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.712963+0000", 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089374120000000005 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713016+0000", 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2243000000000001e-05 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713049+0000", 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3096000000000003e-05 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13071 5.1 5:8cd03df6:::benchmark_data_smithi037_101035_object13070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8515153909999995, 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013866906, 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13071 2023-10-08T06:57:52.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3599999999999999e-07 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699354+0000", 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4691999999999994e-05 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699360+0000", 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9159999999999998e-06 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699364+0000", 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0069999999999999e-06 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700173+0000", 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00080942500000000001 2023-10-08T06:57:52.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700294+0000", 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012094 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700392+0000", 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7575e-05 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704069+0000", 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036775950000000001 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713055+0000", 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089859989999999997 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713098+0000", 2023-10-08T06:57:52.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2211e-05 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713126+0000", 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.811e-05 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.588 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:14295 5.1 5:848f3e80:::benchmark_data_smithi037_101035_object14294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.4882876809999992, 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012720018, 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 14295 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062487+0000", 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8899999999999999e-07 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062614+0000", 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126389 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062623+0000", 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5480000000000007e-06 2023-10-08T06:57:52.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.062630+0000", 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8109999999999997e-06 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063015+0000", 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000385184 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063168+0000", 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015317999999999999 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.063310+0000", 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014111700000000001 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.067609+0000", 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042993060000000001 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075113+0000", 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0075037150000000002 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075165+0000", 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2695999999999998e-05 2023-10-08T06:57:52.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.075207+0000", 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1383e-05 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:52.595 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.4434735809999992, 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:57:52.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:26900 5.3 e27/20 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head v 27'1703, mlcod=27'1700)", 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:52.600 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.3221445339999995, 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016375165000000001, 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6699999999999999e-07 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228688+0000", 2023-10-08T06:57:52.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8009e-05 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228694+0000", 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3690000000000003e-06 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228705+0000", 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0019e-05 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228746+0000", 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1140000000000003e-05 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228766+0000", 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0310999999999999e-05 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.244952+0000", 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016186158999999999 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245005+0000", 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2791000000000003e-05 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:26906 5.3 e27/20 5:c1cb740d:::benchmark_data_smithi037_101035_object26905:head v 27'1704, mlcod=27'1701)", 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.231381+0000", 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.3193930490000003, 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013662163999999999, 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231381+0000", 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231381+0000", 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231382+0000", 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7199999999999999e-07 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231432+0000", 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0445999999999998e-05 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231441+0000", 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8519999999999993e-06 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231448+0000", 2023-10-08T06:57:52.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4939999999999997e-06 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231491+0000", 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2814e-05 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.231507+0000", 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5248e-05 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245009+0000", 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013502310999999999 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245043+0000", 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4527000000000003e-05 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.610 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:27426 5.7 5:ed7f1097:::benchmark_data_smithi037_101035_object27425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.410457+0000", 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1403176180000001, 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011739871000000001, 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.611 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 27426 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.410457+0000", 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.410457+0000", 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.410457+0000", 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5599999999999995e-07 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.410562+0000", 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010496 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.410570+0000", 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.410577+0000", 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2179999999999996e-06 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.412834+0000", 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002257289 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.412934+0000", 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9822999999999996e-05 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.413047+0000", 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011298600000000001 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.415339+0000", 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0022918159999999999 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.422101+0000", 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067626580000000004 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.422161+0000", 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9725000000000002e-05 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.422197+0000", 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5527000000000001e-05 2023-10-08T06:57:52.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:27710 5.9 5:9607a63e:::benchmark_data_smithi037_101035_object27709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.510487+0000", 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0402872089999997, 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011819669999999999, 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.618 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 27710 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.510487+0000", 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.510487+0000", 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.510487+0000", 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1600000000000002e-07 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.510510+0000", 2023-10-08T06:57:52.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2163000000000001e-05 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.510514+0000", 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6859999999999997e-06 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.510518+0000", 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2430000000000001e-06 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.511583+0000", 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001065222 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.511707+0000", 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012422900000000001 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.511862+0000", 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015540700000000001 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.516968+0000", 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051051120000000002 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.522253+0000", 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052853350000000004 2023-10-08T06:57:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.522286+0000", 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2697999999999998e-05 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.522307+0000", 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1158999999999999e-05 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.6772198409999999, 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:57:52.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:57:52.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:57:52.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.631 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.6703854529999997, 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.632 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:57:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:29781 5.2 5:4e41e2c7:::benchmark_data_smithi037_101035_object29780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.2742515779999999, 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013881332999999999, 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 29781 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.639 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7899999999999997e-07 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276572+0000", 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8396000000000002e-05 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276582+0000", 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0319999999999999e-05 2023-10-08T06:57:52.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276589+0000", 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0500000000000003e-06 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.277829+0000", 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001239513 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.277950+0000", 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121205 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278047+0000", 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7479000000000006e-05 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.283432+0000", 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053842109999999999 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290339+0000", 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069073900000000002 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290380+0000", 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0648000000000001e-05 2023-10-08T06:57:52.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290404+0000", 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4341999999999998e-05 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:29787 5.2 5:4b3264d9:::benchmark_data_smithi037_101035_object29786:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:49.278510+0000", 2023-10-08T06:57:52.645 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.2722641599999998, 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011989201, 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 29787 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278510+0000", 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278510+0000", 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278511+0000", 2023-10-08T06:57:52.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278576+0000", 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5296000000000006e-05 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278587+0000", 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1056999999999999e-05 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278595+0000", 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5229999999999998e-06 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278629+0000", 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4551999999999997e-05 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278711+0000", 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1495999999999994e-05 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278798+0000", 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7084999999999997e-05 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.283472+0000", 2023-10-08T06:57:52.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046745729999999996 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290439+0000", 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069661369999999999 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290476+0000", 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7740000000000001e-05 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290499+0000", 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2997999999999999e-05 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:31559 5.7 5:ef911ca4:::benchmark_data_smithi037_101035_object31558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.6090716949999999, 2023-10-08T06:57:52.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015291592999999999, 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 31559 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941704+0000", 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0869999999999999e-06 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941771+0000", 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7267000000000005e-05 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941782+0000", 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1253999999999999e-05 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941788+0000", 2023-10-08T06:57:52.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2999999999999998e-06 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941837+0000", 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8238000000000001e-05 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941976+0000", 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013968499999999999 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.942307+0000", 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00033071100000000003 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943850+0000", 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001542777 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956893+0000", 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013042672999999999 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956955+0000", 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2786999999999994e-05 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956994+0000", 2023-10-08T06:57:52.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8813999999999998e-05 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:31562 5.2 5:40ed5256:::benchmark_data_smithi037_101035_object31561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:49.943570+0000", 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.6072039179999997, 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013445479, 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.659 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.660 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.660 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.660 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 31562 2023-10-08T06:57:52.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.660 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943570+0000", 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943570+0000", 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943571+0000", 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943643+0000", 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2157999999999996e-05 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943654+0000", 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0997e-05 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943662+0000", 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.892e-06 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943702+0000", 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0232999999999999e-05 2023-10-08T06:57:52.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943800+0000", 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7608000000000005e-05 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943891+0000", 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1162999999999994e-05 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.945076+0000", 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011851769999999999 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956944+0000", 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011867782 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956988+0000", 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3600999999999998e-05 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.957016+0000", 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8076999999999999e-05 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.666 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32151 5.f 5:f6be1e0c:::benchmark_data_smithi037_101035_object32150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.162811+0000", 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.3879633060000001, 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011918242000000001, 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32151 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.162811+0000", 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.162811+0000", 2023-10-08T06:57:52.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.162812+0000", 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2500000000000004e-07 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.162916+0000", 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010442000000000001 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.162926+0000", 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5240000000000006e-06 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.162932+0000", 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.224e-06 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.162991+0000", 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8924e-05 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.163124+0000", 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133277 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.163265+0000", 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140493 2023-10-08T06:57:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.164751+0000", 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001486649 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.174636+0000", 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0098845740000000001 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.174692+0000", 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6334e-05 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.174729+0000", 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6998000000000001e-05 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32155 5.f 5:f017b763:::benchmark_data_smithi037_101035_object32154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.165214+0000", 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.3855604870000002, 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012577372999999999, 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32155 2023-10-08T06:57:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165214+0000", 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165214+0000", 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165214+0000", 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8400000000000004e-07 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165265+0000", 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0164000000000003e-05 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165275+0000", 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0169999999999999e-05 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165280+0000", 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3879999999999999e-06 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165328+0000", 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8128999999999999e-05 2023-10-08T06:57:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165466+0000", 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013745700000000001 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.165628+0000", 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000161927 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.166970+0000", 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001342219 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.177730+0000", 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010760139 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.177767+0000", 2023-10-08T06:57:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6977000000000002e-05 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.177791+0000", 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4119000000000001e-05 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32200 5.1 5:88d4e8c5:::benchmark_data_smithi037_101035_object32199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.3640534190000002, 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014682766, 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32200 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186722+0000", 2023-10-08T06:57:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186831+0000", 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109088 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186844+0000", 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2629999999999999e-05 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186851+0000", 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5870000000000004e-06 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192680+0000", 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058284460000000001 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192763+0000", 2023-10-08T06:57:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3529000000000006e-05 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192849+0000", 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5500999999999993e-05 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.198504+0000", 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056553050000000002 2023-10-08T06:57:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201342+0000", 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002838283 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201371+0000", 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8418000000000001e-05 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201404+0000", 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3027000000000001e-05 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32202 5.9 5:905793ff:::benchmark_data_smithi037_101035_object32201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.187592+0000", 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.3631820709999998, 2023-10-08T06:57:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013734802000000001, 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32202 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.187592+0000", 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.187592+0000", 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.187593+0000", 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8599999999999998e-07 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.187713+0000", 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119987 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.187722+0000", 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3989999999999993e-06 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.187729+0000", 2023-10-08T06:57:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5919999999999997e-06 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192675+0000", 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049456730000000003 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192798+0000", 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012384399999999999 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192932+0000", 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133478 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.195486+0000", 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025546140000000002 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201258+0000", 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057715550000000003 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201292+0000", 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4211000000000002e-05 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201327+0000", 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4762999999999999e-05 2023-10-08T06:57:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:52.694 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:52.695 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:52.696 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:52.694+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:52.696 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:57:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:57:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:57:52.795 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:52.794+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:52.873 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:52.873 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:52.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.873 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38851 5.d 5:bab6b552:::benchmark_data_smithi037_101035_object38850:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:52.873 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.867292+0000", 2023-10-08T06:57:52.873 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.005717743, 2023-10-08T06:57:52.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057390970000000003, 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38851 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867292+0000", 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867292+0000", 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867293+0000", 2023-10-08T06:57:52.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6899999999999997e-07 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867350+0000", 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7009000000000003e-05 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867361+0000", 2023-10-08T06:57:52.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0949e-05 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867366+0000", 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2140000000000004e-06 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867420+0000", 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4246000000000002e-05 2023-10-08T06:57:52.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867529+0000", 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108331 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.867647+0000", 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118405 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869483+0000", 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018363330000000001 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38862 5.d 5:b193db56:::benchmark_data_smithi037_101035_object38861:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.869751+0000", 2023-10-08T06:57:52.879 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.003258501, 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003336547, 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38862 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869751+0000", 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869751+0000", 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869752+0000", 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1800000000000004e-07 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869809+0000", 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999998e-05 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869819+0000", 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8260000000000005e-06 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869825+0000", 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4029999999999998e-06 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:52.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.869876+0000", 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1771999999999998e-05 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.870060+0000", 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018337599999999999 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.870252+0000", 2023-10-08T06:57:52.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019231700000000001 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.872241+0000", 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019891000000000002 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 2 2023-10-08T06:57:52.885 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:52.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:52.897 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:52.896+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:52.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:52.996+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:53.056 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:53.056 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:57:53.056 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:57:53.056 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:57:53.056 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:53.071 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:53.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:53.097+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:53.199 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:53.198+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.921924486999998, 2023-10-08T06:57:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013838266, 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328375+0000", 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.843e-06 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328384+0000", 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5669999999999995e-06 2023-10-08T06:57:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328397+0000", 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2925000000000001e-05 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328411+0000", 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.454e-05 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001114128 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329709+0000", 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018355199999999999 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329888+0000", 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179576 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332277+0000", 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023889419999999998 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342081+0000", 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098036779999999997 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342151+0000", 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0166999999999994e-05 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342208+0000", 2023-10-08T06:57:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7348e-05 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.921256737, 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013649668, 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329038+0000", 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329039+0000", 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3030000000000001e-06 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329046+0000", 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4690000000000002e-06 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329058+0000", 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2319e-05 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329068+0000", 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0036e-05 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329696+0000", 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062830000000000004 2023-10-08T06:57:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329836+0000", 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000139388 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329998+0000", 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016215399999999999 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.333392+0000", 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033940540000000001 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342572+0000", 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091795669999999996 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342641+0000", 2023-10-08T06:57:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9270000000000006e-05 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342688+0000", 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6808000000000003e-05 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3850773199999997, 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:57:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3826425640000002, 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:57:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3823691010000001, 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:57:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:57:53.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:57:53.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3822293300000004, 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.287 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:57:53.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:57:53.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:57:53.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3821424750000002, 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:57:53.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:57:53.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3820815670000002, 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:53.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:57:53.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3819723689999996, 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.308 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:57:53.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3793768110000002, 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.320 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3768000630000001, 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:57:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:57:53.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:57:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.327 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:31560 5.e 5:71d9d0f4:::benchmark_data_smithi037_101035_object31559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:49.941961+0000", 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.3083334440000001, 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015307685999999999, 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 31560 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.941961+0000", 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.941961+0000", 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.941962+0000", 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942038+0000", 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5724999999999997e-05 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942044+0000", 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5880000000000003e-06 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942048+0000", 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.313e-06 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942971+0000", 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00092279199999999997 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.943105+0000", 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013388899999999999 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.943213+0000", 2023-10-08T06:57:53.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108183 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.949054+0000", 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058405999999999996 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957182+0000", 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081276290000000008 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957233+0000", 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1950000000000002e-05 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957269+0000", 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5456000000000001e-05 2023-10-08T06:57:53.334 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:31561 5.0 5:0f9c915b:::benchmark_data_smithi037_101035_object31560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:49.942231+0000", 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.3080632140000001, 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015051689, 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.335 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 31561 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942231+0000", 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942231+0000", 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942232+0000", 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.61e-07 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942288+0000", 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5738000000000001e-05 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942296+0000", 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5420000000000005e-06 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942303+0000", 2023-10-08T06:57:53.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0939999999999996e-06 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942348+0000", 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5787000000000001e-05 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942480+0000", 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013140999999999999 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942611+0000", 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000131612 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.949061+0000", 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064497060000000004 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957158+0000", 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080964609999999992 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957246+0000", 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8187000000000001e-05 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957283+0000", 2023-10-08T06:57:53.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7391000000000002e-05 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:32156 5.0 5:0a343b50:::benchmark_data_smithi037_101035_object32155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.0841400569999999, 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015012665999999999, 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 32156 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0200000000000001e-07 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166217+0000", 2023-10-08T06:57:53.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1245000000000001e-05 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166227+0000", 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166233+0000", 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4310000000000002e-06 2023-10-08T06:57:53.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.168606+0000", 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023730610000000001 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.168695+0000", 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9158000000000003e-05 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.168822+0000", 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012675100000000001 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.172544+0000", 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003722047 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.181101+0000", 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008556971 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.181137+0000", 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6288999999999998e-05 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.181167+0000", 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0457999999999999e-05 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:32161 5.8 5:19b20b7c:::benchmark_data_smithi037_101035_object32160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:50.169776+0000", 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.080518906, 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014327424, 2023-10-08T06:57:53.349 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 32161 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169776+0000", 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169776+0000", 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169777+0000", 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169851+0000", 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4466000000000002e-05 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169861+0000", 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9219999999999992e-06 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169866+0000", 2023-10-08T06:57:53.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4360000000000001e-06 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169912+0000", 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5731e-05 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.170028+0000", 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011603 2023-10-08T06:57:53.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.170164+0000", 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001362 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.172571+0000", 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024063600000000002 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.184029+0000", 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011458398999999999 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.184074+0000", 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5160999999999997e-05 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.184103+0000", 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8957000000000001e-05 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38341 5.8 5:1de0ec6e:::benchmark_data_smithi037_101035_object38340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.656539+0000", 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.59375549699999997, 2023-10-08T06:57:53.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013533956, 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38341 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.656539+0000", 2023-10-08T06:57:53.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.656539+0000", 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.656540+0000", 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1299999999999999e-07 2023-10-08T06:57:53.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.656604+0000", 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4226999999999993e-05 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.656618+0000", 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4025e-05 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.656624+0000", 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8669999999999999e-06 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.657598+0000", 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097378600000000003 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.657690+0000", 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2598999999999999e-05 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.657790+0000", 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9448000000000001e-05 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.659751+0000", 2023-10-08T06:57:53.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019614440000000001 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.669981+0000", 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010229567 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.670048+0000", 2023-10-08T06:57:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6979999999999999e-05 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.670073+0000", 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5299999999999998e-05 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38567 5.e 5:7e0678cf:::benchmark_data_smithi037_101035_object38566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:53.363 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.50412199599999996, 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016004681999999999, 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38567 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:53.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746220+0000", 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6269e-05 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746228+0000", 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7960000000000001e-06 2023-10-08T06:57:53.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746238+0000", 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3419999999999997e-06 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746297+0000", 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9485999999999999e-05 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746395+0000", 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7388999999999999e-05 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746526+0000", 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013114100000000001 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.748377+0000", 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001851679 2023-10-08T06:57:53.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762072+0000", 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013694674 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762139+0000", 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7436999999999998e-05 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762177+0000", 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7876999999999997e-05 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38570 5.4 5:2a7ac47c:::benchmark_data_smithi037_101035_object38569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.50401413699999997, 2023-10-08T06:57:53.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01536218, 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38570 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3099999999999997e-07 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746326+0000", 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4518999999999998e-05 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746336+0000", 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0390999999999999e-05 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746344+0000", 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6359999999999994e-06 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746388+0000", 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4499999999999997e-05 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746500+0000", 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112025 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746628+0000", 2023-10-08T06:57:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012728300000000001 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.748361+0000", 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017339390000000001 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.761529+0000", 2023-10-08T06:57:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013167834 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.761602+0000", 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2923000000000006e-05 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.761643+0000", 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0499e-05 2023-10-08T06:57:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38981 5.8 5:139681d3:::benchmark_data_smithi037_101035_object38980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.330083032, 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016272268999999999, 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38981 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4600000000000005e-07 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920325+0000", 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112623 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920333+0000", 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7069999999999992e-06 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920339+0000", 2023-10-08T06:57:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926104+0000", 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057651339999999999 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926229+0000", 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125637 2023-10-08T06:57:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926371+0000", 2023-10-08T06:57:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141648 2023-10-08T06:57:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.928101+0000", 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017302859999999999 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936393+0000", 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0082914990000000008 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936448+0000", 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5322000000000003e-05 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936484+0000", 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5775999999999998e-05 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38983 5.e 5:75075bf5:::benchmark_data_smithi037_101035_object38982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.922492+0000", 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.32780226699999998, 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015684310999999999, 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38983 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922492+0000", 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922492+0000", 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922493+0000", 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3600000000000002e-07 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922572+0000", 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9012999999999997e-05 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922581+0000", 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1779999999999992e-06 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922587+0000", 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.927081+0000", 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044943630000000004 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.927219+0000", 2023-10-08T06:57:53.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013735 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.927365+0000", 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014589799999999999 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.931051+0000", 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036868140000000001 2023-10-08T06:57:53.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.938017+0000", 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069653689999999999 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.938137+0000", 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012012500000000001 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:53.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.938177+0000", 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9787999999999999e-05 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:53.393 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:53.395 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:53.393+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:57:53.396 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:53.397 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 13 16 40102 40086 192.707 158.25 0.00519551 0.00518554 2023-10-08T06:57:53.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:53.494+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:40665 5.6 5:6afde3ff:::benchmark_data_smithi037_101035_object40664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.581942+0000", 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0049070390000000002, 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049436979999999998, 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.589 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 40665 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.581942+0000", 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.581942+0000", 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.581943+0000", 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582004+0000", 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0807000000000002e-05 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582014+0000", 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6809999999999993e-06 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582020+0000", 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7870000000000004e-06 2023-10-08T06:57:53.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582078+0000", 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7537999999999997e-05 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582177+0000", 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9407000000000006e-05 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582282+0000", 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010422200000000001 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:40666 5.3 5:c6ea4076:::benchmark_data_smithi037_101035_object40665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.582041+0000", 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0048082480000000002, 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049360439999999997, 2023-10-08T06:57:53.594 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 40666 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582041+0000", 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582041+0000", 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582042+0000", 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582073+0000", 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1446999999999999e-05 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582080+0000", 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9630000000000001e-06 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582087+0000", 2023-10-08T06:57:53.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4220000000000003e-06 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582138+0000", 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0843000000000001e-05 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582281+0000", 2023-10-08T06:57:53.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014296999999999999 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582446+0000", 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000164427 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586196+0000", 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037506810000000001 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.599 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:40669 5.c 5:31ec295e:::benchmark_data_smithi037_101035_object40668:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.582982+0000", 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0038669350000000002, 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.004086887, 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:53.600 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 40669 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582982+0000", 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582982+0000", 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.582983+0000", 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7899999999999997e-07 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583036+0000", 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2432000000000002e-05 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583049+0000", 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3405e-05 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583057+0000", 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1559999999999995e-06 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583109+0000", 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2265999999999997e-05 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583246+0000", 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013702300000000001 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583373+0000", 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012615700000000001 2023-10-08T06:57:53.604 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:40670 5.6 5:6373370f:::benchmark_data_smithi037_101035_object40669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.583316+0000", 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.003532674, 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0038443119999999999, 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 40670 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583316+0000", 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583316+0000", 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583317+0000", 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0800000000000003e-07 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583381+0000", 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3952e-05 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583391+0000", 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0037999999999999e-05 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583399+0000", 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4780000000000002e-06 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585173+0000", 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0017742159999999999 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585333+0000", 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000159576 2023-10-08T06:57:53.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585490+0000", 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015707000000000001 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40663 5.e e30/20 5:74d3402d:::benchmark_data_smithi037_101035_object40662:head v 30'2595, mlcod=30'2593)", 2023-10-08T06:57:53.610 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.583703+0000", 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0031457429999999999, 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035360420000000001, 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583703+0000", 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583703+0000", 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583704+0000", 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7300000000000002e-07 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583741+0000", 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7565999999999999e-05 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583748+0000", 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.691e-06 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583754+0000", 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7980000000000002e-06 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583873+0000", 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000119187 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583894+0000", 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0611e-05 2023-10-08T06:57:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40664 5.b e30/20 5:dcc8b1dc:::benchmark_data_smithi037_101035_object40663:head v 30'2568, mlcod=30'2566)", 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.583763+0000", 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0030863309999999999, 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003542548, 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.615 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583763+0000", 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583763+0000", 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583763+0000", 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.96e-07 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583798+0000", 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4579000000000002e-05 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583805+0000", 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3969999999999997e-06 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583810+0000", 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2970000000000003e-06 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583855+0000", 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4097999999999997e-05 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583874+0000", 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9655000000000001e-05 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40667 5.4 e30/20 5:277f0aaa:::benchmark_data_smithi037_101035_object40666:head v 30'2516, mlcod=30'2514)", 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.583822+0000", 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0030273869999999999, 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003550812, 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583822+0000", 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583822+0000", 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583822+0000", 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.34e-07 2023-10-08T06:57:53.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583853+0000", 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1247000000000001e-05 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583860+0000", 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.251e-06 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583864+0000", 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8289999999999998e-06 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583940+0000", 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5621e-05 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.583959+0000", 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8533e-05 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40671 5.7 e30/20 5:ef92450e:::benchmark_data_smithi037_101035_object40670:head v 30'2500, mlcod=30'2498)", 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.584149+0000", 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0027000510000000002, 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032783370000000001, 2023-10-08T06:57:53.624 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584149+0000", 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584149+0000", 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584150+0000", 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9400000000000005e-07 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584207+0000", 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7799e-05 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584218+0000", 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0271999999999999e-05 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584224+0000", 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.964e-06 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584266+0000", 2023-10-08T06:57:53.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1788e-05 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584284+0000", 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8117999999999998e-05 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40673 5.4 e30/20 5:2e0cfb04:::benchmark_data_smithi037_101035_object40672:head v 30'2517, mlcod=30'2514)", 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.584544+0000", 2023-10-08T06:57:53.628 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0023048529999999999, 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002926218, 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584544+0000", 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584544+0000", 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584545+0000", 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9900000000000001e-07 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584611+0000", 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6581999999999994e-05 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584621+0000", 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1279999999999997e-06 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584627+0000", 2023-10-08T06:57:53.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6989999999999997e-06 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585365+0000", 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00073773100000000004 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585380+0000", 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5089000000000001e-05 2023-10-08T06:57:53.632 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40672 5.e e30/20 5:767626fe:::benchmark_data_smithi037_101035_object40671:head v 30'2596, mlcod=30'2593)", 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.584639+0000", 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0022100549999999998, 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028972780000000001, 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.633 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584639+0000", 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584639+0000", 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584640+0000", 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1500000000000005e-07 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584673+0000", 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3593000000000002e-05 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584680+0000", 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584685+0000", 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.074e-06 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585351+0000", 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066562000000000001 2023-10-08T06:57:53.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585369+0000", 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7904999999999999e-05 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:40675 5.6 5:64f72f60:::benchmark_data_smithi037_101035_object40674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.584893+0000", 2023-10-08T06:57:53.637 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.001956429, 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002713877, 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 40675 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584893+0000", 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584893+0000", 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584894+0000", 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4399999999999998e-07 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584955+0000", 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1302000000000004e-05 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584964+0000", 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8289999999999997e-06 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.584972+0000", 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9680000000000006e-06 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586971+0000", 2023-10-08T06:57:53.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001998882 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587114+0000", 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014314500000000001 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587263+0000", 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014951299999999999 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40676 5.e e30/20 5:71620cf2:::benchmark_data_smithi037_101035_object40675:head v 30'2597, mlcod=30'2593)", 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.585948+0000", 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00090105899999999995, 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001732567, 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585948+0000", 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585948+0000", 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.585949+0000", 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.37e-07 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586010+0000", 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1320000000000002e-05 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586019+0000", 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3889999999999994e-06 2023-10-08T06:57:53.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586024+0000", 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8879999999999996e-06 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586522+0000", 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00049774400000000005 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586541+0000", 2023-10-08T06:57:53.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9408000000000001e-05 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:40674 5.4 e30/20 5:2aa0421b:::benchmark_data_smithi037_101035_object40673:head v 30'2518, mlcod=30'2514)", 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.586037+0000", 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00081229200000000005, 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001708656, 2023-10-08T06:57:53.648 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586037+0000", 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586037+0000", 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586037+0000", 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6899999999999999e-07 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586092+0000", 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4471000000000001e-05 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586098+0000", 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5420000000000002e-06 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586102+0000", 2023-10-08T06:57:53.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5949999999999999e-06 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586396+0000", 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029407100000000002 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.586407+0000", 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.135e-05 2023-10-08T06:57:53.652 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(client.4555.0:40665 5.6 e30/20)", 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.587520+0000", 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9993286, 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00028889600000000002, 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587520+0000", 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587520+0000", 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587521+0000", 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1899999999999999e-07 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587522+0000", 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4810000000000001e-06 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587526+0000", 2023-10-08T06:57:53.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9820000000000002e-06 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587529+0000", 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9679999999999998e-06 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:40677 5.c 5:366e4e45:::benchmark_data_smithi037_101035_object40676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.587613+0000", 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9992361, 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00025810200000000002, 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 40677 2023-10-08T06:57:53.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587613+0000", 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587613+0000", 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587614+0000", 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.16e-07 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587717+0000", 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000102848 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587726+0000", 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3700000000000001e-06 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587732+0000", 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9970000000000004e-06 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587787+0000", 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4589000000000002e-05 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:40679 5.5 5:aca75b17:::benchmark_data_smithi037_101035_object40678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:53.587750+0000", 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4294967295.9990988, 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000203604, 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:53.661 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 40679 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587750+0000", 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587750+0000", 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587751+0000", 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5600000000000001e-07 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587783+0000", 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2564999999999997e-05 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587789+0000", 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3639999999999998e-06 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587793+0000", 2023-10-08T06:57:53.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9949999999999999e-06 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587834+0000", 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1601999999999999e-05 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:53.587941+0000", 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106869 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:53.665 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.666 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:53.666 INFO:teuthology.orchestra.run.smithi183.stdout: ], 2023-10-08T06:57:53.666 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 16 2023-10-08T06:57:53.666 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:53.667 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:53.668 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:53.666+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:53.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:53.767+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:53.853 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:53.853 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:57:53.854 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2023-10-08T06:57:53.854 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2023-10-08T06:57:53.854 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:53.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:53.868+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:53.870 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:53.971 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:53.970+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:54.063 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14433 5.6 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.9538245540000005, 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017532516000000001, 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.064 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14433 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106905+0000", 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106971+0000", 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5945000000000006e-05 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106979+0000", 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8739999999999995e-06 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106983+0000", 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3660000000000002e-06 2023-10-08T06:57:54.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107023+0000", 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9634e-05 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107137+0000", 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114747 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.068 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107229+0000", 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1775999999999997e-05 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108887+0000", 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016575100000000001 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124321+0000", 2023-10-08T06:57:54.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015434128 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124374+0000", 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2899000000000003e-05 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124437+0000", 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3016999999999997e-05 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.070 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19485 5.c 5:31c60dc6:::benchmark_data_smithi037_101035_object19484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.3479133339999994, 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014907449999999999, 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.071 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19485 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712815+0000", 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712816+0000", 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3399999999999998e-07 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712854+0000", 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7591e-05 2023-10-08T06:57:54.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712862+0000", 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4309999999999994e-06 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712869+0000", 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3520000000000003e-06 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.714984+0000", 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002115638 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715161+0000", 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017632800000000001 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.715296+0000", 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013528300000000001 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718545+0000", 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032489569999999998 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727623+0000", 2023-10-08T06:57:54.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0090785859999999996 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727684+0000", 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0278999999999997e-05 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727723+0000", 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9270999999999997e-05 2023-10-08T06:57:54.077 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:19486 5.c 5:3f8361ed:::benchmark_data_smithi037_101035_object19485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.3478467219999999, 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014972698, 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.078 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 19486 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712882+0000", 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712883+0000", 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712916+0000", 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3052999999999997e-05 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712925+0000", 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.38e-06 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.712931+0000", 2023-10-08T06:57:54.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0240000000000003e-06 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716123+0000", 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031922399999999998 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716228+0000", 2023-10-08T06:57:54.082 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010487 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.716365+0000", 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000136303 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.718584+0000", 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022193239999999999 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727789+0000", 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092049030000000004 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727822+0000", 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2848999999999997e-05 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:45.727855+0000", 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3160000000000001e-05 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:26900 5.3 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.8325589359999999, 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017031261999999998, 2023-10-08T06:57:54.085 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 26900 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228171+0000", 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.37e-07 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228232+0000", 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1746000000000001e-05 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228242+0000", 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0040999999999999e-05 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228250+0000", 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9140000000000008e-06 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228299+0000", 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8273999999999999e-05 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228429+0000", 2023-10-08T06:57:54.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129956 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228557+0000", 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012801199999999999 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.232147+0000", 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035903879999999999 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245130+0000", 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012982570000000001 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245177+0000", 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7830000000000001e-05 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245201+0000", 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3794e-05 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:26906 5.3 5:c1cb740d:::benchmark_data_smithi037_101035_object26905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.231036+0000", 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.8296929830000002, 2023-10-08T06:57:54.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014250792, 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 26906 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231036+0000", 2023-10-08T06:57:54.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231036+0000", 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231037+0000", 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8999999999999995e-07 2023-10-08T06:57:54.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231093+0000", 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6530999999999998e-05 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231106+0000", 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2376e-05 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231113+0000", 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7610000000000007e-06 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231151+0000", 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8021000000000001e-05 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231235+0000", 2023-10-08T06:57:54.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3404000000000003e-05 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.231318+0000", 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3293000000000004e-05 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.235989+0000", 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.004670581 2023-10-08T06:57:54.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245237+0000", 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092482020000000005 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245267+0000", 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0392e-05 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245287+0000", 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9341e-05 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28697 5.a 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:54.099 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.1902567900000003, 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.029866567, 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28697 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870473+0000", 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3200000000000005e-07 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870533+0000", 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9941000000000001e-05 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870549+0000", 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6688e-05 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870555+0000", 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9059999999999999e-06 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870617+0000", 2023-10-08T06:57:54.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1309999999999994e-05 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870732+0000", 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115198 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870813+0000", 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1542e-05 2023-10-08T06:57:54.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.874939+0000", 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041253219999999998 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900278+0000", 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025339897 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900315+0000", 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6229999999999997e-05 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900339+0000", 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3901e-05 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28699 5.a 5:5b28870b:::benchmark_data_smithi037_101035_object28698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.1873331409999999, 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.027162454999999999, 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.107 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28699 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:54.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.06e-07 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873473+0000", 2023-10-08T06:57:54.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6679000000000002e-05 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873487+0000", 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3597999999999999e-05 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873491+0000", 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.916e-06 2023-10-08T06:57:54.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873529+0000", 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7598000000000002e-05 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873626+0000", 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7367000000000005e-05 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873729+0000", 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010220799999999999 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880045+0000", 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063162089999999997 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900391+0000", 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020346212999999998 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900514+0000", 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012279700000000001 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900558+0000", 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4264000000000002e-05 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28704 5.a 5:576041a3:::benchmark_data_smithi037_101035_object28703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.1844568219999996, 2023-10-08T06:57:54.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.024376907999999999, 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28704 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:54.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876273+0000", 2023-10-08T06:57:54.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1099999999999995e-07 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876333+0000", 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0281000000000001e-05 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876341+0000", 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2859999999999999e-06 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876346+0000", 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9099999999999996e-06 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876382+0000", 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6164000000000001e-05 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876493+0000", 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001111 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876609+0000", 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000116128 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880067+0000", 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003457304 2023-10-08T06:57:54.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900600+0000", 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020532749999999999 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900629+0000", 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9323e-05 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900649+0000", 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0051000000000002e-05 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30811 5.c 5:33193cdf:::benchmark_data_smithi037_101035_object30810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.4010690539999997, 2023-10-08T06:57:54.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018643812999999999, 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30811 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:54.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9500000000000002e-07 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659715+0000", 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659724+0000", 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7280000000000007e-06 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659732+0000", 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664288+0000", 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045555680000000003 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664434+0000", 2023-10-08T06:57:54.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014595400000000001 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664590+0000", 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156599 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666251+0000", 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016600549999999999 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678240+0000", 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011989145999999999 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678278+0000", 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8389000000000001e-05 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678304+0000", 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5531e-05 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:31559 5.7 e27/20 5:ef911ca4:::benchmark_data_smithi037_101035_object31558:head v 27'1969, mlcod=27'1967)", 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.942409+0000", 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.1183194690000002, 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014373777000000001, 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.128 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942409+0000", 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942409+0000", 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942410+0000", 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4700000000000002e-07 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942469+0000", 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9091000000000001e-05 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942477+0000", 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0639999999999994e-06 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942482+0000", 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.293e-06 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942517+0000", 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.464e-05 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942536+0000", 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9392e-05 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.956732+0000", 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014195572 2023-10-08T06:57:54.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.956783+0000", 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1277999999999999e-05 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.133 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:31561 5.0 e27/20 5:0f9c915b:::benchmark_data_smithi037_101035_object31560:head v 27'1944, mlcod=27'1942)", 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.942712+0000", 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.1180165530000004, 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014088009, 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942712+0000", 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942712+0000", 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942713+0000", 2023-10-08T06:57:54.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.63e-07 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942791+0000", 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8652000000000005e-05 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942799+0000", 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0649999999999999e-06 2023-10-08T06:57:54.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942805+0000", 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3329999999999996e-06 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942910+0000", 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000104866 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.942926+0000", 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6813e-05 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.956745+0000", 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013818318 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.956800+0000", 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5498999999999998e-05 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:38550 5.7 e29/20 5:e4621c07:::benchmark_data_smithi037_101035_object38549:head v 29'2376, mlcod=29'2374)", 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.741996+0000", 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.318732673, 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01443706, 2023-10-08T06:57:54.139 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.741996+0000", 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.741996+0000", 2023-10-08T06:57:54.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.741997+0000", 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8500000000000001e-07 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.742117+0000", 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011993399999999999 2023-10-08T06:57:54.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.742124+0000", 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0990000000000001e-06 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.742129+0000", 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8810000000000004e-06 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.742173+0000", 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4471000000000002e-05 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.742185+0000", 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2101e-05 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745633+0000", 2023-10-08T06:57:54.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003448057 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756433+0000", 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010799832000000001 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.144 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38558 5.a 5:534da067:::benchmark_data_smithi037_101035_object38557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.3169272329999999, 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015151994, 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38558 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.145 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4499999999999996e-07 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743888+0000", 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5570999999999998e-05 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743900+0000", 2023-10-08T06:57:54.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1838000000000001e-05 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743907+0000", 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3189999999999997e-06 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743948+0000", 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1192000000000001e-05 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.744036+0000", 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7347000000000002e-05 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.744126+0000", 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0647000000000001e-05 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746077+0000", 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019509620000000001 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758866+0000", 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012788851 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758917+0000", 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1178999999999999e-05 2023-10-08T06:57:54.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758954+0000", 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6343000000000001e-05 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38560 5.c 5:31643017:::benchmark_data_smithi037_101035_object38559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:57:54.151 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.315124781, 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015913983, 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38560 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745605+0000", 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0699999999999996e-07 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745681+0000", 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5860999999999998e-05 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745690+0000", 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5619999999999993e-06 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745697+0000", 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5690000000000001e-06 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756602+0000", 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010904775 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756717+0000", 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115425 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756839+0000", 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012244400000000001 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761372+0000", 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045321939999999998 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761451+0000", 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9827000000000007e-05 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761490+0000", 2023-10-08T06:57:54.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8952999999999998e-05 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761518+0000", 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7665999999999999e-05 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38562 5.6 5:6537f88c:::benchmark_data_smithi037_101035_object38561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.314949089, 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016164101, 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38562 2023-10-08T06:57:54.159 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.160 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745781+0000", 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5199999999999995e-07 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745845+0000", 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4641000000000007e-05 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745854+0000", 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6670000000000002e-06 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745862+0000", 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0020000000000006e-06 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745897+0000", 2023-10-08T06:57:54.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5339999999999997e-05 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745976+0000", 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8535000000000006e-05 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746055+0000", 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9349000000000002e-05 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761759+0000", 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015703931000000001 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761839+0000", 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9800000000000002e-05 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761892+0000", 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3214000000000002e-05 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761944+0000", 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1770000000000001e-05 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38563 5.6 5:693ba6d4:::benchmark_data_smithi037_101035_object38562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.3148528210000001, 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019052401, 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38563 2023-10-08T06:57:54.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745877+0000", 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.99e-07 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745909+0000", 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2098999999999999e-05 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745917+0000", 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9559999999999997e-06 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745922+0000", 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7749999999999998e-06 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757816+0000", 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011893733 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757935+0000", 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011882799999999999 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.170 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758060+0000", 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000125217 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761820+0000", 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003759872 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764861+0000", 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030408420000000002 2023-10-08T06:57:54.171 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764895+0000", 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4248999999999997e-05 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764928+0000", 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3231000000000001e-05 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.172 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38564 5.6 5:646adcee:::benchmark_data_smithi037_101035_object38563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.314778344, 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021880430999999999, 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.173 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38564 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.174 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745951+0000", 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6400000000000002e-07 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746069+0000", 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000117945 2023-10-08T06:57:54.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746078+0000", 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4800000000000001e-06 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746084+0000", 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759452+0000", 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013368161 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759548+0000", 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5867999999999998e-05 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759671+0000", 2023-10-08T06:57:54.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012332700000000001 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764962+0000", 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052914839999999999 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767742+0000", 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027792110000000002 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767792+0000", 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0659999999999999e-05 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767831+0000", 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.854e-05 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38569 5.6 5:6346498c:::benchmark_data_smithi037_101035_object38568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.314514749, 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021737508999999999, 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.180 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38569 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:57:54.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746215+0000", 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4499999999999997e-07 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746278+0000", 2023-10-08T06:57:54.182 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3112000000000002e-05 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746285+0000", 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746291+0000", 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.993e-06 2023-10-08T06:57:54.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761964+0000", 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015672927 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762055+0000", 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0352999999999994e-05 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762165+0000", 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000109961 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764998+0000", 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028333960000000002 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767879+0000", 2023-10-08T06:57:54.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028805129999999999 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767921+0000", 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2070999999999998e-05 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767952+0000", 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0898999999999997e-05 2023-10-08T06:57:54.186 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:38567 5.e e29/20 5:7e0678cf:::benchmark_data_smithi037_101035_object38566:head v 29'2454, mlcod=29'2452)", 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.314058926, 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015302191999999999, 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.187 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.188 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0699999999999998e-07 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747567+0000", 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089657400000000003 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747576+0000", 2023-10-08T06:57:54.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1220000000000001e-06 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747583+0000", 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757799+0000", 2023-10-08T06:57:54.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010216767 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757811+0000", 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1685000000000001e-05 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761948+0000", 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041366959999999996 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761972+0000", 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4409e-05 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38571 5.6 5:66544174:::benchmark_data_smithi037_101035_object38570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.3130769920000001, 2023-10-08T06:57:54.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.026065827, 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38571 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:54.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:54.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2799999999999996e-07 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747680+0000", 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7137000000000001e-05 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747708+0000", 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8674e-05 2023-10-08T06:57:54.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747715+0000", 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.64e-06 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765069+0000", 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017353848000000002 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.196 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765144+0000", 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5306e-05 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765236+0000", 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2280000000000004e-05 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767868+0000", 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026313320000000001 2023-10-08T06:57:54.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773659+0000", 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057915329999999998 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773696+0000", 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7081e-05 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:54.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773718+0000", 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1367999999999999e-05 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:54.199 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:54.200 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:54.199+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:54.201 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:54.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:54.301+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:54.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 14 16 42659 42643 190.356 159.812 0.00824536 0.00525001 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42665 5.1 5:8f40fcd7:::benchmark_data_smithi037_101035_object42664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.365591+0000", 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0059085630000000004, 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005944179, 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.373 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42665 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365591+0000", 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365591+0000", 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365592+0000", 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6899999999999996e-07 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365810+0000", 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000218447 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365820+0000", 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8160000000000005e-06 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365825+0000", 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2089999999999996e-06 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365856+0000", 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0658999999999999e-05 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.365943+0000", 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7235000000000001e-05 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366020+0000", 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6718999999999995e-05 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368673+0000", 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026528770000000001 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42667 5.6 e30/20 5:6e2597cd:::benchmark_data_smithi037_101035_object42666:head v 30'2725, mlcod=30'2722)", 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0052609880000000003, 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053884600000000003, 2023-10-08T06:57:54.379 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366239+0000", 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5999999999999999e-07 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366284+0000", 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5608000000000001e-05 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366292+0000", 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7130000000000005e-06 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366297+0000", 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.288e-06 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366349+0000", 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1119999999999998e-05 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366368+0000", 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9619999999999998e-05 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42668 5.c e30/20 5:3b9470c4:::benchmark_data_smithi037_101035_object42667:head v 30'2777, mlcod=30'2773)", 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.004037428, 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004231945, 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:57:54.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367463+0000", 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6300000000000005e-07 2023-10-08T06:57:54.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367514+0000", 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1226e-05 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367523+0000", 2023-10-08T06:57:54.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1819999999999995e-06 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367529+0000", 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3980000000000004e-06 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367596+0000", 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6440999999999996e-05 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367614+0000", 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8428e-05 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42674 5.9 5:9f6fb609:::benchmark_data_smithi037_101035_object42673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.367922+0000", 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003576957, 2023-10-08T06:57:54.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038384220000000002, 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42674 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367922+0000", 2023-10-08T06:57:54.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367922+0000", 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367923+0000", 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7000000000000004e-07 2023-10-08T06:57:54.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367976+0000", 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3185e-05 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367985+0000", 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9760000000000001e-06 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367990+0000", 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0690000000000001e-06 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368610+0000", 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061959099999999996 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368740+0000", 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013011399999999999 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368860+0000", 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011974800000000001 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371646+0000", 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027866900000000001 2023-10-08T06:57:54.393 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42671 5.c e30/20 5:33980e00:::benchmark_data_smithi037_101035_object42670:head v 30'2778, mlcod=30'2773)", 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0034113910000000002, 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037628010000000001, 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.394 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368157+0000", 2023-10-08T06:57:54.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9062999999999999e-05 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368165+0000", 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6990000000000003e-06 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368169+0000", 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2509999999999996e-06 2023-10-08T06:57:54.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368646+0000", 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000476398 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368666+0000", 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0012000000000001e-05 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.398 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42676 5.3 e30/20 5:ca7cd2a1:::benchmark_data_smithi037_101035_object42675:head v 30'2685, mlcod=30'2683)", 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368420+0000", 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0030790930000000002, 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034962109999999999, 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368420+0000", 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368420+0000", 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368421+0000", 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0100000000000001e-07 2023-10-08T06:57:54.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368479+0000", 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8044000000000002e-05 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368484+0000", 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7540000000000003e-06 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368488+0000", 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4450000000000001e-06 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368532+0000", 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4100999999999997e-05 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368545+0000", 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3560999999999999e-05 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42675 5.1 5:8fc3f667:::benchmark_data_smithi037_101035_object42674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368579+0000", 2023-10-08T06:57:54.403 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002920326, 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034073329999999998, 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42675 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368579+0000", 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368579+0000", 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368580+0000", 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4000000000000001e-07 2023-10-08T06:57:54.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368621+0000", 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1335000000000003e-05 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368631+0000", 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0301e-05 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368638+0000", 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368701+0000", 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2595999999999995e-05 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368825+0000", 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012431899999999999 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368948+0000", 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122349 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371637+0000", 2023-10-08T06:57:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026895949999999999 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42677 5.9 5:932b56cb:::benchmark_data_smithi037_101035_object42676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002840852, 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034003779999999999, 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.409 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42677 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5499999999999998e-07 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368701+0000", 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2055999999999998e-05 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368724+0000", 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2889000000000001e-05 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368731+0000", 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8079999999999999e-06 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370177+0000", 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014464300000000001 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370291+0000", 2023-10-08T06:57:54.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011335100000000001 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370444+0000", 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015310399999999999 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42678 5.7 5:e4644b32:::benchmark_data_smithi037_101035_object42677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:54.414 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368758+0000", 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0027415899999999999, 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033459050000000001, 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42678 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368758+0000", 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368758+0000", 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368758+0000", 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3499999999999996e-07 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368785+0000", 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.618e-05 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368793+0000", 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9529999999999999e-06 2023-10-08T06:57:54.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368799+0000", 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3269999999999997e-06 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368846+0000", 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6931999999999997e-05 2023-10-08T06:57:54.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368975+0000", 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012884499999999999 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369147+0000", 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000172265 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42673 5.c e30/20 5:360ae71b:::benchmark_data_smithi037_101035_object42672:head v 30'2779, mlcod=30'2773)", 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.369712+0000", 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001786986, 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002433401, 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369712+0000", 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369712+0000", 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369713+0000", 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8100000000000003e-07 2023-10-08T06:57:54.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369771+0000", 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7917999999999997e-05 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369784+0000", 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3121e-05 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369791+0000", 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7150000000000001e-06 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.369963+0000", 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000171874 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370014+0000", 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1317999999999999e-05 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42681 5.7 5:ec73df5e:::benchmark_data_smithi037_101035_object42680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.370112+0000", 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0013871389999999999, 2023-10-08T06:57:54.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020791519999999999, 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42681 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370112+0000", 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370112+0000", 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370113+0000", 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2500000000000004e-07 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370143+0000", 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9569000000000001e-05 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370153+0000", 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0149999999999999e-05 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370160+0000", 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.041e-06 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370590+0000", 2023-10-08T06:57:54.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00043034399999999998 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370677+0000", 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7095000000000006e-05 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370765+0000", 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7721999999999998e-05 2023-10-08T06:57:54.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42682 5.5 e30/20 5:adaa5632:::benchmark_data_smithi037_101035_object42681:head v 30'2674, mlcod=30'2672)", 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.371128+0000", 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00037140600000000001, 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011439379999999999, 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.430 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371128+0000", 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371128+0000", 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371129+0000", 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0900000000000001e-07 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371197+0000", 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7970000000000001e-05 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371206+0000", 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2830000000000007e-06 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371213+0000", 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6560000000000003e-06 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371384+0000", 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017137599999999999 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371408+0000", 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4273999999999998e-05 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42684 5.d e30/20 5:bfa84eaf:::benchmark_data_smithi037_101035_object42683:head v 30'2603, mlcod=30'2601)", 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.372109+0000", 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9993906, 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023932599999999999, 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372109+0000", 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372109+0000", 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372109+0000", 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5300000000000004e-07 2023-10-08T06:57:54.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372160+0000", 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0213000000000002e-05 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372169+0000", 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0040000000000005e-06 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372173+0000", 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7650000000000001e-06 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372214+0000", 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0598e-05 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372242+0000", 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8430000000000001e-05 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42685 5.c e30/20 5:33e47f3c:::benchmark_data_smithi037_101035_object42684:head v 30'2780, mlcod=30'2775)", 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.372217+0000", 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9992828, 2023-10-08T06:57:54.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000194157, 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372217+0000", 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372217+0000", 2023-10-08T06:57:54.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372217+0000", 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372277+0000", 2023-10-08T06:57:54.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0010000000000003e-05 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372284+0000", 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5679999999999996e-06 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372288+0000", 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.065e-06 2023-10-08T06:57:54.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372323+0000", 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5126999999999998e-05 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.372340+0000", 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6526999999999999e-05 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.443 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:54.444 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.444 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:54.444 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:57:54.444 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 14 2023-10-08T06:57:54.444 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:54.445 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:54.444+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:54.446 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:54.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:54.544+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:54.646 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:54.645+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:54.659 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:54.659 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:57:54.660 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:57:54.660 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:57:54.660 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:54.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:54.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:57:54.747 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:54.746+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:54.848 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:54.847+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:54.853 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:54.873 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:54.890 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:54.890 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:54.893 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:54.895 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:57:54.895 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:57:54.895 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:57:54.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:54.949 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:54.948+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:55.050 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:55.049+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:55.072 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:55.072 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:55.086 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:55.151 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:55.150+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:55.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:55.251+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:55.279 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:55.352 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:55.351+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:55.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 15 16 45075 45059 187.732 151 0.00507943 0.0053242 2023-10-08T06:57:55.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:57:55.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:55.452+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:55.487 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:55.487 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:55.501 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:55.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:55.553+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:55.655 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:55.654+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:55.688 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:55.688 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:55.704 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:55.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:55.754+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:55.856 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:55.855+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:55.897 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:55.898 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:55.913 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:55.999 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:55.998+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:56.059 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:56.058+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:56.142 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:56.142 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:56.158 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:56.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:56.159+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:56.260 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:56.259+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:56.280 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:57:56.338 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:56.338 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:56.353 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:56.361 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:56.360+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:56.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 16 16 47478 47462 185.385 150.188 0.00596622 0.00539094 2023-10-08T06:57:56.462 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:56.460+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:56.524 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:56.524 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:56.540 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:56.563 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:56.562+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:56.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:56.662+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:56.714 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:56.714 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:56.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:56.764 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:56.763+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:56.865 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:56.864+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:56.897 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:56.897 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:56.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:57:56.911 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:56.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:56.965+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:57.059 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:57.068 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:57.066+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:57.080 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:57.101 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:57.102 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:57:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:57:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:57:57.122 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:57:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:57:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:57:57.123 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:57.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:57.182 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:57.181+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:57.270 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:57.269+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:57.280 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T06:57:57.280 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T06:57:57.280 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-10-08T06:57:57.280 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.649594 2023-10-08T06:57:57.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.6495935016497812 2023-10-08T06:57:57.312 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:57.312 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:57:57.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.981978099999999, 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013838266, 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328370+0000", 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328375+0000", 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.843e-06 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328384+0000", 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5669999999999995e-06 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328397+0000", 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2925000000000001e-05 2023-10-08T06:57:57.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.328411+0000", 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.454e-05 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329525+0000", 2023-10-08T06:57:57.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001114128 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329709+0000", 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018355199999999999 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.329888+0000", 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179576 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.332277+0000", 2023-10-08T06:57:57.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023889419999999998 2023-10-08T06:57:57.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342081+0000", 2023-10-08T06:57:57.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098036779999999997 2023-10-08T06:57:57.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342151+0000", 2023-10-08T06:57:57.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0166999999999994e-05 2023-10-08T06:57:57.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:17.342208+0000", 2023-10-08T06:57:57.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7348e-05 2023-10-08T06:57:57.320 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.321 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.321 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.321 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.322 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:57.322 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4451309329999997, 2023-10-08T06:57:57.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:57:57.322 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.322 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.322 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.322 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:57.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:57:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:57:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:57:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:57:57.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:57:57.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4426961770000002, 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.330 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:57:57.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:57:57.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4424227139999992, 2023-10-08T06:57:57.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:57.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:57:57.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:57:57.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:57:57.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:57:57.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:57:57.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:57:57.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:57:57.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:57:57.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:57:57.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:57:57.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:57:57.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:57:57.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:57:57.346 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.346 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.346 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4422829430000004, 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.347 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:57:57.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:57:57.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:57:57.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:57:57.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:57.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:57:57.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:57:57.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:57:57.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:57:57.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:57:57.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:57:57.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.357 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:57.358 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4421960879999993, 2023-10-08T06:57:57.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:57:57.358 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.358 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:57:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:57:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:57:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:57:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:57:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:57:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:57:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:57:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:57:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:57:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:57:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:57:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:57:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:57:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:57:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:57:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4421351799999993, 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:57:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:57:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:57:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4420259820000005, 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:57:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:57:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:57:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:57:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:57:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:57:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:57:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:57:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:57:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:57:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4394304239999993, 2023-10-08T06:57:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:57:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:57:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:57:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:57:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:57:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:57:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:57:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:57:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:57:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:57:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:57:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.4368536760000001, 2023-10-08T06:57:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:57:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:57:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:57:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:57:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:57:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:57:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:57:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:57:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:57:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:57:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:57:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:57:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:31560 5.e 5:71d9d0f4:::benchmark_data_smithi037_101035_object31559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:49.941961+0000", 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.3683870569999996, 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015307685999999999, 2023-10-08T06:57:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 31560 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.941961+0000", 2023-10-08T06:57:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.941961+0000", 2023-10-08T06:57:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.941962+0000", 2023-10-08T06:57:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:57:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942038+0000", 2023-10-08T06:57:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5724999999999997e-05 2023-10-08T06:57:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942044+0000", 2023-10-08T06:57:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5880000000000003e-06 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942048+0000", 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.313e-06 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942971+0000", 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00092279199999999997 2023-10-08T06:57:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.943105+0000", 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013388899999999999 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.943213+0000", 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108183 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.949054+0000", 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058405999999999996 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957182+0000", 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081276290000000008 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957233+0000", 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1950000000000002e-05 2023-10-08T06:57:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957269+0000", 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5456000000000001e-05 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:31561 5.0 5:0f9c915b:::benchmark_data_smithi037_101035_object31560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:49.942231+0000", 2023-10-08T06:57:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.3681168269999997, 2023-10-08T06:57:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015051689, 2023-10-08T06:57:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 31561 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942231+0000", 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942231+0000", 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942232+0000", 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.61e-07 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942288+0000", 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5738000000000001e-05 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942296+0000", 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5420000000000005e-06 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942303+0000", 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0939999999999996e-06 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942348+0000", 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5787000000000001e-05 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942480+0000", 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013140999999999999 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.942611+0000", 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000131612 2023-10-08T06:57:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.949061+0000", 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064497060000000004 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957158+0000", 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080964609999999992 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957246+0000", 2023-10-08T06:57:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8187000000000001e-05 2023-10-08T06:57:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:49.957283+0000", 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7391000000000002e-05 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:32156 5.0 5:0a343b50:::benchmark_data_smithi037_101035_object32155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.1441936699999999, 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015012665999999999, 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 32156 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166155+0000", 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0200000000000001e-07 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166217+0000", 2023-10-08T06:57:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1245000000000001e-05 2023-10-08T06:57:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166227+0000", 2023-10-08T06:57:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2023-10-08T06:57:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.166233+0000", 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4310000000000002e-06 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.168606+0000", 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023730610000000001 2023-10-08T06:57:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.168695+0000", 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9158000000000003e-05 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.168822+0000", 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012675100000000001 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.172544+0000", 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003722047 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.181101+0000", 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008556971 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.181137+0000", 2023-10-08T06:57:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6288999999999998e-05 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.181167+0000", 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0457999999999999e-05 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:32161 5.8 5:19b20b7c:::benchmark_data_smithi037_101035_object32160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:50.169776+0000", 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.140572519, 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014327424, 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 32161 2023-10-08T06:57:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169776+0000", 2023-10-08T06:57:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169776+0000", 2023-10-08T06:57:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169777+0000", 2023-10-08T06:57:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:57:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169851+0000", 2023-10-08T06:57:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4466000000000002e-05 2023-10-08T06:57:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169861+0000", 2023-10-08T06:57:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9219999999999992e-06 2023-10-08T06:57:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169866+0000", 2023-10-08T06:57:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4360000000000001e-06 2023-10-08T06:57:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.169912+0000", 2023-10-08T06:57:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5731e-05 2023-10-08T06:57:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.170028+0000", 2023-10-08T06:57:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011603 2023-10-08T06:57:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.170164+0000", 2023-10-08T06:57:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001362 2023-10-08T06:57:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.172571+0000", 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024063600000000002 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.184029+0000", 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011458398999999999 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.184074+0000", 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5160999999999997e-05 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:50.184103+0000", 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8957000000000001e-05 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38567 5.e 5:7e0678cf:::benchmark_data_smithi037_101035_object38566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5641756090000003, 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016004681999999999, 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38567 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746220+0000", 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6269e-05 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746228+0000", 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7960000000000001e-06 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746238+0000", 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3419999999999997e-06 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746297+0000", 2023-10-08T06:57:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9485999999999999e-05 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746395+0000", 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7388999999999999e-05 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746526+0000", 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013114100000000001 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.748377+0000", 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001851679 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762072+0000", 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013694674 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762139+0000", 2023-10-08T06:57:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7436999999999998e-05 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762177+0000", 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7876999999999997e-05 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38570 5.4 5:2a7ac47c:::benchmark_data_smithi037_101035_object38569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5640677499999995, 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01536218, 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38570 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746281+0000", 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3099999999999997e-07 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746326+0000", 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4518999999999998e-05 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746336+0000", 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0390999999999999e-05 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746344+0000", 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6359999999999994e-06 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746388+0000", 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4499999999999997e-05 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746500+0000", 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112025 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746628+0000", 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012728300000000001 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.748361+0000", 2023-10-08T06:57:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017339390000000001 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.761529+0000", 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013167834 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.761602+0000", 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2923000000000006e-05 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.761643+0000", 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0499e-05 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38981 5.8 5:139681d3:::benchmark_data_smithi037_101035_object38980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3901366450000001, 2023-10-08T06:57:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016272268999999999, 2023-10-08T06:57:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38981 2023-10-08T06:57:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:57:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4600000000000005e-07 2023-10-08T06:57:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920325+0000", 2023-10-08T06:57:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112623 2023-10-08T06:57:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920333+0000", 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7069999999999992e-06 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920339+0000", 2023-10-08T06:57:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:57:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926104+0000", 2023-10-08T06:57:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057651339999999999 2023-10-08T06:57:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926229+0000", 2023-10-08T06:57:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125637 2023-10-08T06:57:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926371+0000", 2023-10-08T06:57:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141648 2023-10-08T06:57:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.928101+0000", 2023-10-08T06:57:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017302859999999999 2023-10-08T06:57:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936393+0000", 2023-10-08T06:57:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0082914990000000008 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936448+0000", 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5322000000000003e-05 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936484+0000", 2023-10-08T06:57:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5775999999999998e-05 2023-10-08T06:57:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38983 5.e 5:75075bf5:::benchmark_data_smithi037_101035_object38982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.922492+0000", 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.38785588, 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015684310999999999, 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38983 2023-10-08T06:57:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922492+0000", 2023-10-08T06:57:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922492+0000", 2023-10-08T06:57:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922493+0000", 2023-10-08T06:57:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3600000000000002e-07 2023-10-08T06:57:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922572+0000", 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9012999999999997e-05 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922581+0000", 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1779999999999992e-06 2023-10-08T06:57:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.922587+0000", 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.927081+0000", 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044943630000000004 2023-10-08T06:57:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.927219+0000", 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013735 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.927365+0000", 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014589799999999999 2023-10-08T06:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.931051+0000", 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036868140000000001 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.938017+0000", 2023-10-08T06:57:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069653689999999999 2023-10-08T06:57:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.938137+0000", 2023-10-08T06:57:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012012500000000001 2023-10-08T06:57:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.938177+0000", 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9787999999999999e-05 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:40663 5.e 5:74d3402d:::benchmark_data_smithi037_101035_object40662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7287626970000001, 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015880376000000002, 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40663 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:57:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1399999999999996e-07 2023-10-08T06:57:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581645+0000", 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9054000000000001e-05 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581652+0000", 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5509999999999996e-06 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581657+0000", 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.147e-06 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581709+0000", 2023-10-08T06:57:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1558999999999999e-05 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581864+0000", 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015551399999999999 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582032+0000", 2023-10-08T06:57:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016779100000000001 2023-10-08T06:57:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.583970+0000", 2023-10-08T06:57:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001938267 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597386+0000", 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013416311 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597426+0000", 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9405e-05 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597466+0000", 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0062999999999999e-05 2023-10-08T06:57:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:40667 5.4 5:277f0aaa:::benchmark_data_smithi037_101035_object40666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:53.582063+0000", 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7282849200000001, 2023-10-08T06:57:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015074432, 2023-10-08T06:57:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:57:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:57:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:57:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40667 2023-10-08T06:57:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582063+0000", 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:57:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582063+0000", 2023-10-08T06:57:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:57:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:57:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582064+0000", 2023-10-08T06:57:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1399999999999996e-07 2023-10-08T06:57:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582143+0000", 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9122000000000006e-05 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:57:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582153+0000", 2023-10-08T06:57:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6670000000000008e-06 2023-10-08T06:57:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582160+0000", 2023-10-08T06:57:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3629999999999996e-06 2023-10-08T06:57:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582207+0000", 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6532000000000001e-05 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582307+0000", 2023-10-08T06:57:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100337 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582420+0000", 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112686 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.585638+0000", 2023-10-08T06:57:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032177170000000001 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597032+0000", 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394115999999999 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597092+0000", 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0124999999999998e-05 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:57:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597138+0000", 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5952999999999999e-05 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:57:57.498 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:57.499 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 17 16 49886 49870 183.332 150.5 0.00791448 0.00545211 2023-10-08T06:57:57.500 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:57.500 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:57.498+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:57.600 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:57.599+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:57.696 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:57.696 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:57.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.697 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50665 5.a 5:55ddac29:::benchmark_data_smithi037_101035_object50664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.697 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.687739+0000", 2023-10-08T06:57:57.697 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0059422449999999996, 2023-10-08T06:57:57.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059709489999999997, 2023-10-08T06:57:57.697 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.698 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:57.698 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.698 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.698 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.698 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50665 2023-10-08T06:57:57.698 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.699 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687739+0000", 2023-10-08T06:57:57.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687739+0000", 2023-10-08T06:57:57.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687740+0000", 2023-10-08T06:57:57.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0900000000000001e-07 2023-10-08T06:57:57.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.701 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687769+0000", 2023-10-08T06:57:57.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8941e-05 2023-10-08T06:57:57.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.702 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.702 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687778+0000", 2023-10-08T06:57:57.702 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6209999999999993e-06 2023-10-08T06:57:57.702 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.703 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.703 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.703 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687784+0000", 2023-10-08T06:57:57.703 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.93e-06 2023-10-08T06:57:57.703 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.703 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.703 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.690893+0000", 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031091579999999999 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691027+0000", 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000134466 2023-10-08T06:57:57.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.705 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:57.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691177+0000", 2023-10-08T06:57:57.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015002 2023-10-08T06:57:57.705 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.705 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.705 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.706 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50666 5.5 5:ac9da4e0:::benchmark_data_smithi037_101035_object50665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.706 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.688482+0000", 2023-10-08T06:57:57.706 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0051995030000000003, 2023-10-08T06:57:57.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005310782, 2023-10-08T06:57:57.706 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50666 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.707 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.708 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.708 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688482+0000", 2023-10-08T06:57:57.708 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.708 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.708 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.708 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.708 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688482+0000", 2023-10-08T06:57:57.709 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.709 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.709 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.709 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.709 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688483+0000", 2023-10-08T06:57:57.709 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0599999999999999e-07 2023-10-08T06:57:57.710 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.710 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.710 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.710 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688565+0000", 2023-10-08T06:57:57.710 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1613999999999995e-05 2023-10-08T06:57:57.710 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.710 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688574+0000", 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3430000000000002e-06 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688580+0000", 2023-10-08T06:57:57.711 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.516e-06 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688625+0000", 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4267999999999997e-05 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.712 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.713 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688732+0000", 2023-10-08T06:57:57.713 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010695499999999999 2023-10-08T06:57:57.713 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.713 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.713 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:57.713 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.688852+0000", 2023-10-08T06:57:57.713 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012059500000000001 2023-10-08T06:57:57.714 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.714 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.714 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:57.714 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691099+0000", 2023-10-08T06:57:57.714 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002246657 2023-10-08T06:57:57.714 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.714 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50669 5.a 5.5fb9271a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.690816+0000", 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0028659530000000001, 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030523299999999998, 2023-10-08T06:57:57.715 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50669 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.716 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.690816+0000", 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.690816+0000", 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.717 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.690817+0000", 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1999999999999999e-06 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691026+0000", 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020944799999999999 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.718 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691038+0000", 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1885999999999999e-05 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691047+0000", 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5790000000000004e-06 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.719 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(client.4555.0:50661 5.a e31/20 ondisk, result = 0)", 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.691092+0000", 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0025898420000000002, 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028263630000000001, 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691092+0000", 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.720 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691092+0000", 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691092+0000", 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0400000000000002e-07 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.721 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691095+0000", 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9639999999999999e-06 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691103+0000", 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0940000000000008e-06 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691110+0000", 2023-10-08T06:57:57.722 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4389999999999997e-06 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692518+0000", 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014087380000000001 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692523+0000", 2023-10-08T06:57:57.723 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1649999999999999e-06 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50672 5.a 5.7b0e2efa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.691068+0000", 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0026139679999999999, 2023-10-08T06:57:57.724 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0029073359999999999, 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50672 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.725 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691068+0000", 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691068+0000", 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691068+0000", 2023-10-08T06:57:57.726 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3099999999999996e-07 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691146+0000", 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7933000000000001e-05 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691155+0000", 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9080000000000001e-06 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.727 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691162+0000", 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.674e-06 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:50671 5.2 e31/20 5:41a8a856:::benchmark_data_smithi037_101035_object50670:head v 31'3184, mlcod=31'3181)", 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.691329+0000", 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0023526189999999998, 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026992930000000002, 2023-10-08T06:57:57.728 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691329+0000", 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691329+0000", 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.729 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691330+0000", 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.75e-07 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691408+0000", 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8495e-05 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.730 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691423+0000", 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4908e-05 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691429+0000", 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5540000000000003e-06 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.731 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692540+0000", 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001110427 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692561+0000", 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1438999999999999e-05 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.732 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:50668 5.0 e31/20 5:0046da18:::benchmark_data_smithi037_101035_object50667:head v 31'3090, mlcod=31'3087)", 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.691479+0000", 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0022026010000000002, 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026058639999999998, 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691479+0000", 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.733 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691479+0000", 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691479+0000", 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1099999999999996e-07 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.734 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691574+0000", 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4493999999999993e-05 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691587+0000", 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2515e-05 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.735 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691594+0000", 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4769999999999997e-06 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691636+0000", 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2076999999999997e-05 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.736 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.737 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.737 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691653+0000", 2023-10-08T06:57:57.737 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7210999999999998e-05 2023-10-08T06:57:57.737 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.737 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.737 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.737 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.738 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.738 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:50674 5.e e31/20 5:7341571c:::benchmark_data_smithi037_101035_object50673:head v 31'3228, mlcod=31'3226)", 2023-10-08T06:57:57.738 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.691633+0000", 2023-10-08T06:57:57.738 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0020485439999999998, 2023-10-08T06:57:57.738 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0025175530000000001, 2023-10-08T06:57:57.738 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.738 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:57.739 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.739 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.739 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.739 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691633+0000", 2023-10-08T06:57:57.739 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.739 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.739 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691633+0000", 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691634+0000", 2023-10-08T06:57:57.740 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.58e-07 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691702+0000", 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8570000000000002e-05 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.741 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.742 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691711+0000", 2023-10-08T06:57:57.742 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.816e-06 2023-10-08T06:57:57.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.742 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.742 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.742 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691718+0000", 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8040000000000004e-06 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691765+0000", 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6847000000000001e-05 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.743 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.744 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.744 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.691785+0000", 2023-10-08T06:57:57.744 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0367e-05 2023-10-08T06:57:57.744 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.744 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.744 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.745 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.745 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.745 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50675 5.c 5:39e379f4:::benchmark_data_smithi037_101035_object50674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.745 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.692232+0000", 2023-10-08T06:57:57.745 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.001449472, 2023-10-08T06:57:57.745 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019823649999999998, 2023-10-08T06:57:57.745 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.746 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:57.746 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.746 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.746 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.746 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50675 2023-10-08T06:57:57.746 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.746 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.747 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.747 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.747 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692232+0000", 2023-10-08T06:57:57.747 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.747 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.747 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.747 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692232+0000", 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692233+0000", 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0599999999999999e-07 2023-10-08T06:57:57.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692301+0000", 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8088000000000003e-05 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.749 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692315+0000", 2023-10-08T06:57:57.750 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3684e-05 2023-10-08T06:57:57.750 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.750 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.750 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.750 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692323+0000", 2023-10-08T06:57:57.750 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1790000000000008e-06 2023-10-08T06:57:57.750 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692387+0000", 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4298e-05 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.751 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692521+0000", 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013415000000000001 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692666+0000", 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000144967 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.752 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50678 5.5 5:aaed9a97:::benchmark_data_smithi037_101035_object50677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.693050+0000", 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00063127799999999998, 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001239467, 2023-10-08T06:57:57.753 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50678 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.754 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693050+0000", 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693050+0000", 2023-10-08T06:57:57.755 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693051+0000", 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0400000000000005e-07 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.756 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693113+0000", 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1851000000000001e-05 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693126+0000", 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2473999999999999e-05 2023-10-08T06:57:57.757 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.758 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.758 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.758 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693133+0000", 2023-10-08T06:57:57.758 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.306e-06 2023-10-08T06:57:57.758 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.758 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.758 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693181+0000", 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7858000000000002e-05 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693309+0000", 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012864699999999999 2023-10-08T06:57:57.759 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.760 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.760 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:57.760 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693444+0000", 2023-10-08T06:57:57.760 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013513699999999999 2023-10-08T06:57:57.760 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.760 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.760 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:50676 5.8 e31/20 5:1aa76f49:::benchmark_data_smithi037_101035_object50675:head v 31'3114, mlcod=31'3112)", 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.693157+0000", 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00052428999999999996, 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00120253, 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:57.762 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.762 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.762 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.762 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693157+0000", 2023-10-08T06:57:57.762 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.762 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.762 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.763 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.763 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693157+0000", 2023-10-08T06:57:57.763 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.763 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.763 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.763 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.763 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693158+0000", 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4000000000000002e-07 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693237+0000", 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8768000000000002e-05 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.764 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.765 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.765 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693245+0000", 2023-10-08T06:57:57.765 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.636e-06 2023-10-08T06:57:57.765 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.765 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.765 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.765 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693251+0000", 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3630000000000002e-06 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693290+0000", 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9174000000000001e-05 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.766 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.767 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.767 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693308+0000", 2023-10-08T06:57:57.767 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8590999999999999e-05 2023-10-08T06:57:57.767 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.767 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.767 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.767 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.768 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.768 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:50677 5.b e31/20 5:d6c06bb5:::benchmark_data_smithi037_101035_object50676:head v 31'3215, mlcod=31'3213)", 2023-10-08T06:57:57.768 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.693300+0000", 2023-10-08T06:57:57.768 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.000381238, 2023-10-08T06:57:57.768 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001124143, 2023-10-08T06:57:57.768 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.768 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:57.769 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.769 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.769 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.769 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693300+0000", 2023-10-08T06:57:57.769 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.769 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.769 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.770 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.770 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693300+0000", 2023-10-08T06:57:57.770 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.770 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.770 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693301+0000", 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.79e-07 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693368+0000", 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7321000000000001e-05 2023-10-08T06:57:57.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.772 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.772 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.772 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693375+0000", 2023-10-08T06:57:57.772 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7630000000000003e-06 2023-10-08T06:57:57.772 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.772 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.772 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.773 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693380+0000", 2023-10-08T06:57:57.773 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6760000000000004e-06 2023-10-08T06:57:57.773 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.773 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.773 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.773 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693425+0000", 2023-10-08T06:57:57.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5049000000000002e-05 2023-10-08T06:57:57.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.774 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.774 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.774 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693442+0000", 2023-10-08T06:57:57.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6823000000000001e-05 2023-10-08T06:57:57.774 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.775 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.775 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.775 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.775 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(client.4555.0:50666 5.5 e31/20)", 2023-10-08T06:57:57.775 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.693428+0000", 2023-10-08T06:57:57.775 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00025344099999999997, 2023-10-08T06:57:57.776 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001053465, 2023-10-08T06:57:57.776 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.776 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:57:57.776 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.776 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.776 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.776 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693428+0000", 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693428+0000", 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.777 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693429+0000", 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8500000000000002e-07 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693432+0000", 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9730000000000002e-06 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693439+0000", 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2699999999999999e-06 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.693444+0000", 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3190000000000002e-06 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.779 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:50657 5.2 e31/20 5:49d12bae:::benchmark_data_smithi037_101035_object50656:head v 31'3183, mlcod=31'3180)", 2023-10-08T06:57:57.780 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.686766+0000", 2023-10-08T06:57:57.780 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0069154009999999998, 2023-10-08T06:57:57.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007764412, 2023-10-08T06:57:57.780 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.780 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:57:57.780 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.780 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686766+0000", 2023-10-08T06:57:57.781 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686766+0000", 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686767+0000", 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0800000000000004e-07 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.782 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.783 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.783 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686804+0000", 2023-10-08T06:57:57.783 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6868e-05 2023-10-08T06:57:57.783 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.783 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.783 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.783 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686828+0000", 2023-10-08T06:57:57.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4490000000000001e-05 2023-10-08T06:57:57.784 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.784 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.784 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686835+0000", 2023-10-08T06:57:57.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7220000000000002e-06 2023-10-08T06:57:57.784 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686891+0000", 2023-10-08T06:57:57.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5778e-05 2023-10-08T06:57:57.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.786 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.686914+0000", 2023-10-08T06:57:57.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3289e-05 2023-10-08T06:57:57.786 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.786 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.786 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.787 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50660 5.a 5:5e69552c:::benchmark_data_smithi037_101035_object50659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.787 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.687243+0000", 2023-10-08T06:57:57.787 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0064385739999999999, 2023-10-08T06:57:57.787 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073508169999999999, 2023-10-08T06:57:57.787 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.787 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:57.787 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50660 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.788 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687243+0000", 2023-10-08T06:57:57.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.789 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.789 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.789 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.789 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687243+0000", 2023-10-08T06:57:57.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.789 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687244+0000", 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.043e-06 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.790 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687335+0000", 2023-10-08T06:57:57.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0582999999999997e-05 2023-10-08T06:57:57.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.791 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687344+0000", 2023-10-08T06:57:57.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5950000000000005e-06 2023-10-08T06:57:57.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687349+0000", 2023-10-08T06:57:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1710000000000001e-06 2023-10-08T06:57:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687390+0000", 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0122e-05 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687507+0000", 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000117242 2023-10-08T06:57:57.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.794 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.794 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:57.794 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687602+0000", 2023-10-08T06:57:57.794 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5542000000000001e-05 2023-10-08T06:57:57.794 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.794 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.794 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692494+0000", 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0048920129999999997 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.795 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:50661 5.a 5:536d48c0:::benchmark_data_smithi037_101035_object50660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:57.796 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:57.687362+0000", 2023-10-08T06:57:57.796 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0063196570000000002, 2023-10-08T06:57:57.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073218839999999999, 2023-10-08T06:57:57.796 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:57.796 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:57:57.796 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:57.796 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 50661 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687362+0000", 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687362+0000", 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687363+0000", 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7199999999999998e-07 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:57.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687396+0000", 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3806999999999997e-05 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687403+0000", 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3779999999999998e-06 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:57.799 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.687409+0000", 2023-10-08T06:57:57.800 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.823e-06 2023-10-08T06:57:57.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.800 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.800 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:57.800 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.689247+0000", 2023-10-08T06:57:57.800 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0018387410000000001 2023-10-08T06:57:57.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.689362+0000", 2023-10-08T06:57:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011448800000000001 2023-10-08T06:57:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.689492+0000", 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012977 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:57.692526+0000", 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030346650000000002 2023-10-08T06:57:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.803 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:57.803 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.803 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:57.803 INFO:teuthology.orchestra.run.smithi183.stdout: ], 2023-10-08T06:57:57.803 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 16 2023-10-08T06:57:57.803 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:57.805 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:57.805 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:57.803+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:57.905 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:57.904+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:58.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:58.004+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:58.032 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:58.032 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:57:58.032 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2023-10-08T06:57:58.032 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2023-10-08T06:57:58.033 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:58.045 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:57:58.107 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:58.106+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:58.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:58.206+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:58.273 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:57:58.273 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:57:58.273 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:57:58.273 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:57:58.273 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.273 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14433 5.6 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:58.273 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.163434805, 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017532516000000001, 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14433 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.274 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.275 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106905+0000", 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106971+0000", 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5945000000000006e-05 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106979+0000", 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8739999999999995e-06 2023-10-08T06:57:58.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106983+0000", 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3660000000000002e-06 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107023+0000", 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9634e-05 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.277 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107137+0000", 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114747 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107229+0000", 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1775999999999997e-05 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.278 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108887+0000", 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016575100000000001 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124321+0000", 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015434128 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124374+0000", 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2899000000000003e-05 2023-10-08T06:57:58.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124437+0000", 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3016999999999997e-05 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:26900 5.3 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:58.280 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.042169187000001, 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017031261999999998, 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 26900 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.281 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.282 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228171+0000", 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.37e-07 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228232+0000", 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1746000000000001e-05 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.283 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228242+0000", 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0040999999999999e-05 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228250+0000", 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9140000000000008e-06 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228299+0000", 2023-10-08T06:57:58.284 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8273999999999999e-05 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228429+0000", 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129956 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228557+0000", 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012801199999999999 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.285 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.232147+0000", 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035903879999999999 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245130+0000", 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012982570000000001 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.286 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245177+0000", 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7830000000000001e-05 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245201+0000", 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3794e-05 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.287 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28697 5.a 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3998670410000003, 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.029866567, 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.288 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28697 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:57:58.289 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870473+0000", 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3200000000000005e-07 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870533+0000", 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9941000000000001e-05 2023-10-08T06:57:58.290 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870549+0000", 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6688e-05 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870555+0000", 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9059999999999999e-06 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.291 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870617+0000", 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1309999999999994e-05 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870732+0000", 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115198 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870813+0000", 2023-10-08T06:57:58.292 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1542e-05 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.874939+0000", 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041253219999999998 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900278+0000", 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025339897 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.293 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900315+0000", 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6229999999999997e-05 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900339+0000", 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3901e-05 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.294 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.296 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.296 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28699 5.a 5:5b28870b:::benchmark_data_smithi037_101035_object28698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.296 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:58.296 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3969433920000007, 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.027162454999999999, 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28699 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.297 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.06e-07 2023-10-08T06:57:58.298 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873473+0000", 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6679000000000002e-05 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873487+0000", 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3597999999999999e-05 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.299 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873491+0000", 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.916e-06 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873529+0000", 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7598000000000002e-05 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873626+0000", 2023-10-08T06:57:58.300 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7367000000000005e-05 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873729+0000", 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010220799999999999 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880045+0000", 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063162089999999997 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.301 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900391+0000", 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020346212999999998 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900514+0000", 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012279700000000001 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.302 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900558+0000", 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4264000000000002e-05 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28704 5.a 5:576041a3:::benchmark_data_smithi037_101035_object28703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3940670730000004, 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.024376907999999999, 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.303 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28704 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.304 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876273+0000", 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1099999999999995e-07 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876333+0000", 2023-10-08T06:57:58.305 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0281000000000001e-05 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876341+0000", 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2859999999999999e-06 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876346+0000", 2023-10-08T06:57:58.306 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9099999999999996e-06 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876382+0000", 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6164000000000001e-05 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876493+0000", 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001111 2023-10-08T06:57:58.307 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876609+0000", 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000116128 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880067+0000", 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003457304 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.308 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900600+0000", 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020532749999999999 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900629+0000", 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9323e-05 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900649+0000", 2023-10-08T06:57:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0051000000000002e-05 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30811 5.c 5:33193cdf:::benchmark_data_smithi037_101035_object30810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.6106793049999997, 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018643812999999999, 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.310 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30811 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.311 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9500000000000002e-07 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659715+0000", 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659724+0000", 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7280000000000007e-06 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659732+0000", 2023-10-08T06:57:58.313 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664288+0000", 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045555680000000003 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664434+0000", 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014595400000000001 2023-10-08T06:57:58.314 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664590+0000", 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156599 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666251+0000", 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016600549999999999 2023-10-08T06:57:58.315 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678240+0000", 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011989145999999999 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678278+0000", 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8389000000000001e-05 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.316 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678304+0000", 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5531e-05 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38558 5.a 5:534da067:::benchmark_data_smithi037_101035_object38557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5265374840000003, 2023-10-08T06:57:58.317 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015151994, 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38558 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.318 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743802+0000", 2023-10-08T06:57:58.319 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4499999999999996e-07 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743888+0000", 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5570999999999998e-05 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743900+0000", 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1838000000000001e-05 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743907+0000", 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3189999999999997e-06 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.743948+0000", 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1192000000000001e-05 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.744036+0000", 2023-10-08T06:57:58.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7347000000000002e-05 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.744126+0000", 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0647000000000001e-05 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746077+0000", 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019509620000000001 2023-10-08T06:57:58.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758866+0000", 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012788851 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758917+0000", 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1178999999999999e-05 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758954+0000", 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6343000000000001e-05 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38560 5.c 5:31643017:::benchmark_data_smithi037_101035_object38559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5247350319999997, 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015913983, 2023-10-08T06:57:58.324 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38560 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745605+0000", 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0699999999999996e-07 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745681+0000", 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5860999999999998e-05 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745690+0000", 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5619999999999993e-06 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745697+0000", 2023-10-08T06:57:58.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5690000000000001e-06 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756602+0000", 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010904775 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756717+0000", 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115425 2023-10-08T06:57:58.328 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756839+0000", 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012244400000000001 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761372+0000", 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045321939999999998 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761451+0000", 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9827000000000007e-05 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761490+0000", 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8952999999999998e-05 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761518+0000", 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7665999999999999e-05 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38562 5.6 5:6537f88c:::benchmark_data_smithi037_101035_object38561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5245593399999997, 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016164101, 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.331 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38562 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:57:58.332 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745781+0000", 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5199999999999995e-07 2023-10-08T06:57:58.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745845+0000", 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4641000000000007e-05 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745854+0000", 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6670000000000002e-06 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745862+0000", 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0020000000000006e-06 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745897+0000", 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5339999999999997e-05 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.335 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745976+0000", 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8535000000000006e-05 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746055+0000", 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9349000000000002e-05 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761759+0000", 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015703931000000001 2023-10-08T06:57:58.336 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761839+0000", 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9800000000000002e-05 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761892+0000", 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3214000000000002e-05 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761944+0000", 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1770000000000001e-05 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38563 5.6 5:693ba6d4:::benchmark_data_smithi037_101035_object38562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:57:58.338 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5244630719999996, 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019052401, 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38563 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.339 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.340 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745877+0000", 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.99e-07 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745909+0000", 2023-10-08T06:57:58.341 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2098999999999999e-05 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745917+0000", 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9559999999999997e-06 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745922+0000", 2023-10-08T06:57:58.342 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7749999999999998e-06 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757816+0000", 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011893733 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757935+0000", 2023-10-08T06:57:58.343 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011882799999999999 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758060+0000", 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000125217 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761820+0000", 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003759872 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.344 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764861+0000", 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030408420000000002 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764895+0000", 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4248999999999997e-05 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.345 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764928+0000", 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3231000000000001e-05 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38564 5.6 5:646adcee:::benchmark_data_smithi037_101035_object38563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5243885949999996, 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021880430999999999, 2023-10-08T06:57:58.346 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38564 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745951+0000", 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6400000000000002e-07 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746069+0000", 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000117945 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746078+0000", 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4800000000000001e-06 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746084+0000", 2023-10-08T06:57:58.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759452+0000", 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013368161 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759548+0000", 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5867999999999998e-05 2023-10-08T06:57:58.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759671+0000", 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012332700000000001 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764962+0000", 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052914839999999999 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767742+0000", 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027792110000000002 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767792+0000", 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0659999999999999e-05 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767831+0000", 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.854e-05 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38569 5.6 5:6346498c:::benchmark_data_smithi037_101035_object38568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5241249999999997, 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021737508999999999, 2023-10-08T06:57:58.353 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38569 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746215+0000", 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4499999999999997e-07 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746278+0000", 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3112000000000002e-05 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746285+0000", 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746291+0000", 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.993e-06 2023-10-08T06:57:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761964+0000", 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015672927 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762055+0000", 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0352999999999994e-05 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762165+0000", 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000109961 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764998+0000", 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028333960000000002 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767879+0000", 2023-10-08T06:57:58.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028805129999999999 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767921+0000", 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2070999999999998e-05 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767952+0000", 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0898999999999997e-05 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.359 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:38567 5.e e29/20 5:7e0678cf:::benchmark_data_smithi037_101035_object38566:head v 29'2454, mlcod=29'2452)", 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5236691770000004, 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015302191999999999, 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746670+0000", 2023-10-08T06:57:58.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0699999999999998e-07 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747567+0000", 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089657400000000003 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747576+0000", 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1220000000000001e-06 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747583+0000", 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757799+0000", 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010216767 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757811+0000", 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1685000000000001e-05 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761948+0000", 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041366959999999996 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761972+0000", 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4409e-05 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38571 5.6 5:66544174:::benchmark_data_smithi037_101035_object38570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.522687243, 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.026065827, 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38571 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2799999999999996e-07 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747680+0000", 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7137000000000001e-05 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747708+0000", 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8674e-05 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747715+0000", 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.64e-06 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765069+0000", 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017353848000000002 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765144+0000", 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5306e-05 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765236+0000", 2023-10-08T06:57:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2280000000000004e-05 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767868+0000", 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026313320000000001 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773659+0000", 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057915329999999998 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773696+0000", 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7081e-05 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773718+0000", 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1367999999999999e-05 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:42667 5.6 5:6e2597cd:::benchmark_data_smithi037_101035_object42666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.9045631099999998, 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016427344999999999, 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 42667 2023-10-08T06:57:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365838+0000", 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365845+0000", 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6580000000000002e-06 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365851+0000", 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0990000000000004e-06 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365903+0000", 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2104000000000001e-05 2023-10-08T06:57:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366026+0000", 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012274599999999999 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366149+0000", 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012269099999999999 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.368593+0000", 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024444419999999998 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382104+0000", 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013510858000000001 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382164+0000", 2023-10-08T06:57:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0217000000000003e-05 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382203+0000", 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8872000000000003e-05 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:42668 5.c 5:3b9470c4:::benchmark_data_smithi037_101035_object42667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.9044722140000001, 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016740874999999999, 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 42668 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:57:58.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7400000000000003e-07 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365914+0000", 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6384000000000002e-05 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365922+0000", 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9289999999999998e-06 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365928+0000", 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1630000000000001e-06 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366055+0000", 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012724599999999999 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366224+0000", 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016901399999999999 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366379+0000", 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015441700000000001 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.370638+0000", 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0042591800000000004 2023-10-08T06:57:58.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382507+0000", 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011869071 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382571+0000", 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4533e-05 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382608+0000", 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6363999999999999e-05 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:42671 5.c 5:33980e00:::benchmark_data_smithi037_101035_object42670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:54.366000+0000", 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.9043385960000001, 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016719845000000001, 2023-10-08T06:57:58.385 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 42671 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366000+0000", 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366000+0000", 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366001+0000", 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3900000000000005e-07 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366031+0000", 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0003000000000001e-05 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366038+0000", 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366045+0000", 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.348e-06 2023-10-08T06:57:58.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.367752+0000", 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0017074379999999999 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.367843+0000", 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1040999999999998e-05 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.368004+0000", 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016096599999999999 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.371895+0000", 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0038909980000000001 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382658+0000", 2023-10-08T06:57:58.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010762814000000001 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382698+0000", 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0241000000000003e-05 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382720+0000", 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2310000000000002e-05 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.391 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:51437 5.8 e31/20 5:1395e381:::benchmark_data_smithi037_101035_object51436:head v 31'3153, mlcod=31'3151)", 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.024982+0000", 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.24535707700000001, 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015518578999999999, 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.392 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.024982+0000", 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.024982+0000", 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.024983+0000", 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9999999999999997e-07 2023-10-08T06:57:58.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.025093+0000", 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000110716 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.025102+0000", 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8650000000000007e-06 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.025109+0000", 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0500000000000003e-06 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.025149+0000", 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0225000000000002e-05 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.025162+0000", 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2514000000000001e-05 2023-10-08T06:57:58.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.040451+0000", 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015288561000000001 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.040501+0000", 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0047999999999999e-05 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.396 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:51449 5.0 e31/20 5:078c55bb:::benchmark_data_smithi037_101035_object51448:head v 31'3147, mlcod=31'3145)", 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.24108569699999999, 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016999805999999999, 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029254+0000", 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2e-07 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029284+0000", 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0264999999999999e-05 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029293+0000", 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6689999999999995e-06 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029300+0000", 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8379999999999996e-06 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.034256+0000", 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049568140000000004 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.034279+0000", 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2858e-05 2023-10-08T06:57:58.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046210+0000", 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011930329999999999 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046253+0000", 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3612000000000002e-05 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.401 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:51451 5.8 e31/20 5:1f80398c:::benchmark_data_smithi037_101035_object51450:head v 31'3157, mlcod=31'3151)", 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.240134188, 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016149121999999998, 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:57:58.402 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9799999999999999e-07 2023-10-08T06:57:58.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030275+0000", 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9564e-05 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030284+0000", 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7830000000000004e-06 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030290+0000", 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6390000000000003e-06 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.036122+0000", 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058316330000000001 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.036137+0000", 2023-10-08T06:57:58.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4955e-05 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046325+0000", 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010188041 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046354+0000", 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9209000000000001e-05 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.406 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.407 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.407 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:57:58.407 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:57:58.407 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:57:58.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:57:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.1 primary-affinity to 0.649594 (8425712) 2023-10-08T06:57:58.409 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:58.407+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:58.410 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 18 16 52115 52099 180.885 139.312 0.00566681 0.00551172 2023-10-08T06:57:58.410 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:57:58.509 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:58.508+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:58.538 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:58.538 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:58.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.538 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:52107 5.d 5.ef0e4e2d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:57:58.538 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:58.345516+0000", 2023-10-08T06:57:58.538 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.192588861, 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.19261407, 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for peered", 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 52107 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345516+0000", 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345516+0000", 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345516+0000", 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2900000000000003e-07 2023-10-08T06:57:58.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345541+0000", 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5137999999999999e-05 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345553+0000", 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2041e-05 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345559+0000", 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9399999999999999e-06 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345606+0000", 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6904999999999999e-05 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.345614+0000", 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8949999999999998e-06 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:52072 5.d 5.3ab6041d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:57:58.543 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:58.316244+0000", 2023-10-08T06:57:58.544 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.22185996899999999, 2023-10-08T06:57:58.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.22193009599999999, 2023-10-08T06:57:58.544 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.544 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for peered", 2023-10-08T06:57:58.545 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.545 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.545 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.545 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 52072 2023-10-08T06:57:58.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.546 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316244+0000", 2023-10-08T06:57:58.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316244+0000", 2023-10-08T06:57:58.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316245+0000", 2023-10-08T06:57:58.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.16e-07 2023-10-08T06:57:58.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316326+0000", 2023-10-08T06:57:58.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0900000000000001e-05 2023-10-08T06:57:58.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316359+0000", 2023-10-08T06:57:58.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3346999999999998e-05 2023-10-08T06:57:58.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316366+0000", 2023-10-08T06:57:58.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0410000000000003e-06 2023-10-08T06:57:58.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316416+0000", 2023-10-08T06:57:58.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0557999999999999e-05 2023-10-08T06:57:58.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2023-10-08T06:57:58.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.316425+0000", 2023-10-08T06:57:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4509999999999992e-06 2023-10-08T06:57:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:52036 5.d 5.510837ed (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:57:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:58.289973+0000", 2023-10-08T06:57:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.24813176000000001, 2023-10-08T06:57:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.24823947699999999, 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for peered", 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 52036 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.289973+0000", 2023-10-08T06:57:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.289973+0000", 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.289974+0000", 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4600000000000003e-07 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.290008+0000", 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4032000000000002e-05 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.290018+0000", 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0067e-05 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.290025+0000", 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2309999999999999e-06 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.290084+0000", 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8774999999999999e-05 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.290093+0000", 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.149e-06 2023-10-08T06:57:58.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:52046 5.d 5.11188fad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:58.295454+0000", 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.24265062400000001, 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.24279493999999999, 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for peered", 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.563 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 52046 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295454+0000", 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295454+0000", 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295455+0000", 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7499999999999999e-07 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295505+0000", 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0087999999999999e-05 2023-10-08T06:57:58.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295521+0000", 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6628000000000001e-05 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295527+0000", 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0719999999999996e-06 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295594+0000", 2023-10-08T06:57:58.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6444000000000003e-05 2023-10-08T06:57:58.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2023-10-08T06:57:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.295601+0000", 2023-10-08T06:57:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.764e-06 2023-10-08T06:57:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:57:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 4 2023-10-08T06:57:58.569 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:58.570 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:57:58.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:58.613+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:58.697 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:57:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:57:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:57:58.698 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:58.708 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:57:58.710 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:58.709+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:58.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:58.810+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4156.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:58.879 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.256104790999998, 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013962354, 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4156", 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/599329663", 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 141 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620802+0000", 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620803+0000", 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7000000000000001e-07 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620806+0000", 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.676e-06 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620810+0000", 2023-10-08T06:57:58.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.647e-06 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.620812+0000", 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5019999999999999e-06 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627179+0000", 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0063668500000000003 2023-10-08T06:57:58.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627272+0000", 2023-10-08T06:57:58.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3276000000000006e-05 2023-10-08T06:57:58.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:58.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.627404+0000", 2023-10-08T06:57:58.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131428 2023-10-08T06:57:58.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.632498+0000", 2023-10-08T06:57:58.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005094164 2023-10-08T06:57:58.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634675+0000", 2023-10-08T06:57:58.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021769570000000002 2023-10-08T06:57:58.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634731+0000", 2023-10-08T06:57:58.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6144999999999999e-05 2023-10-08T06:57:58.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:06.634765+0000", 2023-10-08T06:57:58.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3439000000000003e-05 2023-10-08T06:57:58.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.888 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.889 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13069 5.1 5:88cd8266:::benchmark_data_smithi037_101035_object13068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:58.889 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:58.889 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 15.177779745, 2023-10-08T06:57:58.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013921543999999999, 2023-10-08T06:57:58.890 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.890 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.890 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.890 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.890 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.890 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13069 2023-10-08T06:57:58.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.891 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:58.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699127+0000", 2023-10-08T06:57:58.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699128+0000", 2023-10-08T06:57:58.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2023-10-08T06:57:58.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699202+0000", 2023-10-08T06:57:58.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4029999999999994e-05 2023-10-08T06:57:58.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699211+0000", 2023-10-08T06:57:58.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5620000000000004e-06 2023-10-08T06:57:58.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699218+0000", 2023-10-08T06:57:58.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7660000000000001e-06 2023-10-08T06:57:58.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699268+0000", 2023-10-08T06:57:58.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0173999999999998e-05 2023-10-08T06:57:58.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699381+0000", 2023-10-08T06:57:58.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113522 2023-10-08T06:57:58.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:58.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699486+0000", 2023-10-08T06:57:58.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010518699999999999 2023-10-08T06:57:58.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704026+0000", 2023-10-08T06:57:58.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045396569999999999 2023-10-08T06:57:58.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.712963+0000", 2023-10-08T06:57:58.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089374120000000005 2023-10-08T06:57:58.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713016+0000", 2023-10-08T06:57:58.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2243000000000001e-05 2023-10-08T06:57:58.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713049+0000", 2023-10-08T06:57:58.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3096000000000003e-05 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:13071 5.1 5:8cd03df6:::benchmark_data_smithi037_101035_object13070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 15.177648137, 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013866906, 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.902 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 13071 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699259+0000", 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3599999999999999e-07 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699354+0000", 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4691999999999994e-05 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699360+0000", 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9159999999999998e-06 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.699364+0000", 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0069999999999999e-06 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700173+0000", 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00080942500000000001 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700294+0000", 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012094 2023-10-08T06:57:58.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.700392+0000", 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7575e-05 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.704069+0000", 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036775950000000001 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713055+0000", 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0089859989999999997 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713098+0000", 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2211e-05 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:43.713126+0000", 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.811e-05 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.909 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.769606327, 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:26900 5.3 e27/20 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head v 27'1703, mlcod=27'1700)", 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.64827728, 2023-10-08T06:57:58.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016375165000000001, 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6699999999999999e-07 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228688+0000", 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8009e-05 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228694+0000", 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3690000000000003e-06 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228705+0000", 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0019e-05 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228746+0000", 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1140000000000003e-05 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228766+0000", 2023-10-08T06:57:58.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0310999999999999e-05 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.244952+0000", 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016186158999999999 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245005+0000", 2023-10-08T06:57:58.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2791000000000003e-05 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.003352587, 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.921 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:57:58.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:57:58.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:57:58.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:57:58.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.9965181990000005, 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.929 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:29781 5.2 5:4e41e2c7:::benchmark_data_smithi037_101035_object29780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6003843240000002, 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013881332999999999, 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.937 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 29781 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276523+0000", 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7899999999999997e-07 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276572+0000", 2023-10-08T06:57:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8396000000000002e-05 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276582+0000", 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0319999999999999e-05 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.276589+0000", 2023-10-08T06:57:58.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0500000000000003e-06 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.277829+0000", 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001239513 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.277950+0000", 2023-10-08T06:57:58.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121205 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.278047+0000", 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7479000000000006e-05 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.283432+0000", 2023-10-08T06:57:58.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053842109999999999 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290339+0000", 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069073900000000002 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290380+0000", 2023-10-08T06:57:58.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0648000000000001e-05 2023-10-08T06:57:58.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.290404+0000", 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4341999999999998e-05 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:31559 5.7 5:ef911ca4:::benchmark_data_smithi037_101035_object31558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.945 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.9352044409999998, 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015291592999999999, 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 31559 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941704+0000", 2023-10-08T06:57:58.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0869999999999999e-06 2023-10-08T06:57:58.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941771+0000", 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7267000000000005e-05 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941782+0000", 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1253999999999999e-05 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941788+0000", 2023-10-08T06:57:58.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2999999999999998e-06 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941837+0000", 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8238000000000001e-05 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941976+0000", 2023-10-08T06:57:58.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013968499999999999 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.942307+0000", 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00033071100000000003 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943850+0000", 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001542777 2023-10-08T06:57:58.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956893+0000", 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013042672999999999 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956955+0000", 2023-10-08T06:57:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2786999999999994e-05 2023-10-08T06:57:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956994+0000", 2023-10-08T06:57:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8813999999999998e-05 2023-10-08T06:57:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32200 5.1 5:88d4e8c5:::benchmark_data_smithi037_101035_object32199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:57:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:57:58.955 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6901861650000001, 2023-10-08T06:57:58.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014682766, 2023-10-08T06:57:58.955 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.955 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.956 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.956 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32200 2023-10-08T06:57:58.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.956 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:57:58.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:57:58.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186722+0000", 2023-10-08T06:57:58.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:57:58.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186831+0000", 2023-10-08T06:57:58.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109088 2023-10-08T06:57:58.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186844+0000", 2023-10-08T06:57:58.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2629999999999999e-05 2023-10-08T06:57:58.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186851+0000", 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5870000000000004e-06 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192680+0000", 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058284460000000001 2023-10-08T06:57:58.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192763+0000", 2023-10-08T06:57:58.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3529000000000006e-05 2023-10-08T06:57:58.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:58.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192849+0000", 2023-10-08T06:57:58.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5500999999999993e-05 2023-10-08T06:57:58.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.198504+0000", 2023-10-08T06:57:58.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056553050000000002 2023-10-08T06:57:58.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201342+0000", 2023-10-08T06:57:58.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002838283 2023-10-08T06:57:58.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201371+0000", 2023-10-08T06:57:58.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8418000000000001e-05 2023-10-08T06:57:58.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201404+0000", 2023-10-08T06:57:58.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3027000000000001e-05 2023-10-08T06:57:58.966 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.966 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.966 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.967 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:38550 5.7 5:e4621c07:::benchmark_data_smithi037_101035_object38549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:57:58.967 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:57:58.967 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 6.1364950589999996, 2023-10-08T06:57:58.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016332946000000001, 2023-10-08T06:57:58.967 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.967 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.968 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:58.968 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:58.968 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:58.968 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 38550 2023-10-08T06:57:58.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.968 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:57:58.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:57:58.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:57:58.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1399999999999997e-07 2023-10-08T06:57:58.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740594+0000", 2023-10-08T06:57:58.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018210399999999999 2023-10-08T06:57:58.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740600+0000", 2023-10-08T06:57:58.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7089999999999999e-06 2023-10-08T06:57:58.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740604+0000", 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7620000000000001e-06 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741601+0000", 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099723600000000009 2023-10-08T06:57:58.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741738+0000", 2023-10-08T06:57:58.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137219 2023-10-08T06:57:58.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:58.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741885+0000", 2023-10-08T06:57:58.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014629399999999999 2023-10-08T06:57:58.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:58.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.743601+0000", 2023-10-08T06:57:58.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017165010000000001 2023-10-08T06:57:58.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:58.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756688+0000", 2023-10-08T06:57:58.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013086591 2023-10-08T06:57:58.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756723+0000", 2023-10-08T06:57:58.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5126000000000002e-05 2023-10-08T06:57:58.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756745+0000", 2023-10-08T06:57:58.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1990000000000001e-05 2023-10-08T06:57:58.979 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.979 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.979 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.980 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42667 5.6 e30/20 5:6e2597cd:::benchmark_data_smithi037_101035_object42666:head v 30'2725, mlcod=30'2722)", 2023-10-08T06:57:58.980 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:57:58.980 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5106686509999996, 2023-10-08T06:57:58.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015488478, 2023-10-08T06:57:58.980 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.981 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.981 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:57:58.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:57:58.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366239+0000", 2023-10-08T06:57:58.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5999999999999999e-07 2023-10-08T06:57:58.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366284+0000", 2023-10-08T06:57:58.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5608000000000001e-05 2023-10-08T06:57:58.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366292+0000", 2023-10-08T06:57:58.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7130000000000005e-06 2023-10-08T06:57:58.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366297+0000", 2023-10-08T06:57:58.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.288e-06 2023-10-08T06:57:58.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366349+0000", 2023-10-08T06:57:58.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1119999999999998e-05 2023-10-08T06:57:58.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366368+0000", 2023-10-08T06:57:58.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9619999999999998e-05 2023-10-08T06:57:58.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.381681+0000", 2023-10-08T06:57:58.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015312614 2023-10-08T06:57:58.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.381727+0000", 2023-10-08T06:57:58.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6054999999999999e-05 2023-10-08T06:57:58.990 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.990 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.990 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.991 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42668 5.c e30/20 5:3b9470c4:::benchmark_data_smithi037_101035_object42667:head v 30'2777, mlcod=30'2773)", 2023-10-08T06:57:58.991 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:57:58.991 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5094450909999999, 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014897924, 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:57:58.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:58.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367463+0000", 2023-10-08T06:57:58.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6300000000000005e-07 2023-10-08T06:57:58.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:58.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367514+0000", 2023-10-08T06:57:58.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1226e-05 2023-10-08T06:57:58.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:58.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367523+0000", 2023-10-08T06:57:58.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1819999999999995e-06 2023-10-08T06:57:58.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:58.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367529+0000", 2023-10-08T06:57:58.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3980000000000004e-06 2023-10-08T06:57:58.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:58.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367596+0000", 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6440999999999996e-05 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367614+0000", 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8428e-05 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382289+0000", 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014675006000000001 2023-10-08T06:57:58.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382360+0000", 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0580000000000005e-05 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:58.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:58.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:58.999 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42674 5.9 5:9f6fb609:::benchmark_data_smithi037_101035_object42673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:58.999 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.367922+0000", 2023-10-08T06:57:58.999 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5089846199999997, 2023-10-08T06:57:58.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014564346000000001, 2023-10-08T06:57:58.999 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:58.999 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:59.000 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:59.000 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:59.000 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:59.000 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42674 2023-10-08T06:57:59.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.000 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:59.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:59.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367922+0000", 2023-10-08T06:57:59.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:59.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367922+0000", 2023-10-08T06:57:59.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:59.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367923+0000", 2023-10-08T06:57:59.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7000000000000004e-07 2023-10-08T06:57:59.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:59.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367976+0000", 2023-10-08T06:57:59.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3185e-05 2023-10-08T06:57:59.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367985+0000", 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9760000000000001e-06 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367990+0000", 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0690000000000001e-06 2023-10-08T06:57:59.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368610+0000", 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061959099999999996 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368740+0000", 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013011399999999999 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368860+0000", 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011974800000000001 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371646+0000", 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027866900000000001 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:59.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382404+0000", 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010757549999999999 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382451+0000", 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6557999999999997e-05 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382487+0000", 2023-10-08T06:57:59.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6195000000000002e-05 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42671 5.c e30/20 5:33980e00:::benchmark_data_smithi037_101035_object42670:head v 30'2778, mlcod=30'2773)", 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5088190539999999, 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014307802, 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:59.008 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:59.009 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:59.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:59.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:59.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:59.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:59.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:59.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368088+0000", 2023-10-08T06:57:59.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2023-10-08T06:57:59.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:59.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368157+0000", 2023-10-08T06:57:59.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9062999999999999e-05 2023-10-08T06:57:59.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:59.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368165+0000", 2023-10-08T06:57:59.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6990000000000003e-06 2023-10-08T06:57:59.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:59.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368169+0000", 2023-10-08T06:57:59.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2509999999999996e-06 2023-10-08T06:57:59.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:59.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368646+0000", 2023-10-08T06:57:59.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000476398 2023-10-08T06:57:59.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:59.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368666+0000", 2023-10-08T06:57:59.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0012000000000001e-05 2023-10-08T06:57:59.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:59.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382364+0000", 2023-10-08T06:57:59.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013698167000000001 2023-10-08T06:57:59.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:59.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382396+0000", 2023-10-08T06:57:59.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1770999999999998e-05 2023-10-08T06:57:59.017 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.017 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.017 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.018 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42676 5.3 e30/20 5:ca7cd2a1:::benchmark_data_smithi037_101035_object42675:head v 30'2685, mlcod=30'2683)", 2023-10-08T06:57:59.018 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368420+0000", 2023-10-08T06:57:59.018 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5084867559999999, 2023-10-08T06:57:59.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013936194000000001, 2023-10-08T06:57:59.019 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:59.019 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:59.019 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:59.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:59.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368420+0000", 2023-10-08T06:57:59.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368420+0000", 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:59.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368421+0000", 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0100000000000001e-07 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368479+0000", 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8044000000000002e-05 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:59.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368484+0000", 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7540000000000003e-06 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368488+0000", 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4450000000000001e-06 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368532+0000", 2023-10-08T06:57:59.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4100999999999997e-05 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368545+0000", 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3560999999999999e-05 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382260+0000", 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013714031999999999 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382356+0000", 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6955999999999998e-05 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42675 5.1 5:8fc3f667:::benchmark_data_smithi037_101035_object42674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368579+0000", 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5083279889999996, 2023-10-08T06:57:59.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013813127, 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42675 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368579+0000", 2023-10-08T06:57:59.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368579+0000", 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368580+0000", 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4000000000000001e-07 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368621+0000", 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1335000000000003e-05 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368631+0000", 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0301e-05 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368638+0000", 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368701+0000", 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2595999999999995e-05 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368825+0000", 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012431899999999999 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368948+0000", 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122349 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.371637+0000", 2023-10-08T06:57:59.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026895949999999999 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382285+0000", 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010648062999999999 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382348+0000", 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2728e-05 2023-10-08T06:57:59.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382392+0000", 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4197999999999999e-05 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.031 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:42677 5.9 5:932b56cb:::benchmark_data_smithi037_101035_object42676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:57:59.032 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:59.032 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.508248515, 2023-10-08T06:57:59.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013905221000000001, 2023-10-08T06:57:59.032 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:59.032 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:59.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:59.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:59.033 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:59.033 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 42677 2023-10-08T06:57:59.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.033 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:59.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:59.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:59.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:59.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:59.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:59.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368659+0000", 2023-10-08T06:57:59.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5499999999999998e-07 2023-10-08T06:57:59.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368701+0000", 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2055999999999998e-05 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:59.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368724+0000", 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2889000000000001e-05 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.368731+0000", 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8079999999999999e-06 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370177+0000", 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014464300000000001 2023-10-08T06:57:59.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370291+0000", 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011335100000000001 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.370444+0000", 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015310399999999999 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.373383+0000", 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002939456 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382493+0000", 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.009110155 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:59.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382539+0000", 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6118000000000001e-05 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382564+0000", 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4298999999999999e-05 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.040 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:50899 5.f 5:f78f4ca7:::benchmark_data_smithi037_101035_object50898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.0907146759999999, 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016993019000000002, 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 50899 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:59.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:59.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:57:59.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:59.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:57:59.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:59.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786193+0000", 2023-10-08T06:57:59.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4799999999999998e-07 2023-10-08T06:57:59.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:59.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786222+0000", 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9499e-05 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786232+0000", 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8830000000000001e-06 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:59.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786238+0000", 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1680000000000001e-06 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789392+0000", 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031532930000000002 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789506+0000", 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114697 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789630+0000", 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012329100000000001 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.794834+0000", 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052047309999999998 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803096+0000", 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082619519999999995 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:59.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803149+0000", 2023-10-08T06:57:59.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.304e-05 2023-10-08T06:57:59.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:59.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803185+0000", 2023-10-08T06:57:59.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5917000000000002e-05 2023-10-08T06:57:59.055 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.055 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.056 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.056 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:51894 5.7 5:ef5452b4:::benchmark_data_smithi037_101035_object51893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:57:59.056 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:58.224646+0000", 2023-10-08T06:57:59.056 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.65226080900000005, 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013899743000000001, 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 51894 2023-10-08T06:57:59.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.058 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:57:59.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:57:59.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.224646+0000", 2023-10-08T06:57:59.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.224646+0000", 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.224647+0000", 2023-10-08T06:57:59.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4099999999999998e-07 2023-10-08T06:57:59.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:57:59.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.224680+0000", 2023-10-08T06:57:59.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3290000000000001e-05 2023-10-08T06:57:59.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.224688+0000", 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7940000000000003e-06 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.224694+0000", 2023-10-08T06:57:59.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4949999999999999e-06 2023-10-08T06:57:59.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:57:59.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.226462+0000", 2023-10-08T06:57:59.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017680160000000001 2023-10-08T06:57:59.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:57:59.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.226547+0000", 2023-10-08T06:57:59.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5919000000000002e-05 2023-10-08T06:57:59.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:57:59.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.226633+0000", 2023-10-08T06:57:59.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5926000000000004e-05 2023-10-08T06:57:59.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:57:59.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.232054+0000", 2023-10-08T06:57:59.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054201340000000001 2023-10-08T06:57:59.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:57:59.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.238477+0000", 2023-10-08T06:57:59.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064230800000000003 2023-10-08T06:57:59.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:57:59.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.238518+0000", 2023-10-08T06:57:59.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1026999999999999e-05 2023-10-08T06:57:59.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:57:59.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:57:59.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:57:59.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:58.238546+0000", 2023-10-08T06:57:59.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8320999999999999e-05 2023-10-08T06:57:59.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.067 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:57:59.068 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:57:59.068 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:57:59.069 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:59.068+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:59.070 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:57:59.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:57:59.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:59.170+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:59.205 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:57:59.205 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:57:59.205 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2023-10-08T06:57:59.205 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:57:59.215 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:57:59.268 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:57:59.271 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:59.270+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:59.289 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:57:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:57:59.311 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:57:59.312 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:57:59.312 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:57:59.312 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:57:59.356 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:59.356 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:59.362 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 19 16 52245 52229 171.792 8.125 0.00979808 0.00581767 2023-10-08T06:57:59.368 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:57:59.371 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:59.370+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:59.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:59.470+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:59.535 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:59.535 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:59.552 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:57:59.595 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:59.594+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:59.674 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:57:59.673+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:57:59.737 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:59.738 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:59.752 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:57:59.775 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:59.774+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:59.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:57:59.875+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:57:59.976 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:57:59.976+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:57:59.983 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:57:59.983 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:57:59.997 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:58:00.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:00.076+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:00.178 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:00.177+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:00.190 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:00.190 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:00.208 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:00.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:00.278+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:00.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2023-10-08T06:58:00.363246+0000 min lat: 0.0012103 max lat: 1.0238 avg lat: 0.00587284 2023-10-08T06:58:00.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-10-08T06:58:00.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 20 16 54485 54469 170.202 140 0.0051088 0.00587284 2023-10-08T06:58:00.376 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:00.376 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:00.381 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:00.378+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:00.394 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:00.480 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:00.478+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:00.581 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:00.580+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:00.609 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:00.609 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:00.624 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:00.681 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:00.681+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:00.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:00.782+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:00.798 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:00.799 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:00.815 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:00.884 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:00.883+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:00.978 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:00.979 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:00.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:00.984+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:00.993 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:01.084 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:01.083+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:01.162 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:01.162 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:01.178 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:01.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:01.185+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:01.286 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:01.285+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:01.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:58:01.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:01.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 21 16 56763 56747 168.876 142.375 0.0104762 0.00591854 2023-10-08T06:58:01.386 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:01.386 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:01.387 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:01.385+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:01.399 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:58:01.488 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:01.486+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:01.517 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:01.537 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:01.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:58:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:58:01.588 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:01.588+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:01.589 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:58:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:57242 5.a 5:5c454c25:::benchmark_data_smithi037_101035_object57241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.581535+0000", 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0067232949999999998, 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006756448, 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 57242 2023-10-08T06:58:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.581535+0000", 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.581535+0000", 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.581536+0000", 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4600000000000003e-07 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.581573+0000", 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7503000000000003e-05 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.581582+0000", 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2700000000000004e-06 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.581588+0000", 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2179999999999996e-06 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582255+0000", 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066754399999999995 2023-10-08T06:58:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582331+0000", 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5454e-05 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582417+0000", 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5915999999999995e-05 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585300+0000", 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028835309999999999 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57243 5.8 e33/20 5:1345861a:::benchmark_data_smithi037_101035_object57242:head v 33'3544, mlcod=33'3542)", 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.582106+0000", 2023-10-08T06:58:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0061519249999999999, 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062703109999999998, 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582106+0000", 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582106+0000", 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582107+0000", 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0200000000000002e-07 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582159+0000", 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2367000000000002e-05 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582169+0000", 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9380000000000004e-06 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582176+0000", 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1019999999999999e-06 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582227+0000", 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0603000000000003e-05 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.582239+0000", 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2296999999999999e-05 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57244 5.b e33/20 5:d7b18833:::benchmark_data_smithi037_101035_object57243:head v 33'3674, mlcod=33'3670)", 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.584377+0000", 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0038809790000000001, 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040410660000000003, 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584377+0000", 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584377+0000", 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584378+0000", 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2200000000000004e-07 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584440+0000", 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1748000000000006e-05 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584450+0000", 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0003000000000001e-05 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584457+0000", 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0160000000000003e-06 2023-10-08T06:58:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584490+0000", 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3655999999999998e-05 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584503+0000", 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2656999999999999e-05 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:57249 5.6 5:689aeae7:::benchmark_data_smithi037_101035_object57248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.584524+0000", 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.003734654, 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039427289999999999, 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 57249 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584524+0000", 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584524+0000", 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584524+0000", 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8599999999999996e-07 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584621+0000", 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6280000000000007e-05 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584632+0000", 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0910000000000001e-05 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584640+0000", 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9230000000000002e-06 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584717+0000", 2023-10-08T06:58:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7853000000000002e-05 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584799+0000", 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1268999999999997e-05 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584880+0000", 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0890000000000006e-05 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.608 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57245 5.0 e33/20 5:05025e13:::benchmark_data_smithi037_101035_object57244:head v 33'3497, mlcod=33'3495)", 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.584755+0000", 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.003502902, 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037550890000000001, 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584755+0000", 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584755+0000", 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584756+0000", 2023-10-08T06:58:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0100000000000005e-07 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584871+0000", 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115351 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584880+0000", 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4500000000000004e-06 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584885+0000", 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7400000000000001e-06 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584930+0000", 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4265999999999999e-05 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584946+0000", 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6846000000000001e-05 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:57253 5.e 5:750babfb:::benchmark_data_smithi037_101035_object57252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.584782+0000", 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0034763099999999998, 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037644760000000001, 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 57253 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584782+0000", 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584782+0000", 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584782+0000", 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.06e-07 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584944+0000", 2023-10-08T06:58:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016118299999999999 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584952+0000", 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6750000000000008e-06 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584959+0000", 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5719999999999999e-06 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585002+0000", 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2614000000000002e-05 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585131+0000", 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129164 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585343+0000", 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00021259499999999999 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:57254 5.c 5:3f79458e:::benchmark_data_smithi037_101035_object57253:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.584971+0000", 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.003287056, 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003624338, 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 57254 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584971+0000", 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584971+0000", 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584972+0000", 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6700000000000003e-07 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585000+0000", 2023-10-08T06:58:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8591000000000001e-05 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585008+0000", 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3289999999999996e-06 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585013+0000", 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7010000000000001e-06 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585059+0000", 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6069000000000002e-05 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585309+0000", 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00025003500000000001 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585444+0000", 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000134833 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57247 5.8 e33/20 5:1c187d3e:::benchmark_data_smithi037_101035_object57246:head v 33'3545, mlcod=33'3542)", 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.584901+0000", 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0033569049999999999, 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003736269, 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584901+0000", 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584901+0000", 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.584902+0000", 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1e-07 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585049+0000", 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000147078 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585056+0000", 2023-10-08T06:58:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.002e-06 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585061+0000", 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0490000000000003e-06 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585237+0000", 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000176183 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585257+0000", 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0531999999999999e-05 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57251 5.7 e33/20 5:eeed61cb:::benchmark_data_smithi037_101035_object57250:head v 33'3477, mlcod=33'3475)", 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.585194+0000", 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0030645389999999998, 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0034889309999999998, 2023-10-08T06:58:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585194+0000", 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585194+0000", 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585194+0000", 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9399999999999995e-07 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585228+0000", 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3510000000000003e-05 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585236+0000", 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9759999999999995e-06 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585242+0000", 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0589999999999999e-06 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586629+0000", 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001387342 2023-10-08T06:58:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586641+0000", 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2277e-05 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:57256 5.c 5:30c7fc42:::benchmark_data_smithi037_101035_object57255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.585959+0000", 2023-10-08T06:58:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00229934, 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027923190000000001, 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 57256 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585959+0000", 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585959+0000", 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.585960+0000", 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2200000000000002e-07 2023-10-08T06:58:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586033+0000", 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3454000000000005e-05 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586043+0000", 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8800000000000003e-06 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586050+0000", 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1600000000000001e-06 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.587244+0000", 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001193824 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.587380+0000", 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135733 2023-10-08T06:58:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.587524+0000", 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014457900000000001 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57246 5.b e33/20 5:dfa231c4:::benchmark_data_smithi037_101035_object57245:head v 33'3675, mlcod=33'3672)", 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.586164+0000", 2023-10-08T06:58:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.002093957, 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026724169999999998, 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586164+0000", 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586164+0000", 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586165+0000", 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1099999999999996e-07 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586244+0000", 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9312000000000002e-05 2023-10-08T06:58:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586253+0000", 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7059999999999993e-06 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586259+0000", 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4969999999999998e-06 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586298+0000", 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9205000000000002e-05 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586316+0000", 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7385e-05 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57255 5.8 e33/20 5:13f5b241:::benchmark_data_smithi037_101035_object57254:head v 33'3546, mlcod=33'3542)", 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.586761+0000", 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.001497143, 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0021406799999999998, 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586761+0000", 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586761+0000", 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586762+0000", 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1900000000000002e-07 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586830+0000", 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8565000000000005e-05 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586839+0000", 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3149999999999992e-06 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.586845+0000", 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2790000000000004e-06 2023-10-08T06:58:01.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.587184+0000", 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00033892699999999999 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.587202+0000", 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7969e-05 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:57248 5.b e33/20 5:d636e322:::benchmark_data_smithi037_101035_object57247:head v 33'3676, mlcod=33'3672)", 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:01.588225+0000", 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.2965e-05, 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00070947100000000004, 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588225+0000", 2023-10-08T06:58:01.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588225+0000", 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588226+0000", 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0400000000000005e-07 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588299+0000", 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2547999999999997e-05 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588311+0000", 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2116000000000001e-05 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:01.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588318+0000", 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.447e-06 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588359+0000", 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1264999999999999e-05 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:01.588373+0000", 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3645000000000001e-05 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.648 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:01.649 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.649 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:01.649 INFO:teuthology.orchestra.run.smithi183.stdout: ], 2023-10-08T06:58:01.649 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 13 2023-10-08T06:58:01.649 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:58:01.650 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:58:01.692 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:01.691+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:01.791 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:01.790+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:01.881 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:58:01.881 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:58:01.881 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2023-10-08T06:58:01.882 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2023-10-08T06:58:01.882 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:58:01.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:01.892+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:01.897 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:58:01.993 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:01.992+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:02.095 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:58:02.096 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:58:02.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:58:02.096 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:58:02.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.096 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14433 5.6 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:58:02.096 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.984817140000001, 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017532516000000001, 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.097 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14433 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:02.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106905+0000", 2023-10-08T06:58:02.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:58:02.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106971+0000", 2023-10-08T06:58:02.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5945000000000006e-05 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106979+0000", 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8739999999999995e-06 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106983+0000", 2023-10-08T06:58:02.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3660000000000002e-06 2023-10-08T06:58:02.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107023+0000", 2023-10-08T06:58:02.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9634e-05 2023-10-08T06:58:02.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107137+0000", 2023-10-08T06:58:02.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114747 2023-10-08T06:58:02.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107229+0000", 2023-10-08T06:58:02.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1775999999999997e-05 2023-10-08T06:58:02.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108887+0000", 2023-10-08T06:58:02.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016575100000000001 2023-10-08T06:58:02.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124321+0000", 2023-10-08T06:58:02.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015434128 2023-10-08T06:58:02.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124374+0000", 2023-10-08T06:58:02.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2899000000000003e-05 2023-10-08T06:58:02.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.107 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124437+0000", 2023-10-08T06:58:02.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3016999999999997e-05 2023-10-08T06:58:02.107 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.107 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.107 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.108 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:26900 5.3 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.108 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:58:02.108 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.863551522, 2023-10-08T06:58:02.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017031261999999998, 2023-10-08T06:58:02.109 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.109 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.109 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.109 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 26900 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228171+0000", 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.37e-07 2023-10-08T06:58:02.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228232+0000", 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1746000000000001e-05 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228242+0000", 2023-10-08T06:58:02.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0040999999999999e-05 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228250+0000", 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9140000000000008e-06 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228299+0000", 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8273999999999999e-05 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228429+0000", 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129956 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228557+0000", 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012801199999999999 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.232147+0000", 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035903879999999999 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245130+0000", 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012982570000000001 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245177+0000", 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7830000000000001e-05 2023-10-08T06:58:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245201+0000", 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3794e-05 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28697 5.a 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.221249375999999, 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.029866567, 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28697 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:02.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870473+0000", 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3200000000000005e-07 2023-10-08T06:58:02.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870533+0000", 2023-10-08T06:58:02.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9941000000000001e-05 2023-10-08T06:58:02.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870549+0000", 2023-10-08T06:58:02.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6688e-05 2023-10-08T06:58:02.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870555+0000", 2023-10-08T06:58:02.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9059999999999999e-06 2023-10-08T06:58:02.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870617+0000", 2023-10-08T06:58:02.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1309999999999994e-05 2023-10-08T06:58:02.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870732+0000", 2023-10-08T06:58:02.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115198 2023-10-08T06:58:02.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870813+0000", 2023-10-08T06:58:02.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1542e-05 2023-10-08T06:58:02.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.874939+0000", 2023-10-08T06:58:02.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041253219999999998 2023-10-08T06:58:02.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900278+0000", 2023-10-08T06:58:02.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025339897 2023-10-08T06:58:02.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900315+0000", 2023-10-08T06:58:02.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6229999999999997e-05 2023-10-08T06:58:02.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900339+0000", 2023-10-08T06:58:02.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3901e-05 2023-10-08T06:58:02.129 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.129 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.130 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.130 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28699 5.a 5:5b28870b:::benchmark_data_smithi037_101035_object28698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.130 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:02.130 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.218325727, 2023-10-08T06:58:02.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.027162454999999999, 2023-10-08T06:58:02.131 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.131 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.131 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.131 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.131 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28699 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.06e-07 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873473+0000", 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6679000000000002e-05 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873487+0000", 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3597999999999999e-05 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873491+0000", 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.916e-06 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873529+0000", 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7598000000000002e-05 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873626+0000", 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7367000000000005e-05 2023-10-08T06:58:02.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873729+0000", 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010220799999999999 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880045+0000", 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063162089999999997 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900391+0000", 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020346212999999998 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900514+0000", 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012279700000000001 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900558+0000", 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4264000000000002e-05 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28704 5.a 5:576041a3:::benchmark_data_smithi037_101035_object28703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:02.138 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.215449408, 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.024376907999999999, 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28704 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:02.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876273+0000", 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1099999999999995e-07 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876333+0000", 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0281000000000001e-05 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876341+0000", 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2859999999999999e-06 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876346+0000", 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9099999999999996e-06 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876382+0000", 2023-10-08T06:58:02.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6164000000000001e-05 2023-10-08T06:58:02.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876493+0000", 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001111 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876609+0000", 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000116128 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880067+0000", 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003457304 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900600+0000", 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020532749999999999 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900629+0000", 2023-10-08T06:58:02.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9323e-05 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900649+0000", 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0051000000000002e-05 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30811 5.c 5:33193cdf:::benchmark_data_smithi037_101035_object30810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.146 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 12.432061640000001, 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018643812999999999, 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30811 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9500000000000002e-07 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659715+0000", 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659724+0000", 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7280000000000007e-06 2023-10-08T06:58:02.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659732+0000", 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664288+0000", 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045555680000000003 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664434+0000", 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014595400000000001 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664590+0000", 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156599 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666251+0000", 2023-10-08T06:58:02.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016600549999999999 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678240+0000", 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011989145999999999 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678278+0000", 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8389000000000001e-05 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678304+0000", 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5531e-05 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38560 5.c 5:31643017:::benchmark_data_smithi037_101035_object38559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3461173669999997, 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015913983, 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.153 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38560 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745604+0000", 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745605+0000", 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0699999999999996e-07 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745681+0000", 2023-10-08T06:58:02.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5860999999999998e-05 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745690+0000", 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5619999999999993e-06 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745697+0000", 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5690000000000001e-06 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756602+0000", 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010904775 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756717+0000", 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115425 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.756839+0000", 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012244400000000001 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761372+0000", 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045321939999999998 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.158 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761451+0000", 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9827000000000007e-05 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761490+0000", 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8952999999999998e-05 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.159 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761518+0000", 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7665999999999999e-05 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38562 5.6 5:6537f88c:::benchmark_data_smithi037_101035_object38561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3459416750000006, 2023-10-08T06:58:02.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016164101, 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38562 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:58:02.161 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745780+0000", 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745781+0000", 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5199999999999995e-07 2023-10-08T06:58:02.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745845+0000", 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4641000000000007e-05 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745854+0000", 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6670000000000002e-06 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745862+0000", 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0020000000000006e-06 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745897+0000", 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5339999999999997e-05 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745976+0000", 2023-10-08T06:58:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8535000000000006e-05 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746055+0000", 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9349000000000002e-05 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761759+0000", 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015703931000000001 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761839+0000", 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9800000000000002e-05 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761892+0000", 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3214000000000002e-05 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761944+0000", 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1770000000000001e-05 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38563 5.6 5:693ba6d4:::benchmark_data_smithi037_101035_object38562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3458454070000005, 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019052401, 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.167 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38563 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745877+0000", 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.99e-07 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745909+0000", 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2098999999999999e-05 2023-10-08T06:58:02.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.170 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.170 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.170 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745917+0000", 2023-10-08T06:58:02.170 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9559999999999997e-06 2023-10-08T06:58:02.170 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.170 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.171 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.171 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745922+0000", 2023-10-08T06:58:02.171 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7749999999999998e-06 2023-10-08T06:58:02.171 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.171 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.171 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.171 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757816+0000", 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011893733 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757935+0000", 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011882799999999999 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758060+0000", 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000125217 2023-10-08T06:58:02.172 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761820+0000", 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003759872 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764861+0000", 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030408420000000002 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.173 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764895+0000", 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4248999999999997e-05 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764928+0000", 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3231000000000001e-05 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.174 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38564 5.6 5:646adcee:::benchmark_data_smithi037_101035_object38563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3457709300000005, 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021880430999999999, 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38564 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.175 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745951+0000", 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6400000000000002e-07 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746069+0000", 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000117945 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746078+0000", 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4800000000000001e-06 2023-10-08T06:58:02.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746084+0000", 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759452+0000", 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013368161 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759548+0000", 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5867999999999998e-05 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759671+0000", 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012332700000000001 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764962+0000", 2023-10-08T06:58:02.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052914839999999999 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767742+0000", 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027792110000000002 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767792+0000", 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0659999999999999e-05 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.180 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767831+0000", 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.854e-05 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38569 5.6 5:6346498c:::benchmark_data_smithi037_101035_object38568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3455073350000006, 2023-10-08T06:58:02.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021737508999999999, 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38569 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:02.182 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746215+0000", 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4499999999999997e-07 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746278+0000", 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3112000000000002e-05 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746285+0000", 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746291+0000", 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.993e-06 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761964+0000", 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015672927 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762055+0000", 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0352999999999994e-05 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762165+0000", 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000109961 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764998+0000", 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028333960000000002 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.186 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767879+0000", 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028805129999999999 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767921+0000", 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2070999999999998e-05 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767952+0000", 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0898999999999997e-05 2023-10-08T06:58:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38571 5.6 5:66544174:::benchmark_data_smithi037_101035_object38570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3440695779999992, 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.026065827, 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.188 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38571 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.189 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2799999999999996e-07 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747680+0000", 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7137000000000001e-05 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.190 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747708+0000", 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8674e-05 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747715+0000", 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.64e-06 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765069+0000", 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017353848000000002 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765144+0000", 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5306e-05 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765236+0000", 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2280000000000004e-05 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767868+0000", 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026313320000000001 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773659+0000", 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057915329999999998 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773696+0000", 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7081e-05 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773718+0000", 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1367999999999999e-05 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.194 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:42667 5.6 5:6e2597cd:::benchmark_data_smithi037_101035_object42666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 7.7259454449999998, 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016427344999999999, 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 42667 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.195 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.196 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365776+0000", 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365838+0000", 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365845+0000", 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6580000000000002e-06 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365851+0000", 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0990000000000004e-06 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365903+0000", 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2104000000000001e-05 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366026+0000", 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012274599999999999 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366149+0000", 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012269099999999999 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.368593+0000", 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024444419999999998 2023-10-08T06:58:02.199 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382104+0000", 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013510858000000001 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382164+0000", 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0217000000000003e-05 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382203+0000", 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8872000000000003e-05 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:42668 5.c 5:3b9470c4:::benchmark_data_smithi037_101035_object42667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 7.7258545490000001, 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016740874999999999, 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.201 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 42668 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365867+0000", 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7400000000000003e-07 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365914+0000", 2023-10-08T06:58:02.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6384000000000002e-05 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365922+0000", 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9289999999999998e-06 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.365928+0000", 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1630000000000001e-06 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366055+0000", 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012724599999999999 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366224+0000", 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016901399999999999 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366379+0000", 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015441700000000001 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.370638+0000", 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0042591800000000004 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382507+0000", 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011869071 2023-10-08T06:58:02.206 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382571+0000", 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4533e-05 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382608+0000", 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6363999999999999e-05 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.207 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:42671 5.c 5:33980e00:::benchmark_data_smithi037_101035_object42670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:54.366000+0000", 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 7.7257209309999997, 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016719845000000001, 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 42671 2023-10-08T06:58:02.208 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366000+0000", 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366000+0000", 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366001+0000", 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3900000000000005e-07 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366031+0000", 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0003000000000001e-05 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366038+0000", 2023-10-08T06:58:02.210 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.366045+0000", 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.348e-06 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.367752+0000", 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0017074379999999999 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.211 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.367843+0000", 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1040999999999998e-05 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.368004+0000", 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016096599999999999 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.371895+0000", 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0038909980000000001 2023-10-08T06:58:02.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382658+0000", 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010762814000000001 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382698+0000", 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0241000000000003e-05 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:54.382720+0000", 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2310000000000002e-05 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:51449 5.0 e31/20 5:078c55bb:::benchmark_data_smithi037_101035_object51448:head v 31'3147, mlcod=31'3145)", 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.062468032, 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016999805999999999, 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.214 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029254+0000", 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2e-07 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029284+0000", 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0264999999999999e-05 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029293+0000", 2023-10-08T06:58:02.216 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6689999999999995e-06 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029300+0000", 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8379999999999996e-06 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.034256+0000", 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049568140000000004 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.217 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.034279+0000", 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2858e-05 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046210+0000", 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011930329999999999 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.218 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046253+0000", 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3612000000000002e-05 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:51451 5.8 e31/20 5:1f80398c:::benchmark_data_smithi037_101035_object51450:head v 31'3157, mlcod=31'3151)", 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.0615165229999999, 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016149121999999998, 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.219 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030205+0000", 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9799999999999999e-07 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030275+0000", 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9564e-05 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030284+0000", 2023-10-08T06:58:02.221 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7830000000000004e-06 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.030290+0000", 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6390000000000003e-06 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.036122+0000", 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058316330000000001 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.036137+0000", 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4955e-05 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046325+0000", 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010188041 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.223 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046354+0000", 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9209000000000001e-05 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52025 5.e 5:78ce0172:::benchmark_data_smithi037_101035_object52024:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.8019388200000002, 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.017239604, 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.224 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52025 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.225 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3900000000000004e-07 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.226 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289881+0000", 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7559000000000006e-05 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289890+0000", 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8699999999999998e-06 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289895+0000", 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5740000000000003e-06 2023-10-08T06:58:02.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290751+0000", 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00085582900000000001 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290760+0000", 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7679999999999997e-06 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.228 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297332+0000", 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065719400000000001 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297341+0000", 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8249999999999994e-06 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.306177+0000", 2023-10-08T06:58:02.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0088363520000001 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307022+0000", 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00084514799999999999 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.230 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52028 5.e 5:7ff4b5d8:::benchmark_data_smithi037_101035_object52027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.8018158729999998, 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.017449322, 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52028 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.231 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:02.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.75e-07 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289982+0000", 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5687999999999998e-05 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289991+0000", 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5880000000000004e-06 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289998+0000", 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3090000000000001e-06 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290849+0000", 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00085124799999999998 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2023-10-08T06:58:02.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290856+0000", 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.097e-06 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297370+0000", 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065140500000000004 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297375+0000", 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7010000000000004e-06 2023-10-08T06:58:02.235 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307299+0000", 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.009924305 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307355+0000", 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5760999999999997e-05 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.236 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52029 5.e 5:7d9a3073:::benchmark_data_smithi037_101035_object52028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.8017144969999999, 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0174442429999999, 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52029 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:02.238 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290008+0000", 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8199999999999999e-07 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290073+0000", 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5423e-05 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.239 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290081+0000", 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290089+0000", 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3690000000000007e-06 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290881+0000", 2023-10-08T06:58:02.240 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00079155399999999998 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290886+0000", 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.95e-06 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297405+0000", 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065193630000000002 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.241 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297417+0000", 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1499e-05 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307387+0000", 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.009970187 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307451+0000", 2023-10-08T06:58:02.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4251999999999994e-05 2023-10-08T06:58:02.243 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.243 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.243 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.243 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:02.243 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:02.243 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:58:02.243 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:02.093+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:02.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:02.245 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:02.244+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:58:02.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:02.347+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:02.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 22 16 58929 58913 167.353 135.375 0.00377392 0.00597247 2023-10-08T06:58:02.420 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:02.420 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:02.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.421 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:59039 5.1 e34/20)", 2023-10-08T06:58:02.421 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.418654+0000", 2023-10-08T06:58:02.421 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00077656299999999997, 2023-10-08T06:58:02.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00079165400000000003, 2023-10-08T06:58:02.421 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.421 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.418654+0000", 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.418654+0000", 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.418654+0000", 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1199999999999998e-07 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.418657+0000", 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8650000000000001e-06 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.418665+0000", 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2320000000000001e-06 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.418670+0000", 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8080000000000004e-06 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:59041 5.9 e34/20)", 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.419008+0000", 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00042298999999999999, 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00046879000000000002, 2023-10-08T06:58:02.425 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419008+0000", 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419008+0000", 2023-10-08T06:58:02.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419008+0000", 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419012+0000", 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5920000000000001e-06 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419020+0000", 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6580000000000008e-06 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419025+0000", 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1109999999999999e-06 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:59042 5.9 e34/20)", 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.419226+0000", 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.000204935, 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000278001, 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419226+0000", 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419226+0000", 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419226+0000", 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5100000000000001e-07 2023-10-08T06:58:02.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419228+0000", 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9980000000000002e-06 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419234+0000", 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0209999999999996e-06 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.419238+0000", 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4379999999999997e-06 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59039 5.1 5:84d57f8b:::benchmark_data_smithi037_101035_object59038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.412796+0000", 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0066340770000000004, 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067420220000000003, 2023-10-08T06:58:02.432 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59039 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412796+0000", 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412796+0000", 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412797+0000", 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412832+0000", 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5036000000000001e-05 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412842+0000", 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4579999999999999e-06 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412848+0000", 2023-10-08T06:58:02.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412898+0000", 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0841999999999999e-05 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413034+0000", 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000135277 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413169+0000", 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013528999999999999 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59040 5.9 5:90c95553:::benchmark_data_smithi037_101035_object59039:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.412863+0000", 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0065672350000000003, 2023-10-08T06:58:02.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067224939999999999, 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59040 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412863+0000", 2023-10-08T06:58:02.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412863+0000", 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412864+0000", 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:02.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412926+0000", 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1777000000000002e-05 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412942+0000", 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6560000000000001e-05 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412959+0000", 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6685999999999999e-05 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413009+0000", 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0251999999999999e-05 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413132+0000", 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000123189 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413274+0000", 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000141509 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.442 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59041 5.9 5:95379477:::benchmark_data_smithi037_101035_object59040:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.412979+0000", 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0064511480000000003, 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066541609999999996, 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.443 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59041 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412979+0000", 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412979+0000", 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.412980+0000", 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5899999999999996e-07 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413015+0000", 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4448e-05 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413022+0000", 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4410000000000004e-06 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413028+0000", 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414944+0000", 2023-10-08T06:58:02.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019160410000000001 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415103+0000", 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015980399999999999 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415250+0000", 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014608399999999999 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.447 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59042 5.9 5:93722f78:::benchmark_data_smithi037_101035_object59041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.413037+0000", 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.006393368, 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066411370000000001, 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59042 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413037+0000", 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413037+0000", 2023-10-08T06:58:02.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413038+0000", 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8500000000000001e-07 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413062+0000", 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.44e-05 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413069+0000", 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413074+0000", 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4820000000000002e-06 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416851+0000", 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037763990000000002 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416981+0000", 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013045799999999999 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417132+0000", 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000150576 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.452 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59044 5.1 5:866cc419:::benchmark_data_smithi037_101035_object59043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.413423+0000", 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0060070610000000002, 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062988319999999999, 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59044 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413423+0000", 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413423+0000", 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413424+0000", 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413452+0000", 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7863000000000001e-05 2023-10-08T06:58:02.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413462+0000", 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9340000000000001e-06 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.413469+0000", 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1500000000000002e-06 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416830+0000", 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033603880000000002 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416907+0000", 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7517999999999999e-05 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416988+0000", 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1199999999999995e-05 2023-10-08T06:58:02.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59047 5.9 5.28b33f99 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.414856+0000", 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0045745120000000002, 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004909737, 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.458 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59047 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414856+0000", 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414856+0000", 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414857+0000", 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1429999999999999e-06 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414983+0000", 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012586699999999999 2023-10-08T06:58:02.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414997+0000", 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3932e-05 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415006+0000", 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1360000000000003e-06 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.461 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:59050 5.3 e34/20 5:c9b529cb:::benchmark_data_smithi037_101035_object59049:head v 34'3673, mlcod=34'3671)", 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.415577+0000", 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0038536099999999999, 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042226199999999998, 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415577+0000", 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415577+0000", 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415577+0000", 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6400000000000003e-07 2023-10-08T06:58:02.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415640+0000", 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2235000000000003e-05 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415648+0000", 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6430000000000001e-06 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415653+0000", 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9400000000000001e-06 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415714+0000", 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0557999999999999e-05 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415731+0000", 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7448999999999998e-05 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.465 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:59051 5.5 e34/20 5:a5d9862d:::benchmark_data_smithi037_101035_object59050:head v 34'3655, mlcod=34'3652)", 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.416643+0000", 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0027877560000000002, 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032010279999999999, 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416643+0000", 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416643+0000", 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416643+0000", 2023-10-08T06:58:02.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6899999999999997e-07 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416699+0000", 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5778e-05 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416709+0000", 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0071000000000001e-05 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416719+0000", 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3870000000000001e-06 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416761+0000", 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2478999999999998e-05 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.416781+0000", 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0307999999999999e-05 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:59040 5.9 e34/20)", 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.417327+0000", 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0021035609999999999, 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025638319999999998, 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417327+0000", 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417327+0000", 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417328+0000", 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.68e-07 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417331+0000", 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4869999999999998e-06 2023-10-08T06:58:02.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417347+0000", 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5653000000000001e-05 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417353+0000", 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.545e-06 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.473 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59052 5.2 5:46c2f292:::benchmark_data_smithi037_101035_object59051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.417649+0000", 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0017814129999999999, 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002276873, 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.474 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59052 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417649+0000", 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417649+0000", 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417650+0000", 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-06 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417715+0000", 2023-10-08T06:58:02.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4735999999999998e-05 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417727+0000", 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1796e-05 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417734+0000", 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1060000000000002e-06 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417793+0000", 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8733000000000002e-05 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.417902+0000", 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010888299999999999 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.418042+0000", 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014003799999999999 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 13 2023-10-08T06:58:02.479 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:02.481 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:02.481 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:02.479+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:02.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:02.581+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:02.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:02.682+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:02.702 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:02.703 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:02.703 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:02.703 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:02.703 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:02.715 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:02.783 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:02.782+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:02.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:02.884+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:02.937 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:02.937 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:02.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:02.937 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:02.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.938 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:58:02.938 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:02.938 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.82598059, 2023-10-08T06:58:02.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:58:02.938 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.938 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.939 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:02.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:58:02.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:58:02.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:58:02.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:58:02.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:58:02.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:58:02.944 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.944 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.945 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:26900 5.3 e27/20 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head v 27'1703, mlcod=27'1700)", 2023-10-08T06:58:02.945 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:02.945 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.704651543000001, 2023-10-08T06:58:02.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016375165000000001, 2023-10-08T06:58:02.946 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.946 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.946 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:02.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:02.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:02.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6699999999999999e-07 2023-10-08T06:58:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228688+0000", 2023-10-08T06:58:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8009e-05 2023-10-08T06:58:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228694+0000", 2023-10-08T06:58:02.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3690000000000003e-06 2023-10-08T06:58:02.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228705+0000", 2023-10-08T06:58:02.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0019e-05 2023-10-08T06:58:02.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228746+0000", 2023-10-08T06:58:02.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1140000000000003e-05 2023-10-08T06:58:02.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228766+0000", 2023-10-08T06:58:02.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0310999999999999e-05 2023-10-08T06:58:02.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.244952+0000", 2023-10-08T06:58:02.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016186158999999999 2023-10-08T06:58:02.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245005+0000", 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2791000000000003e-05 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:02.955 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.059726850000001, 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:02.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:02.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:02.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.962 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.052892462000001, 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:02.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:02.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:02.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:31559 5.7 5:ef911ca4:::benchmark_data_smithi037_101035_object31558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.969 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.991578704, 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015291592999999999, 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 31559 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941703+0000", 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941704+0000", 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0869999999999999e-06 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941771+0000", 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7267000000000005e-05 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941782+0000", 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1253999999999999e-05 2023-10-08T06:58:02.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941788+0000", 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2999999999999998e-06 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941837+0000", 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8238000000000001e-05 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.941976+0000", 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013968499999999999 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.942307+0000", 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00033071100000000003 2023-10-08T06:58:02.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.943850+0000", 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001542777 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956893+0000", 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013042672999999999 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956955+0000", 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2786999999999994e-05 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:49.956994+0000", 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8813999999999998e-05 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:32200 5.1 5:88d4e8c5:::benchmark_data_smithi037_101035_object32199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.746560428, 2023-10-08T06:58:02.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014682766, 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 32200 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186721+0000", 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186722+0000", 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186831+0000", 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109088 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186844+0000", 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2629999999999999e-05 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.186851+0000", 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5870000000000004e-06 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192680+0000", 2023-10-08T06:58:02.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058284460000000001 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192763+0000", 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3529000000000006e-05 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.192849+0000", 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5500999999999993e-05 2023-10-08T06:58:02.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.198504+0000", 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056553050000000002 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201342+0000", 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002838283 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201371+0000", 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8418000000000001e-05 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:50.201404+0000", 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3027000000000001e-05 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:38550 5.7 5:e4621c07:::benchmark_data_smithi037_101035_object38549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.192869322, 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016332946000000001, 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 38550 2023-10-08T06:58:02.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1399999999999997e-07 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740594+0000", 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018210399999999999 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740600+0000", 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7089999999999999e-06 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740604+0000", 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7620000000000001e-06 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741601+0000", 2023-10-08T06:58:02.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099723600000000009 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741738+0000", 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137219 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741885+0000", 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014629399999999999 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.743601+0000", 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017165010000000001 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756688+0000", 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013086591 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756723+0000", 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5126000000000002e-05 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756745+0000", 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1990000000000001e-05 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42667 5.6 e30/20 5:6e2597cd:::benchmark_data_smithi037_101035_object42666:head v 30'2725, mlcod=30'2722)", 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.567042914, 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015488478, 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366238+0000", 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366239+0000", 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5999999999999999e-07 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366284+0000", 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5608000000000001e-05 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366292+0000", 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7130000000000005e-06 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366297+0000", 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.288e-06 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366349+0000", 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1119999999999998e-05 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.366368+0000", 2023-10-08T06:58:02.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9619999999999998e-05 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.381681+0000", 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015312614 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.381727+0000", 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6054999999999999e-05 2023-10-08T06:58:02.996 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:42668 5.c e30/20 5:3b9470c4:::benchmark_data_smithi037_101035_object42667:head v 30'2777, mlcod=30'2773)", 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5658193540000003, 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014897924, 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367462+0000", 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367463+0000", 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6300000000000005e-07 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367514+0000", 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1226e-05 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367523+0000", 2023-10-08T06:58:02.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1819999999999995e-06 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367529+0000", 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3980000000000004e-06 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367596+0000", 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6440999999999996e-05 2023-10-08T06:58:03.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.367614+0000", 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8428e-05 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382289+0000", 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014675006000000001 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:54.382360+0000", 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0580000000000005e-05 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:50899 5.f 5:f78f4ca7:::benchmark_data_smithi037_101035_object50898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.1470889389999996, 2023-10-08T06:58:03.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016993019000000002, 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 50899 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:03.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786193+0000", 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4799999999999998e-07 2023-10-08T06:58:03.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786222+0000", 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9499e-05 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786232+0000", 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8830000000000001e-06 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786238+0000", 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1680000000000001e-06 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789392+0000", 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031532930000000002 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789506+0000", 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114697 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789630+0000", 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012329100000000001 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.794834+0000", 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052047309999999998 2023-10-08T06:58:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803096+0000", 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082619519999999995 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803149+0000", 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.304e-05 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803185+0000", 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5917000000000002e-05 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57879 5.1 5:8c6a3c53:::benchmark_data_smithi037_101035_object57878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.879739+0000", 2023-10-08T06:58:03.009 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.0535418379999999, 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015964373, 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57879 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879739+0000", 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879739+0000", 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879740+0000", 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7100000000000001e-07 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879770+0000", 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0017000000000001e-05 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879781+0000", 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0479000000000001e-05 2023-10-08T06:58:03.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879788+0000", 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0430000000000002e-06 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879840+0000", 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2175000000000001e-05 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879966+0000", 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012602199999999999 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.880102+0000", 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013643699999999999 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.885948+0000", 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058456439999999997 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.895651+0000", 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097032790000000004 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.895683+0000", 2023-10-08T06:58:03.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2029000000000001e-05 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.895704+0000", 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0477000000000001e-05 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.016 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57920 5.2 5:4b015bf8:::benchmark_data_smithi037_101035_object57919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.0334768110000001, 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017795800000000001, 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57920 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899805+0000", 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900121+0000", 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031621900000000002 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900127+0000", 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2859999999999996e-06 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900131+0000", 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4369999999999999e-06 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906312+0000", 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061814790000000001 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906420+0000", 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010733700000000001 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906504+0000", 2023-10-08T06:58:03.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4794000000000002e-05 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.909717+0000", 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032127689999999999 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917514+0000", 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077965819999999998 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917559+0000", 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5618999999999998e-05 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917600+0000", 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0908999999999997e-05 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.023 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57922 5.2 5:47786b04:::benchmark_data_smithi037_101035_object57921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.03314544, 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017617088999999999, 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.024 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57922 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:03.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9700000000000003e-07 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900176+0000", 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0093999999999999e-05 2023-10-08T06:58:03.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900185+0000", 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.918e-06 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900189+0000", 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1810000000000003e-06 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.907989+0000", 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078000559999999997 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908154+0000", 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016444300000000001 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908326+0000", 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017191999999999999 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.911360+0000", 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003033956 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917653+0000", 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062937280000000002 2023-10-08T06:58:03.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917719+0000", 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5865999999999996e-05 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917753+0000", 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3630000000000002e-05 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.030 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58515 5.7 5:e5bd311c:::benchmark_data_smithi037_101035_object58514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.76168588800000003, 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019075253, 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58515 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171596+0000", 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171630+0000", 2023-10-08T06:58:03.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4464000000000001e-05 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171637+0000", 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171641+0000", 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6030000000000001e-06 2023-10-08T06:58:03.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177693+0000", 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060519090000000003 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177783+0000", 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0705000000000007e-05 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177924+0000", 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140815 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181053+0000", 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003129204 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190584+0000", 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095309550000000007 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190633+0000", 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8715999999999999e-05 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190671+0000", 2023-10-08T06:58:03.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58528 5.f 5:fc8a38c2:::benchmark_data_smithi037_101035_object58527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75545465099999998, 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016426361, 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.038 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58528 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9500000000000001e-07 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177933+0000", 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000106019 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177959+0000", 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5918000000000002e-05 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177975+0000", 2023-10-08T06:58:03.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5333e-05 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181064+0000", 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030889899999999998 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181233+0000", 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016972999999999999 2023-10-08T06:58:03.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181383+0000", 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014949200000000001 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184425+0000", 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030423490000000002 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194169+0000", 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097436050000000007 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194217+0000", 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7927999999999999e-05 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194253+0000", 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6202000000000003e-05 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58529 5.7 5:ea04c6bf:::benchmark_data_smithi037_101035_object58528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75529435499999997, 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016172057, 2023-10-08T06:58:03.045 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58529 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:03.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9500000000000003e-07 2023-10-08T06:58:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.178023+0000", 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5942999999999998e-05 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.178031+0000", 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5769999999999996e-06 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.178037+0000", 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.604e-06 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181074+0000", 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030378950000000001 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181168+0000", 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3387000000000006e-05 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181256+0000", 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8647999999999996e-05 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.188801+0000", 2023-10-08T06:58:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.007544912 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194056+0000", 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052542099999999996 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194115+0000", 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9225999999999998e-05 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194159+0000", 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4159999999999997e-05 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58547 5.f 5:f2fdcd35:::benchmark_data_smithi037_101035_object58546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.184063+0000", 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.74921833100000002, 2023-10-08T06:58:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014938432, 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58547 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184063+0000", 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184063+0000", 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184063+0000", 2023-10-08T06:58:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5299999999999999e-07 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184161+0000", 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7854000000000002e-05 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184172+0000", 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0344e-05 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184179+0000", 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8849999999999999e-06 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.188810+0000", 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046300459999999996 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.188928+0000", 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118918 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.189032+0000", 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010392599999999999 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194446+0000", 2023-10-08T06:58:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054137509999999996 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.198911+0000", 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044647929999999999 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.198964+0000", 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3158999999999997e-05 2023-10-08T06:58:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.199001+0000", 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7302999999999998e-05 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58687 5.2 5:47eb922e:::benchmark_data_smithi037_101035_object58686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.250261+0000", 2023-10-08T06:58:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.68302042699999999, 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015097651, 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58687 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.250261+0000", 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.250261+0000", 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.250262+0000", 2023-10-08T06:58:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4649999999999999e-06 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.250318+0000", 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5816999999999998e-05 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.250332+0000", 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3913999999999999e-05 2023-10-08T06:58:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.250350+0000", 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7484999999999999e-05 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.254061+0000", 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003711935 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.254165+0000", 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103726 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.254307+0000", 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000141879 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.260483+0000", 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061754920000000003 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.265262+0000", 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004779106 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.265316+0000", 2023-10-08T06:58:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4521000000000002e-05 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.265359+0000", 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2311000000000002e-05 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59047 5.9 5:99fccd14:::benchmark_data_smithi037_101035_object59046:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.414856+0000", 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51842525100000003, 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015963805000000001, 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59047 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414856+0000", 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414856+0000", 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414857+0000", 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1429999999999999e-06 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414983+0000", 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012586699999999999 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.414997+0000", 2023-10-08T06:58:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3932e-05 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.415006+0000", 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1360000000000003e-06 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.422042+0000", 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070362560000000003 2023-10-08T06:58:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.422175+0000", 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013296200000000001 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.422340+0000", 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000165105 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.425249+0000", 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029083870000000001 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.430696+0000", 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447159 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.430753+0000", 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6681999999999997e-05 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.430820+0000", 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7175999999999995e-05 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:59400 5.2 5:45e37c36:::benchmark_data_smithi037_101035_object59399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.572038+0000", 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.361243602, 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015071911, 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 59400 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572038+0000", 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572038+0000", 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572038+0000", 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7599999999999996e-07 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572086+0000", 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7765000000000001e-05 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572094+0000", 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1130000000000001e-06 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572101+0000", 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1060000000000002e-06 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572149+0000", 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7329e-05 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572267+0000", 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000117849 2023-10-08T06:58:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.572410+0000", 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000143416 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.574362+0000", 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019524480000000001 2023-10-08T06:58:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.587029+0000", 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012666515999999999 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.587082+0000", 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3031000000000001e-05 2023-10-08T06:58:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.587110+0000", 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7562000000000001e-05 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:03.081 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:03.082 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:03.081+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:03.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:03.184 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:03.182+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:03.254 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:03.254 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:03.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.254 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60867 5.8 5.66ec6c48 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.254 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.251586+0000", 2023-10-08T06:58:03.254 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00010944500000000001, 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015640599999999999, 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60867 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251586+0000", 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251586+0000", 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251587+0000", 2023-10-08T06:58:03.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2900000000000002e-07 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251665+0000", 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7778e-05 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251677+0000", 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1980999999999999e-05 2023-10-08T06:58:03.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251683+0000", 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0820000000000004e-06 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251718+0000", 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5476999999999999e-05 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60869 5.4 5.e19efc94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.251700+0000", 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9999952, 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013709099999999999, 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60869 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251700+0000", 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251700+0000", 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251701+0000", 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.37e-07 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251787+0000", 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5609e-05 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251795+0000", 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8470000000000002e-06 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.251811+0000", 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5204e-05 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60854 5.0 5:0146713f:::benchmark_data_smithi037_101035_object60853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.245901+0000", 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0057941570000000003, 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060125730000000002, 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60854 2023-10-08T06:58:03.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.245901+0000", 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.245901+0000", 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.245902+0000", 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1500000000000003e-07 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246019+0000", 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117246 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246031+0000", 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1371e-05 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246041+0000", 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9210000000000004e-06 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246094+0000", 2023-10-08T06:58:03.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3334000000000001e-05 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246242+0000", 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014808900000000001 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246400+0000", 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015819400000000001 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250922+0000", 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045213440000000001 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60855 5.8 5:17342f07:::benchmark_data_smithi037_101035_object60854:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.246060+0000", 2023-10-08T06:58:03.268 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0056353369999999998, 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059586409999999998, 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60855 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246060+0000", 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246060+0000", 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246061+0000", 2023-10-08T06:58:03.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899999999999999e-07 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246108+0000", 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7859999999999999e-05 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246117+0000", 2023-10-08T06:58:03.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1510000000000004e-06 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246127+0000", 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0437e-05 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246180+0000", 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2846000000000002e-05 2023-10-08T06:58:03.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246370+0000", 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190469 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.246534+0000", 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000163886 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:60850 5.e e34/32 5:71d8a346:::benchmark_data_smithi037_101035_object60849:head v 34'3874, mlcod=34'3871)", 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.247894+0000", 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0038009710000000002, 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041994750000000003, 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:03.274 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.247894+0000", 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.247894+0000", 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.247895+0000", 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2500000000000005e-07 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.247945+0000", 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0071000000000002e-05 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.247955+0000", 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0247e-05 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.247962+0000", 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0720000000000002e-06 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248007+0000", 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4582000000000001e-05 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248020+0000", 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3011e-05 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.278 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60861 5.4 5:2db764ba:::benchmark_data_smithi037_101035_object60860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.248812+0000", 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002883465, 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033675350000000001, 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60861 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248812+0000", 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248812+0000", 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248813+0000", 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9400000000000004e-07 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248926+0000", 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113708 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248939+0000", 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2249000000000001e-05 2023-10-08T06:58:03.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248947+0000", 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.248988+0000", 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0742999999999999e-05 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249077+0000", 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9349000000000001e-05 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249172+0000", 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5229000000000006e-05 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:60860 5.d e34/32 5:b54a16f4:::benchmark_data_smithi037_101035_object60859:head v 34'3711, mlcod=34'3708)", 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.249283+0000", 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0024126719999999998, 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029778740000000001, 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249283+0000", 2023-10-08T06:58:03.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249283+0000", 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249283+0000", 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-07 2023-10-08T06:58:03.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249325+0000", 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2074999999999999e-05 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249334+0000", 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9029999999999993e-06 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249342+0000", 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9179999999999994e-06 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249391+0000", 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9329000000000002e-05 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.249413+0000", 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1480000000000001e-05 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60863 5.b 5:d1376f18:::benchmark_data_smithi037_101035_object60862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.288 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.250308+0000", 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001387735, 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020260410000000001, 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60863 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.289 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250308+0000", 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250308+0000", 2023-10-08T06:58:03.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250309+0000", 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.063e-06 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250359+0000", 2023-10-08T06:58:03.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0093000000000003e-05 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250374+0000", 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5563e-05 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250383+0000", 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6219999999999998e-06 2023-10-08T06:58:03.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250463+0000", 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0017000000000003e-05 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250554+0000", 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1009999999999998e-05 2023-10-08T06:58:03.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.250685+0000", 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000131469 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2023-10-08T06:58:03.294 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:03.296 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:03.294+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:03.296 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:03.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 23 16 61116 61100 166.019 136.688 0.0057833 0.00602029 2023-10-08T06:58:03.397 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:03.396+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:03.410 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T06:58:03.410 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T06:58:03.410 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-10-08T06:58:03.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-10-08T06:58:03.473 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:03.474 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:03.488 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:03.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:03.497+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:03.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:03.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:03.598+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:03.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:03.699+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.834452499999999, 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.832017744, 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:58:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.831744281000001, 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.83160451, 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:58:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:58:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:58:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.831517655000001, 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.831456747000001, 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:58:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:58:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:58:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.831347549, 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:58:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:58:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.828751991000001, 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:03.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:03.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.770 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.826175243, 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.771 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:58:03.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:58:03.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:58:03.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:58:03.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:58:03.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:58:03.779 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38567 5.e 5:7e0678cf:::benchmark_data_smithi037_101035_object38566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.953497175999999, 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016004681999999999, 2023-10-08T06:58:03.780 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38567 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746173+0000", 2023-10-08T06:58:03.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746220+0000", 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6269e-05 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746228+0000", 2023-10-08T06:58:03.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7960000000000001e-06 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746238+0000", 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3419999999999997e-06 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746297+0000", 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9485999999999999e-05 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746395+0000", 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7388999999999999e-05 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.746526+0000", 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013114100000000001 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.748377+0000", 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001851679 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762072+0000", 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013694674 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762139+0000", 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7436999999999998e-05 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.762177+0000", 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7876999999999997e-05 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:38981 5.8 5:139681d3:::benchmark_data_smithi037_101035_object38980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.779458212, 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016272268999999999, 2023-10-08T06:58:03.788 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38981 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:58:03.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920212+0000", 2023-10-08T06:58:03.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4600000000000005e-07 2023-10-08T06:58:03.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920325+0000", 2023-10-08T06:58:03.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112623 2023-10-08T06:58:03.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920333+0000", 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7069999999999992e-06 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.920339+0000", 2023-10-08T06:58:03.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926104+0000", 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057651339999999999 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926229+0000", 2023-10-08T06:58:03.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125637 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.926371+0000", 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141648 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.928101+0000", 2023-10-08T06:58:03.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017302859999999999 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936393+0000", 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0082914990000000008 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936448+0000", 2023-10-08T06:58:03.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5322000000000003e-05 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:52.936484+0000", 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5775999999999998e-05 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:40663 5.e 5:74d3402d:::benchmark_data_smithi037_101035_object40662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-10-08T06:58:03.796 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.118084264, 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015880376000000002, 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40663 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581586+0000", 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1399999999999996e-07 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581645+0000", 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9054000000000001e-05 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581652+0000", 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5509999999999996e-06 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581657+0000", 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.147e-06 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581709+0000", 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1558999999999999e-05 2023-10-08T06:58:03.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.581864+0000", 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015551399999999999 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.582032+0000", 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016779100000000001 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.583970+0000", 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001938267 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597386+0000", 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013416311 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597426+0000", 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9405e-05 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:53.597466+0000", 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0062999999999999e-05 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51437 5.8 5:1395e381:::benchmark_data_smithi037_101035_object51436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.024554+0000", 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6751159300000005, 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016155275, 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51437 2023-10-08T06:58:03.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024554+0000", 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024554+0000", 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024555+0000", 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5400000000000001e-07 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024644+0000", 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9666000000000005e-05 2023-10-08T06:58:03.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024654+0000", 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0137e-05 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024662+0000", 2023-10-08T06:58:03.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4529999999999996e-06 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024703+0000", 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0877999999999997e-05 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024803+0000", 2023-10-08T06:58:03.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9989999999999996e-05 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024900+0000", 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6848999999999994e-05 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030940+0000", 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060401120000000003 2023-10-08T06:58:03.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.040636+0000", 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0096964240000000004 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.040685+0000", 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8980000000000002e-05 2023-10-08T06:58:03.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.040709+0000", 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4131999999999999e-05 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.811 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51440 5.8 5:1efc69c5:::benchmark_data_smithi037_101035_object51439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.024722+0000", 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6749474610000004, 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016135884999999999, 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51440 2023-10-08T06:58:03.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024722+0000", 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024722+0000", 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024723+0000", 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3900000000000004e-07 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024779+0000", 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5556000000000001e-05 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024787+0000", 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1410000000000005e-06 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.024794+0000", 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8689999999999998e-06 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026315+0000", 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015215269999999999 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026432+0000", 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117246 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026594+0000", 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016121500000000001 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030943+0000", 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004348841 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.040754+0000", 2023-10-08T06:58:03.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098119729999999999 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.040815+0000", 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0628000000000003e-05 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.040858+0000", 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3149999999999999e-05 2023-10-08T06:58:03.818 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51442 5.8 5:128c17d7:::benchmark_data_smithi037_101035_object51441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6745261679999999, 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018100852000000001, 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.819 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51442 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025179+0000", 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4416999999999999e-05 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025186+0000", 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.452e-06 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025193+0000", 2023-10-08T06:58:03.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.674e-06 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027741+0000", 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025483200000000002 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027823+0000", 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1264e-05 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027908+0000", 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5137999999999997e-05 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030945+0000", 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030372659999999998 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043185+0000", 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01224039 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043222+0000", 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043245+0000", 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2138999999999999e-05 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51448 5.8 5:12d8ea5b:::benchmark_data_smithi037_101035_object51447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6731775979999997, 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018610680000000001, 2023-10-08T06:58:03.826 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51448 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026493+0000", 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2500000000000004e-07 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026551+0000", 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7887999999999999e-05 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026568+0000", 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886000000000001e-05 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026577+0000", 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6339999999999996e-06 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028861+0000", 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022836639999999999 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028971+0000", 2023-10-08T06:58:03.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001094 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029055+0000", 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4484e-05 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032150+0000", 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030947420000000002 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045032+0000", 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012882482000000001 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045068+0000", 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5799000000000001e-05 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045103+0000", 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4876000000000003e-05 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51449 5.0 5:078c55bb:::benchmark_data_smithi037_101035_object51448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6730769189999997, 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019798169000000001, 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.833 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51449 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2800000000000002e-07 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026615+0000", 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1171000000000001e-05 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026620+0000", 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6389999999999997e-06 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026624+0000", 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7500000000000001e-06 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028853+0000", 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002228701 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028993+0000", 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140741 2023-10-08T06:58:03.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029106+0000", 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011309100000000001 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.031364+0000", 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022572999999999998 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046335+0000", 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014971572000000001 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046369+0000", 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3778000000000001e-05 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046391+0000", 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1997999999999998e-05 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51451 5.8 5:1f80398c:::benchmark_data_smithi037_101035_object51450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6705294869999996, 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017441129999999999, 2023-10-08T06:58:03.840 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51451 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:03.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029141+0000", 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.78e-07 2023-10-08T06:58:03.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029229+0000", 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7996000000000002e-05 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029241+0000", 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2111e-05 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029250+0000", 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7819999999999999e-06 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029939+0000", 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00068897900000000005 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030024+0000", 2023-10-08T06:58:03.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4802999999999994e-05 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030108+0000", 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4419000000000006e-05 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032167+0000", 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020585299999999998 2023-10-08T06:58:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046534+0000", 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014367322 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046563+0000", 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9286999999999999e-05 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046581+0000", 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8023e-05 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60821 5.0 5:09632156:::benchmark_data_smithi037_101035_object60820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.47312114199999999, 2023-10-08T06:58:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017726374, 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60821 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226550+0000", 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0200000000000001e-07 2023-10-08T06:58:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226617+0000", 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7148000000000002e-05 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226627+0000", 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0030000000000001e-05 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226635+0000", 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8679999999999999e-06 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234547+0000", 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079128459999999994 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234636+0000", 2023-10-08T06:58:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8665999999999994e-05 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234726+0000", 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0251e-05 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.238072+0000", 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033451829999999998 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244212+0000", 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006140899 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244247+0000", 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4879000000000003e-05 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244275+0000", 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7801999999999999e-05 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:61318 5.b 5:dd58568c:::benchmark_data_smithi037_101035_object61317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.458562+0000", 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.241107877, 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015850962999999999, 2023-10-08T06:58:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 61318 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.458562+0000", 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.458562+0000", 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.458563+0000", 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8199999999999999e-07 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.458661+0000", 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7879000000000003e-05 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.458675+0000", 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4551e-05 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.458685+0000", 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.025e-05 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.461487+0000", 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028018750000000001 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.461628+0000", 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014084699999999999 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.461781+0000", 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015274200000000001 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.463625+0000", 2023-10-08T06:58:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018440049999999999 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.474314+0000", 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010689099000000001 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.474375+0000", 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1351000000000003e-05 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.474413+0000", 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7582e-05 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:03.861 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:03.863 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:03.863 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:03.863 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 34, 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "a28386aa-6313-4530-b2e8-fd7736a43dc5", 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "created": "2023-10-08T06:56:54.481679+0000", 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2023-10-08T06:58:02.291478+0000", 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "last_up_change": "2023-10-08T06:57:03.011095+0000", 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "last_in_change": "2023-10-08T06:56:55.385351+0000", 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_num": 5801984, 2023-10-08T06:58:03.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_set": [ 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "noscrub", 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "pglog_hardlimit", 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "purged_snapdirs", 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_deletes", 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "sortbitwise" 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_version": 4, 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "full_ratio": 0.94999998807907104, 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_snapshot": "", 2023-10-08T06:58:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_max": 5, 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd": 3, 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "require_min_compat_client": "luminous", 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min_compat_client": "luminous", 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "require_osd_release": "reef", 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_crimson": false, 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "pools": [ 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 1, 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": ".mgr", 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:04.997403+0000", 2023-10-08T06:58:03.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:58:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 1, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 1, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 1, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 1, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 1, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:58:03.868 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "12", 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:58:03.869 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:58:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:58:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_max": 32, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 1 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.872 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": {} 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 2.9900000095367432, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 2.9900000095367432, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 2, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 2, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 0.8831939697265625, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 0.87999999523162842, 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2023-10-08T06:58:03.873 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 2, 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "rbd", 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:09.831792+0000", 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:58:03.874 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 8, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 8, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 8, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 8, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 8, 2023-10-08T06:58:03.875 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "15", 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:58:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:58:03.878 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:58:03.879 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "options": {}, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd": {} 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.5, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.5, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:58:03.880 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.5, 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.5, 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 0.8831939697265625, 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 0.87999999523162842, 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 3, 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_metadata", 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:14.549981+0000", 2023-10-08T06:58:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:58:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 32, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 32, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 32, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 32, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 32, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:58:03.883 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "18", 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:58:03.884 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:58:03.885 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_bias": 4, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 16, 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_priority": 5 2023-10-08T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": "cephfs" 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.309999942779541, 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.309999942779541, 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.309999942779541, 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.309999942779541, 2023-10-08T06:58:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 0.8831939697265625, 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 0.87999999523162842, 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 4, 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "cephfs_data", 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:15.701169+0000", 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:58:03.889 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 64, 2023-10-08T06:58:03.890 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 64, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 64, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 64, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 64, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.891 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "19", 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:58:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:58:03.893 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:58:03.894 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "options": { 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_min": 64, 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs": { 2023-10-08T06:58:03.895 INFO:teuthology.orchestra.run.smithi037.stdout: "data": "cephfs" 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1699999570846558, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1699999570846558, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1699999570846558, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1699999570846558, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 0.8831939697265625, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 0.87999999523162842, 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2023-10-08T06:58:03.896 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 5, 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": "unique_pool_0", 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "create_time": "2023-10-08T06:57:37.183131+0000", 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags_names": "hashpspool", 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": 1, 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 2, 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": 1, 2023-10-08T06:58:03.897 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_rule": 0, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_count": 0, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_target": 0, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "object_hash": 2, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscale_mode": "off", 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": 16, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num": 16, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_placement_num_target": 16, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_target": 16, 2023-10-08T06:58:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num_pending": 16, 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "last_pg_merge_meta": { 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "source_pgid": "0.0", 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "ready_epoch": 0, 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_started": 0, 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "last_epoch_clean": 0, 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "source_version": "0'0", 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "target_version": "0'0" 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "last_change": "22", 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend": "0", 2023-10-08T06:58:03.899 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "auid": 0, 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_mode": "selfmanaged", 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_seq": 0, 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_epoch": 0, 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_snaps": [], 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps": "[]", 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_bytes": 0, 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "quota_max_objects": 0, 2023-10-08T06:58:03.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tiers": [], 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "tier_of": -1, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "read_tier": -1, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "write_tier": -1, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_mode": "none", 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_bytes": 0, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_objects": 0, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_flush_age": 0, 2023-10-08T06:58:03.901 INFO:teuthology.orchestra.run.smithi037.stdout: "cache_min_evict_age": 0, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profile": "", 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_params": { 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "none" 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_period": 0, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_count": 0, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "use_gmt_hitset": true, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min_read_recency_for_promote": 0, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min_write_recency_for_promote": 0, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T06:58:03.902 INFO:teuthology.orchestra.run.smithi037.stdout: "hit_set_search_last_n": 0, 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "grade_table": [], 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "stripe_width": 0, 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "expected_num_objects": 0, 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "fast_read": false, 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "options": {}, 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "application_metadata": { 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "rados": {} 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "read_balance": { 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "score_acting": 1.1299999952316284, 2023-10-08T06:58:03.903 INFO:teuthology.orchestra.run.smithi037.stdout: "score_stable": 1.1299999952316284, 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: "optimal_score": 1, 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity_weighted": 0.8831939697265625, 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity": 0.87999999523162842, 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: "osds": [ 2023-10-08T06:58:03.904 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06", 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 32, 2023-10-08T06:58:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6800", 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.906 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6801", 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6802", 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6803", 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6806", 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6807", 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.909 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6804", 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.163:6805", 2023-10-08T06:58:03.910 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2190327034 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.163:6801/2190327034", 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.163:6803/2190327034", 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.163:6807/2190327034", 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.163:6805/2190327034", 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "da732e65-55c2-489e-bec4-ce4124704896", 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 0.6495819091796875, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:58:03.912 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 25, 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6800", 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.913 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6801", 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6802", 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6803", 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.915 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6806", 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6807", 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6804", 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.169:6805", 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3772527464 2023-10-08T06:58:03.917 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.169:6801/3772527464", 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.169:6803/3772527464", 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.169:6807/3772527464", 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.169:6805/3772527464", 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:58:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: "uuid": "ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1", 2023-10-08T06:58:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2023-10-08T06:58:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2023-10-08T06:58:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: "weight": 1, 2023-10-08T06:58:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_affinity": 1, 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_begin": 0, 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "last_clean_end": 0, 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "up_from": 8, 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "up_thru": 32, 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "down_at": 0, 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "lost_at": 0, 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrs": { 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.920 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6800", 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6801", 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addrs": { 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.921 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6802", 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6803", 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addrs": { 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6806", 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6807", 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.923 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addrs": { 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6804", 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.183:6805", 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1488347209 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "172.21.15.183:6801/1488347209", 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "172.21.15.183:6803/1488347209", 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_back_addr": "172.21.15.183:6807/1488347209", 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_front_addr": "172.21.15.183:6805/1488347209", 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "state": [ 2023-10-08T06:58:03.925 INFO:teuthology.orchestra.run.smithi037.stdout: "exists", 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: "up" 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_xinfo": [ 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 0, 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:58:03.926 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.463792+0000", 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 1, 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:58:03.927 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.488920+0000", 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": 2, 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "down_stamp": "0.000000", 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_probability": 0, 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "laggy_interval": 0, 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "features": 4540138322906710015, 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "old_weight": 0, 2023-10-08T06:58:03.928 INFO:teuthology.orchestra.run.smithi037.stdout: "last_purged_snaps_scrub": "2023-10-08T06:57:00.516673+0000", 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: "dead_epoch": 0 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap": [ 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: "pgid": "3.a", 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: "osds": [ 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_items": [], 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_upmap_primaries": [], 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_temp": [], 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "primary_temp": [], 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklist": {}, 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "range_blocklist": {}, 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_profiles": { 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "default": { 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-failure-domain": "osd", 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "k": "2", 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "m": "1", 2023-10-08T06:58:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin": "jerasure", 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "technique": "reed_sol_van" 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "removed_snaps_queue": [], 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "new_removed_snaps": [], 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "new_purged_snaps": [], 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_node_flags": {}, 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "device_class_flags": {}, 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode": { 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_enabled": false, 2023-10-08T06:58:03.931 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_bucket_count": 0, 2023-10-08T06:58:03.932 INFO:teuthology.orchestra.run.smithi037.stdout: "degraded_stretch_mode": 0, 2023-10-08T06:58:03.932 INFO:teuthology.orchestra.run.smithi037.stdout: "recovering_stretch_mode": 0, 2023-10-08T06:58:03.932 INFO:teuthology.orchestra.run.smithi037.stdout: "stretch_mode_bucket": 0 2023-10-08T06:58:03.932 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-08T06:58:03.932 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T06:58:03.932 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:58:03.933 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:03.933 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:03.933 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:58:03.934 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:58:03.934 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:03.861+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:03.935 INFO:tasks.thrashosds.thrasher:j is {'epoch': 34, 'fsid': 'a28386aa-6313-4530-b2e8-fd7736a43dc5', 'created': '2023-10-08T06:56:54.481679+0000', 'modified': '2023-10-08T06:58:02.291478+0000', 'last_up_change': '2023-10-08T06:57:03.011095+0000', 'last_in_change': '2023-10-08T06:56:55.385351+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:57:04.997403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8831939697265625, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T06:57:09.831792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8831939697265625, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:57:14.549981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.8831939697265625, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:57:15.701169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.8831939697265625, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-10-08T06:57:37.183131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8831939697265625, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': 'a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 2190327034}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 2190327034}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 2190327034}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 2190327034}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 2190327034}]}, 'public_addr': '172.21.15.163:6801/2190327034', 'cluster_addr': '172.21.15.163:6803/2190327034', 'heartbeat_back_addr': '172.21.15.163:6807/2190327034', 'heartbeat_front_addr': '172.21.15.163:6805/2190327034', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'da732e65-55c2-489e-bec4-ce4124704896', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6495819091796875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 25, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 3772527464}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 3772527464}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 3772527464}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 3772527464}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 3772527464}]}, 'public_addr': '172.21.15.169:6801/3772527464', 'cluster_addr': '172.21.15.169:6803/3772527464', 'heartbeat_back_addr': '172.21.15.169:6807/3772527464', 'heartbeat_front_addr': '172.21.15.169:6805/3772527464', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6800', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6801', 'nonce': 1488347209}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6802', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6803', 'nonce': 1488347209}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6806', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6807', 'nonce': 1488347209}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6804', 'nonce': 1488347209}, {'type': 'v1', 'addr': '172.21.15.183:6805', 'nonce': 1488347209}]}, 'public_addr': '172.21.15.183:6801/1488347209', 'cluster_addr': '172.21.15.183:6803/1488347209', 'heartbeat_back_addr': '172.21.15.183:6807/1488347209', 'heartbeat_front_addr': '172.21.15.183:6805/1488347209', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.463792+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.488920+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T06:57:00.516673+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-10-08T06:58:03.936 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.a 2023-10-08T06:58:03.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.a 2023-10-08T06:58:03.974 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:03.973+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:04.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:04.065+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:04.123 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:04.123 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:04.140 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:58:04.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:04.165+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:04.268 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:04.265+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:04.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:58:04.335 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:04.335 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:04.346 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:58:04.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 24 16 63258 63242 164.679 133.875 0.00813834 0.00606961 2023-10-08T06:58:04.387 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:04.386+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:04.468 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:04.467+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:04.568 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:04.568+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:04.575 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:04.576 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:04.590 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:04.669 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:04.668+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:04.767 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:04.767 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:04.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:04.769+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:04.781 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:04.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:04.870+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:04.971 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:04.969+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:04.994 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:04.994 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:05.008 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:05.074 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:05.072+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:05.174 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:05.173+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:05.228 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:05.229 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:05.244 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:05.276 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:05.274+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:clear 3.a pg_upmap mapping 2023-10-08T06:58:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:58:05.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 25 16 65386 65370 163.412 133 0.00632653 0.00611637 2023-10-08T06:58:05.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:05.376+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:05.413 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:05.413 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:05.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:05.477 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:05.476+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:05.578 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:05.577+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:05.592 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:05.592 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:05.606 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:05.691 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:05.690+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:05.780 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:05.779+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:05.823 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:05.823 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:05.839 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:58:05.881 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:05.880+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:05.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:05.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:05.982+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:06.029 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:06.029 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:06.046 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:58:06.083 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:06.083+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:06.092 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:06.112 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:06.145 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:58:06.146 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:06.146 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:06.146 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:58:06.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:06.185+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:06.233 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:58:06.233 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T06:58:06.233 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2023-10-08T06:58:06.233 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2023-10-08T06:58:06.233 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:58:06.250 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:58:06.286 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:06.285+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:06.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 26 16 67512 67496 162.237 132.875 0.00907943 0.00616088 2023-10-08T06:58:06.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:06.387+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:06.447 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:58:06.447 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:58:06.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:58:06.447 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:58:06.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14433 5.6 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.337031805999999, 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017532516000000001, 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14433 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.448 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106905+0000", 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106971+0000", 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5945000000000006e-05 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106979+0000", 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8739999999999995e-06 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106983+0000", 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3660000000000002e-06 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107023+0000", 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9634e-05 2023-10-08T06:58:06.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107137+0000", 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114747 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107229+0000", 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1775999999999997e-05 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108887+0000", 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016575100000000001 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124321+0000", 2023-10-08T06:58:06.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015434128 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124374+0000", 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2899000000000003e-05 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124437+0000", 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3016999999999997e-05 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.454 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:26900 5.3 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 18.215766188, 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017031261999999998, 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.455 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.456 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 26900 2023-10-08T06:58:06.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.456 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:58:06.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228170+0000", 2023-10-08T06:58:06.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228171+0000", 2023-10-08T06:58:06.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.37e-07 2023-10-08T06:58:06.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228232+0000", 2023-10-08T06:58:06.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1746000000000001e-05 2023-10-08T06:58:06.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228242+0000", 2023-10-08T06:58:06.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0040999999999999e-05 2023-10-08T06:58:06.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228250+0000", 2023-10-08T06:58:06.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9140000000000008e-06 2023-10-08T06:58:06.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228299+0000", 2023-10-08T06:58:06.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8273999999999999e-05 2023-10-08T06:58:06.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228429+0000", 2023-10-08T06:58:06.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129956 2023-10-08T06:58:06.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.228557+0000", 2023-10-08T06:58:06.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012801199999999999 2023-10-08T06:58:06.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.232147+0000", 2023-10-08T06:58:06.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035903879999999999 2023-10-08T06:58:06.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245130+0000", 2023-10-08T06:58:06.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012982570000000001 2023-10-08T06:58:06.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245177+0000", 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7830000000000001e-05 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.245201+0000", 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3794e-05 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28697 5.a 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.573464042000001, 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.029866567, 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28697 2023-10-08T06:58:06.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870473+0000", 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3200000000000005e-07 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870533+0000", 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9941000000000001e-05 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870549+0000", 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6688e-05 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870555+0000", 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9059999999999999e-06 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870617+0000", 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1309999999999994e-05 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870732+0000", 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115198 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870813+0000", 2023-10-08T06:58:06.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1542e-05 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.874939+0000", 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041253219999999998 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900278+0000", 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025339897 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900315+0000", 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6229999999999997e-05 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900339+0000", 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3901e-05 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.472 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28699 5.a 5:5b28870b:::benchmark_data_smithi037_101035_object28698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.570540393000002, 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.027162454999999999, 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.473 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28699 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.06e-07 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873473+0000", 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6679000000000002e-05 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873487+0000", 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3597999999999999e-05 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873491+0000", 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.916e-06 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873529+0000", 2023-10-08T06:58:06.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7598000000000002e-05 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873626+0000", 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7367000000000005e-05 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873729+0000", 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010220799999999999 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880045+0000", 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063162089999999997 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900391+0000", 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020346212999999998 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900514+0000", 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012279700000000001 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900558+0000", 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4264000000000002e-05 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.479 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28704 5.a 5:576041a3:::benchmark_data_smithi037_101035_object28703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.567664074, 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.024376907999999999, 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28704 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876273+0000", 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1099999999999995e-07 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876333+0000", 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0281000000000001e-05 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876341+0000", 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2859999999999999e-06 2023-10-08T06:58:06.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876346+0000", 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9099999999999996e-06 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876382+0000", 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6164000000000001e-05 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876493+0000", 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001111 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876609+0000", 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000116128 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880067+0000", 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003457304 2023-10-08T06:58:06.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900600+0000", 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020532749999999999 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900629+0000", 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9323e-05 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900649+0000", 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0051000000000002e-05 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30811 5.c 5:33193cdf:::benchmark_data_smithi037_101035_object30810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.784276305999999, 2023-10-08T06:58:06.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018643812999999999, 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30811 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:06.487 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9500000000000002e-07 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659715+0000", 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659724+0000", 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7280000000000007e-06 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659732+0000", 2023-10-08T06:58:06.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664288+0000", 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045555680000000003 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664434+0000", 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014595400000000001 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664590+0000", 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156599 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666251+0000", 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016600549999999999 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678240+0000", 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011989145999999999 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678278+0000", 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8389000000000001e-05 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678304+0000", 2023-10-08T06:58:06.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5531e-05 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38563 5.6 5:693ba6d4:::benchmark_data_smithi037_101035_object38562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.698060073000001, 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019052401, 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.493 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38563 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.494 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745877+0000", 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.99e-07 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745909+0000", 2023-10-08T06:58:06.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2098999999999999e-05 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745917+0000", 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9559999999999997e-06 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745922+0000", 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7749999999999998e-06 2023-10-08T06:58:06.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757816+0000", 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011893733 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757935+0000", 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011882799999999999 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758060+0000", 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000125217 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761820+0000", 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003759872 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764861+0000", 2023-10-08T06:58:06.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030408420000000002 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764895+0000", 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4248999999999997e-05 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764928+0000", 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3231000000000001e-05 2023-10-08T06:58:06.499 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38564 5.6 5:646adcee:::benchmark_data_smithi037_101035_object38563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.697985596000001, 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021880430999999999, 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.500 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38564 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745951+0000", 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6400000000000002e-07 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746069+0000", 2023-10-08T06:58:06.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000117945 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746078+0000", 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4800000000000001e-06 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746084+0000", 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759452+0000", 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013368161 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759548+0000", 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5867999999999998e-05 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.504 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759671+0000", 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012332700000000001 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764962+0000", 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052914839999999999 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767742+0000", 2023-10-08T06:58:06.505 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027792110000000002 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767792+0000", 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0659999999999999e-05 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767831+0000", 2023-10-08T06:58:06.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.854e-05 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38569 5.6 5:6346498c:::benchmark_data_smithi037_101035_object38568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.697722001000001, 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021737508999999999, 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.507 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38569 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746215+0000", 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4499999999999997e-07 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746278+0000", 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3112000000000002e-05 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746285+0000", 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746291+0000", 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.993e-06 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761964+0000", 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015672927 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762055+0000", 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0352999999999994e-05 2023-10-08T06:58:06.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762165+0000", 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000109961 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764998+0000", 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028333960000000002 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767879+0000", 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028805129999999999 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767921+0000", 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2070999999999998e-05 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767952+0000", 2023-10-08T06:58:06.513 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0898999999999997e-05 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38571 5.6 5:66544174:::benchmark_data_smithi037_101035_object38570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 13.696284243999999, 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.026065827, 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.514 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38571 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.515 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2799999999999996e-07 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.516 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747680+0000", 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7137000000000001e-05 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747708+0000", 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8674e-05 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747715+0000", 2023-10-08T06:58:06.517 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.64e-06 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765069+0000", 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017353848000000002 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765144+0000", 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5306e-05 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.518 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765236+0000", 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2280000000000004e-05 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767868+0000", 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026313320000000001 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773659+0000", 2023-10-08T06:58:06.519 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057915329999999998 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773696+0000", 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7081e-05 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773718+0000", 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1367999999999999e-05 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.520 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:51449 5.0 e31/20 5:078c55bb:::benchmark_data_smithi037_101035_object51448:head v 31'3147, mlcod=31'3145)", 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.414682698, 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016999805999999999, 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.521 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029253+0000", 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.522 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029254+0000", 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2e-07 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029284+0000", 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0264999999999999e-05 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.523 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029293+0000", 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6689999999999995e-06 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.029300+0000", 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8379999999999996e-06 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.034256+0000", 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049568140000000004 2023-10-08T06:58:06.524 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.034279+0000", 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2858e-05 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046210+0000", 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011930329999999999 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.525 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.046253+0000", 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3612000000000002e-05 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52025 5.e 5:78ce0172:::benchmark_data_smithi037_101035_object52024:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.1541534860000002, 2023-10-08T06:58:06.526 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.017239604, 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52025 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:06.527 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3900000000000004e-07 2023-10-08T06:58:06.528 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289881+0000", 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7559000000000006e-05 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289890+0000", 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8699999999999998e-06 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.529 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289895+0000", 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5740000000000003e-06 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290751+0000", 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00085582900000000001 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.530 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290760+0000", 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7679999999999997e-06 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297332+0000", 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065719400000000001 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:06.531 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297341+0000", 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8249999999999994e-06 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.306177+0000", 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0088363520000001 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.532 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307022+0000", 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00084514799999999999 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52028 5.e 5:7ff4b5d8:::benchmark_data_smithi037_101035_object52027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.1540305390000007, 2023-10-08T06:58:06.533 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.017449322, 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52028 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:06.534 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.75e-07 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.535 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289982+0000", 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5687999999999998e-05 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289991+0000", 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5880000000000004e-06 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.536 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289998+0000", 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3090000000000001e-06 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290849+0000", 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00085124799999999998 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2023-10-08T06:58:06.537 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290856+0000", 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.097e-06 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297370+0000", 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065140500000000004 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297375+0000", 2023-10-08T06:58:06.538 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7010000000000004e-06 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307299+0000", 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.009924305 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307355+0000", 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5760999999999997e-05 2023-10-08T06:58:06.539 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52029 5.e 5:7d9a3073:::benchmark_data_smithi037_101035_object52028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.1539291630000008, 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0174442429999999, 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52029 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290008+0000", 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8199999999999999e-07 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.542 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290073+0000", 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5423e-05 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290081+0000", 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290089+0000", 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3690000000000007e-06 2023-10-08T06:58:06.543 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290881+0000", 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00079155399999999998 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290886+0000", 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.95e-06 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.544 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297405+0000", 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065193630000000002 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297417+0000", 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1499e-05 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.545 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307387+0000", 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.009970187 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307451+0000", 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4251999999999994e-05 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.546 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:67169 5.c 5:3179014e:::benchmark_data_smithi037_101035_object67168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.193816+0000", 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.25012042400000001, 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018879877, 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.547 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 67169 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193816+0000", 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193816+0000", 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.548 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193817+0000", 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.24e-06 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193852+0000", 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4999000000000002e-05 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.549 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193863+0000", 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0956e-05 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193871+0000", 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7700000000000001e-06 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.550 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193917+0000", 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6125999999999998e-05 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194046+0000", 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129212 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.551 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194193+0000", 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000146551 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.197587+0000", 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033943179999999999 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.552 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.212614+0000", 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015027624999999999 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.212670+0000", 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5210000000000002e-05 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.553 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.212696+0000", 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5870000000000001e-05 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:67165 5.8 e35/20 5:1d063b33:::benchmark_data_smithi037_101035_object67164:head v 35'4181, mlcod=35'4177)", 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.193927+0000", 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.25000868199999998, 2023-10-08T06:58:06.554 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017547917, 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193927+0000", 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.555 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193927+0000", 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193928+0000", 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0200000000000001e-07 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193959+0000", 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1146000000000003e-05 2023-10-08T06:58:06.556 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193965+0000", 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.392e-06 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193970+0000", 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4630000000000003e-06 2023-10-08T06:58:06.557 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194006+0000", 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6767999999999998e-05 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194025+0000", 2023-10-08T06:58:06.558 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8357999999999999e-05 2023-10-08T06:58:06.561 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.561 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.561 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.561 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.211420+0000", 2023-10-08T06:58:06.561 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017395687999999999 2023-10-08T06:58:06.562 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.562 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.562 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.211475+0000", 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.49e-05 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:67173 5.4 e35/20 5:27ad57f3:::benchmark_data_smithi037_101035_object67172:head v 35'4193, mlcod=35'4191)", 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.194960+0000", 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.24897562300000001, 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019794549000000002, 2023-10-08T06:58:06.563 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194960+0000", 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194960+0000", 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.564 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194961+0000", 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1800000000000001e-07 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195019+0000", 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7741000000000002e-05 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.565 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195026+0000", 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8129999999999996e-06 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195040+0000", 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4061e-05 2023-10-08T06:58:06.566 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.196165+0000", 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011244060000000001 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.196182+0000", 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6985000000000001e-05 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.567 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214716+0000", 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018534001000000001 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214755+0000", 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9124e-05 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.568 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:67178 5.2 e35/20 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head v 35'4251, mlcod=35'4249)", 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.24874615799999999, 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019075749999999999, 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.569 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8400000000000005e-07 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.570 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195248+0000", 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7980999999999999e-05 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195256+0000", 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7379999999999994e-06 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195262+0000", 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7150000000000003e-06 2023-10-08T06:58:06.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.197478+0000", 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022158410000000001 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.197497+0000", 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9309000000000001e-05 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214212+0000", 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016715509999999999 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214266+0000", 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3171999999999998e-05 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:67520 5.6 5:695b607d:::benchmark_data_smithi037_101035_object67519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.365794+0000", 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.078141941000000006, 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017829123999999998, 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.574 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 67520 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365794+0000", 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365794+0000", 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365795+0000", 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1999999999999999e-07 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365891+0000", 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6154000000000001e-05 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365899+0000", 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9549999999999992e-06 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365906+0000", 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.567e-06 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.366563+0000", 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065726100000000002 2023-10-08T06:58:06.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.366711+0000", 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014772900000000001 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.366873+0000", 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016214800000000001 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.372539+0000", 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056662550000000002 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.383540+0000", 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011001116 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.383588+0000", 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8115000000000003e-05 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.383623+0000", 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5104000000000001e-05 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.580 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:67586 5.6 5:6b041fcb:::benchmark_data_smithi037_101035_object67585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.399924+0000", 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.044011956999999997, 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018021911000000002, 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:06.581 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.582 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 67586 2023-10-08T06:58:06.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.582 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:06.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:06.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399924+0000", 2023-10-08T06:58:06.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399924+0000", 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399926+0000", 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4109999999999999e-06 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399972+0000", 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6056000000000001e-05 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399982+0000", 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0694e-05 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399989+0000", 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9650000000000002e-06 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.400037+0000", 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8026999999999999e-05 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.400197+0000", 2023-10-08T06:58:06.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015956299999999999 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.400335+0000", 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000138205 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.402717+0000", 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0023814700000000001 2023-10-08T06:58:06.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.417838+0000", 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015121005 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.417899+0000", 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1752000000000001e-05 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:06.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.417946+0000", 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6762999999999999e-05 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:06.588 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:58:06.589 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:06.588+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:06.590 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:06.690 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:06.689+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:06.774 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:06.774 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:06.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.774 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68374 5.7 5:e56fb483:::benchmark_data_smithi037_101035_object68373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:06.774 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.767103+0000", 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0068331279999999999, 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068545000000000003, 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68374 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:06.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.767103+0000", 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.767103+0000", 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.767104+0000", 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4499999999999997e-07 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.767139+0000", 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5830000000000001e-05 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:06.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.767144+0000", 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8029999999999996e-06 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.767148+0000", 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5099999999999999e-06 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.768907+0000", 2023-10-08T06:58:06.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001759112 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.769044+0000", 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013764300000000001 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.769187+0000", 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014297800000000001 2023-10-08T06:58:06.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.772782+0000", 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003594383 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68381 5.f 5:fb7c7c57:::benchmark_data_smithi037_101035_object68380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.770143+0000", 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0037927730000000002, 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038728500000000002, 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68381 2023-10-08T06:58:06.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770143+0000", 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770143+0000", 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770144+0000", 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9799999999999999e-07 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770243+0000", 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8867000000000001e-05 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770248+0000", 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.186e-06 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770251+0000", 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.596e-06 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770288+0000", 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6979e-05 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770404+0000", 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115592 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:06.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.770540+0000", 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013585999999999999 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773071+0000", 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025310860000000001 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.786 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68387 5.f 5:ff341d5e:::benchmark_data_smithi037_101035_object68386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.773184+0000", 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00075195299999999997, 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00088073199999999996, 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68387 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.787 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773184+0000", 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773184+0000", 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773185+0000", 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773345+0000", 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016001899999999999 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:06.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773356+0000", 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1256e-05 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773363+0000", 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9800000000000001e-06 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773396+0000", 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2817000000000001e-05 2023-10-08T06:58:06.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773484+0000", 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8350000000000006e-05 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773572+0000", 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7559000000000007e-05 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:06.791 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:68381 5.f e36/20)", 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.773451+0000", 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00048477699999999998, 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065461800000000004, 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773451+0000", 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773451+0000", 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773452+0000", 2023-10-08T06:58:06.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8099999999999999e-07 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773453+0000", 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2950000000000001e-06 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773456+0000", 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5300000000000001e-06 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773459+0000", 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.396e-06 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:68388 5.5 e36/20 5:a2c44843:::benchmark_data_smithi037_101035_object68387:head v 36'4245, mlcod=36'4242)", 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.773798+0000", 2023-10-08T06:58:06.795 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.000138143, 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00033656700000000002, 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773798+0000", 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773798+0000", 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773798+0000", 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7099999999999998e-07 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773879+0000", 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0556000000000006e-05 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773889+0000", 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0456e-05 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773895+0000", 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7540000000000003e-06 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773927+0000", 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1917e-05 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.773940+0000", 2023-10-08T06:58:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2743e-05 2023-10-08T06:58:06.800 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.800 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:06.800 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.800 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:06.800 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:06.800 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 5 2023-10-08T06:58:06.800 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:06.801 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:06.800+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:06.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:06.902 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:06.901+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:06.975 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:06.975 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:06.975 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:06.975 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:06.975 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:06.989 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:07.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:07.034+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:07.103 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:07.102+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:07.174 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.063485652000001, 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:58:07.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:58:07.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:26900 5.3 e27/20 5:c2a2948b:::benchmark_data_smithi037_101035_object26899:head v 27'1703, mlcod=27'1700)", 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.942156605000001, 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016375165000000001, 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228630+0000", 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6699999999999999e-07 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228688+0000", 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8009e-05 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228694+0000", 2023-10-08T06:58:07.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3690000000000003e-06 2023-10-08T06:58:07.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228705+0000", 2023-10-08T06:58:07.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0019e-05 2023-10-08T06:58:07.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228746+0000", 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1140000000000003e-05 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.228766+0000", 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0310999999999999e-05 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.244952+0000", 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016186158999999999 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.245005+0000", 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2791000000000003e-05 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.297231912000001, 2023-10-08T06:58:07.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:07.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:07.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:07.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.290397523999999, 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.195 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:07.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.202 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:38550 5.7 5:e4621c07:::benchmark_data_smithi037_101035_object38549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.430374384, 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016332946000000001, 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 38550 2023-10-08T06:58:07.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740412+0000", 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1399999999999997e-07 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740594+0000", 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018210399999999999 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740600+0000", 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7089999999999999e-06 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.740604+0000", 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7620000000000001e-06 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741601+0000", 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099723600000000009 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741738+0000", 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137219 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.741885+0000", 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014629399999999999 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.743601+0000", 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017165010000000001 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756688+0000", 2023-10-08T06:58:07.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013086591 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756723+0000", 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5126000000000002e-05 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:52.756745+0000", 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1990000000000001e-05 2023-10-08T06:58:07.209 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:50899 5.f 5:f78f4ca7:::benchmark_data_smithi037_101035_object50898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.384594001, 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016993019000000002, 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.210 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 50899 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786193+0000", 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4799999999999998e-07 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786222+0000", 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9499e-05 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786232+0000", 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8830000000000001e-06 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786238+0000", 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1680000000000001e-06 2023-10-08T06:58:07.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789392+0000", 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031532930000000002 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789506+0000", 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114697 2023-10-08T06:58:07.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789630+0000", 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012329100000000001 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.794834+0000", 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052047309999999998 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803096+0000", 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082619519999999995 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803149+0000", 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.304e-05 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803185+0000", 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5917000000000002e-05 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57879 5.1 5:8c6a3c53:::benchmark_data_smithi037_101035_object57878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.879739+0000", 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.2910468999999996, 2023-10-08T06:58:07.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015964373, 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57879 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879739+0000", 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879739+0000", 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879740+0000", 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7100000000000001e-07 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879770+0000", 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0017000000000001e-05 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879781+0000", 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0479000000000001e-05 2023-10-08T06:58:07.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879788+0000", 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0430000000000002e-06 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879840+0000", 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2175000000000001e-05 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.879966+0000", 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012602199999999999 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.880102+0000", 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013643699999999999 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.885948+0000", 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058456439999999997 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.895651+0000", 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097032790000000004 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.895683+0000", 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2029000000000001e-05 2023-10-08T06:58:07.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.895704+0000", 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0477000000000001e-05 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57920 5.2 5:4b015bf8:::benchmark_data_smithi037_101035_object57919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:07.224 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.2709818730000002, 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017795800000000001, 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57920 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899805+0000", 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900121+0000", 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031621900000000002 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900127+0000", 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2859999999999996e-06 2023-10-08T06:58:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900131+0000", 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4369999999999999e-06 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906312+0000", 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061814790000000001 2023-10-08T06:58:07.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906420+0000", 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010733700000000001 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906504+0000", 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4794000000000002e-05 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.909717+0000", 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032127689999999999 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917514+0000", 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077965819999999998 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917559+0000", 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5618999999999998e-05 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917600+0000", 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0908999999999997e-05 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.231 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57922 5.2 5:47786b04:::benchmark_data_smithi037_101035_object57921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.2706505019999996, 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017617088999999999, 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57922 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9700000000000003e-07 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900176+0000", 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0093999999999999e-05 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900185+0000", 2023-10-08T06:58:07.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.918e-06 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900189+0000", 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1810000000000003e-06 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.907989+0000", 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078000559999999997 2023-10-08T06:58:07.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908154+0000", 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016444300000000001 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908326+0000", 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017191999999999999 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.911360+0000", 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003033956 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917653+0000", 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062937280000000002 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917719+0000", 2023-10-08T06:58:07.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5865999999999996e-05 2023-10-08T06:58:07.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917753+0000", 2023-10-08T06:58:07.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3630000000000002e-05 2023-10-08T06:58:07.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.239 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.239 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58515 5.7 5:e5bd311c:::benchmark_data_smithi037_101035_object58514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:07.240 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:07.240 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.99919095, 2023-10-08T06:58:07.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019075253, 2023-10-08T06:58:07.240 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.240 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.240 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.240 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58515 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:07.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:07.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171596+0000", 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171630+0000", 2023-10-08T06:58:07.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4464000000000001e-05 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171637+0000", 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171641+0000", 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6030000000000001e-06 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177693+0000", 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060519090000000003 2023-10-08T06:58:07.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177783+0000", 2023-10-08T06:58:07.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0705000000000007e-05 2023-10-08T06:58:07.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177924+0000", 2023-10-08T06:58:07.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140815 2023-10-08T06:58:07.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181053+0000", 2023-10-08T06:58:07.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003129204 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190584+0000", 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095309550000000007 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190633+0000", 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8715999999999999e-05 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190671+0000", 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.250 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58528 5.f 5:fc8a38c2:::benchmark_data_smithi037_101035_object58527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:07.250 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:07.250 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9929597130000003, 2023-10-08T06:58:07.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016426361, 2023-10-08T06:58:07.250 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.250 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.251 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.251 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.251 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.251 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58528 2023-10-08T06:58:07.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.251 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:07.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9500000000000001e-07 2023-10-08T06:58:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177933+0000", 2023-10-08T06:58:07.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000106019 2023-10-08T06:58:07.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177959+0000", 2023-10-08T06:58:07.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5918000000000002e-05 2023-10-08T06:58:07.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177975+0000", 2023-10-08T06:58:07.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5333e-05 2023-10-08T06:58:07.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181064+0000", 2023-10-08T06:58:07.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030889899999999998 2023-10-08T06:58:07.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181233+0000", 2023-10-08T06:58:07.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016972999999999999 2023-10-08T06:58:07.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:07.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181383+0000", 2023-10-08T06:58:07.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014949200000000001 2023-10-08T06:58:07.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184425+0000", 2023-10-08T06:58:07.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030423490000000002 2023-10-08T06:58:07.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194169+0000", 2023-10-08T06:58:07.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097436050000000007 2023-10-08T06:58:07.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194217+0000", 2023-10-08T06:58:07.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7927999999999999e-05 2023-10-08T06:58:07.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194253+0000", 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6202000000000003e-05 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58529 5.7 5:ea04c6bf:::benchmark_data_smithi037_101035_object58528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:07.263 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9927994169999996, 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016172057, 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58529 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:07.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177987+0000", 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9500000000000003e-07 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.178023+0000", 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5942999999999998e-05 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.178031+0000", 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5769999999999996e-06 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.178037+0000", 2023-10-08T06:58:07.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.604e-06 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181074+0000", 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030378950000000001 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181168+0000", 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3387000000000006e-05 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181256+0000", 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8647999999999996e-05 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.188801+0000", 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.007544912 2023-10-08T06:58:07.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194056+0000", 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052542099999999996 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194115+0000", 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9225999999999998e-05 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194159+0000", 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4159999999999997e-05 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67174 5.7 5:e83da62e:::benchmark_data_smithi037_101035_object67173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194436+0000", 2023-10-08T06:58:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.97635002500000001, 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016321645999999999, 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67174 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194436+0000", 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194436+0000", 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194437+0000", 2023-10-08T06:58:07.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:07.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194496+0000", 2023-10-08T06:58:07.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9539e-05 2023-10-08T06:58:07.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194502+0000", 2023-10-08T06:58:07.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7250000000000002e-06 2023-10-08T06:58:07.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194506+0000", 2023-10-08T06:58:07.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8550000000000004e-06 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194551+0000", 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4747999999999999e-05 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194665+0000", 2023-10-08T06:58:07.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011411199999999999 2023-10-08T06:58:07.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194882+0000", 2023-10-08T06:58:07.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00021744599999999999 2023-10-08T06:58:07.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197639+0000", 2023-10-08T06:58:07.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027569109999999999 2023-10-08T06:58:07.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.210698+0000", 2023-10-08T06:58:07.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013058627 2023-10-08T06:58:07.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.210735+0000", 2023-10-08T06:58:07.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7231000000000003e-05 2023-10-08T06:58:07.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.210758+0000", 2023-10-08T06:58:07.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3082999999999999e-05 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67177 5.7 5:eceead93:::benchmark_data_smithi037_101035_object67176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.97606777, 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018827831, 2023-10-08T06:58:07.282 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.283 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.283 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67177 2023-10-08T06:58:07.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.283 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:07.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:07.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:07.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:58:07.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194808+0000", 2023-10-08T06:58:07.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8851999999999996e-05 2023-10-08T06:58:07.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194813+0000", 2023-10-08T06:58:07.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5380000000000002e-06 2023-10-08T06:58:07.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194817+0000", 2023-10-08T06:58:07.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6219999999999998e-06 2023-10-08T06:58:07.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196266+0000", 2023-10-08T06:58:07.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014492940000000001 2023-10-08T06:58:07.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196360+0000", 2023-10-08T06:58:07.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3331999999999993e-05 2023-10-08T06:58:07.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196452+0000", 2023-10-08T06:58:07.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2529999999999997e-05 2023-10-08T06:58:07.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197982+0000", 2023-10-08T06:58:07.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015301030000000001 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213446+0000", 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015463563 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213510+0000", 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3689999999999995e-05 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213546+0000", 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6828e-05 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.97595594500000005, 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:07.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:07.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:07.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67184 5.2 5:4ca6e80a:::benchmark_data_smithi037_101035_object67183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.97220096300000003, 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017158867000000001, 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67184 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.301 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198586+0000", 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8899999999999998e-07 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198642+0000", 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5687999999999999e-05 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198653+0000", 2023-10-08T06:58:07.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1345000000000001e-05 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198661+0000", 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.233e-06 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198709+0000", 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8390999999999998e-05 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198786+0000", 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6852000000000002e-05 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198891+0000", 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105643 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.200969+0000", 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020771600000000002 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215641+0000", 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014672304000000001 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215709+0000", 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8456999999999999e-05 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215744+0000", 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4904999999999999e-05 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.307 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67436 5.7 5:e2f7cac5:::benchmark_data_smithi037_101035_object67435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.84388917600000002, 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017493584, 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67436 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326898+0000", 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.569999999999999e-07 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326935+0000", 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7011999999999997e-05 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326946+0000", 2023-10-08T06:58:07.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0446e-05 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326953+0000", 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3100000000000003e-06 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330129+0000", 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003176183 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330249+0000", 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119702 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330391+0000", 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014252399999999999 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.336180+0000", 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057887770000000002 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344304+0000", 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081237419999999998 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344349+0000", 2023-10-08T06:58:07.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4866e-05 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344391+0000", 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2064999999999998e-05 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.314 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68298 5.9 5:920090b0:::benchmark_data_smithi037_101035_object68297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.44468158800000002, 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017738614, 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68298 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726106+0000", 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0279999999999999e-06 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726184+0000", 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8300000000000006e-05 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726196+0000", 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.201e-05 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726203+0000", 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1029999999999996e-06 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726266+0000", 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2346000000000002e-05 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726431+0000", 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016508899999999999 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:07.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726617+0000", 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018605299999999999 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733386+0000", 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067696600000000003 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743760+0000", 2023-10-08T06:58:07.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010373339000000001 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743814+0000", 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4151999999999999e-05 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743843+0000", 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9533999999999999e-05 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.321 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68301 5.9 5:9ecd52b1:::benchmark_data_smithi037_101035_object68300:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.727528+0000", 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.44325830599999999, 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016369334999999999, 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.322 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68301 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.727528+0000", 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.727528+0000", 2023-10-08T06:58:07.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.727529+0000", 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2999999999999999e-07 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.727638+0000", 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000108773 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.727648+0000", 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0699e-05 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.727656+0000", 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4420000000000001e-06 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.728815+0000", 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011587259999999999 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.728899+0000", 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4164000000000003e-05 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729026+0000", 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012772099999999999 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743745+0000", 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014718159 2023-10-08T06:58:07.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743850+0000", 2023-10-08T06:58:07.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105466 2023-10-08T06:58:07.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743879+0000", 2023-10-08T06:58:07.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9261999999999999e-05 2023-10-08T06:58:07.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743897+0000", 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8093000000000001e-05 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68304 5.1 5:836c7fad:::benchmark_data_smithi037_101035_object68303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.441189526, 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016799999999999999, 2023-10-08T06:58:07.331 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68304 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729628+0000", 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0830000000000001e-05 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729642+0000", 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3570999999999999e-05 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729649+0000", 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4309999999999997e-06 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731268+0000", 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001619241 2023-10-08T06:58:07.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731382+0000", 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113522 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731534+0000", 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015160099999999999 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733712+0000", 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021787970000000001 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746333+0000", 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012620350000000001 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746375+0000", 2023-10-08T06:58:07.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2151999999999999e-05 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746397+0000", 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1943999999999999e-05 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:07.338 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:07.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:58:07.341 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:07.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:07.339+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:07.363 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 27 16 69658 69642 161.195 134.125 0.00339562 0.00620081 2023-10-08T06:58:07.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:07.441+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:07.513 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:69965 5.a e36/20 5:5ef5a9b6:::benchmark_data_smithi037_101035_object69964:head v 36'4332, mlcod=36'4330)", 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.504971+0000", 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.007522132, 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0075481719999999997, 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.504971+0000", 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.504971+0000", 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.504972+0000", 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9400000000000005e-07 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.505012+0000", 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0077999999999998e-05 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.505040+0000", 2023-10-08T06:58:07.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8690000000000001e-05 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.505047+0000", 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7610000000000002e-06 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.505104+0000", 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6514000000000001e-05 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.505133+0000", 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9890999999999999e-05 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69966 5.8 5:14b3501e:::benchmark_data_smithi037_101035_object69965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506350+0000", 2023-10-08T06:58:07.518 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0061432980000000002, 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062417999999999996, 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69966 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506350+0000", 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506350+0000", 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506351+0000", 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8100000000000001e-07 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506400+0000", 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8869000000000003e-05 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506410+0000", 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0681e-05 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506417+0000", 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4910000000000002e-06 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506473+0000", 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6094000000000002e-05 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506580+0000", 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010666300000000001 2023-10-08T06:58:07.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506684+0000", 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104214 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510799+0000", 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041150309999999999 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.523 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69967 5.4 5:21c6b4f2:::benchmark_data_smithi037_101035_object69966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506450+0000", 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0060435480000000001, 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062351050000000003, 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.524 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69967 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506450+0000", 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506450+0000", 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506450+0000", 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5999999999999999e-07 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506521+0000", 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0875000000000002e-05 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506528+0000", 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4499999999999998e-06 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506534+0000", 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6160000000000001e-06 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506583+0000", 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8593e-05 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506705+0000", 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012212799999999999 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506850+0000", 2023-10-08T06:58:07.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014577599999999999 2023-10-08T06:58:07.529 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.529 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.529 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.529 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69968 5.4 5:25acbad3:::benchmark_data_smithi037_101035_object69967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506548+0000", 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0059448599999999997, 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062243569999999998, 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.530 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69968 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506548+0000", 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506548+0000", 2023-10-08T06:58:07.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506549+0000", 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.58e-07 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506573+0000", 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4023999999999999e-05 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506578+0000", 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8209999999999998e-06 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506583+0000", 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5290000000000002e-06 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510784+0000", 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042014940000000001 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510922+0000", 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013720900000000001 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.511073+0000", 2023-10-08T06:58:07.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000150884 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69970 5.0 5:0f050db8:::benchmark_data_smithi037_101035_object69969:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506635+0000", 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0058583690000000004, 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061942819999999997, 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:07.535 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69970 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506635+0000", 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506635+0000", 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506635+0000", 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6499999999999999e-07 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506680+0000", 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4891000000000001e-05 2023-10-08T06:58:07.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506687+0000", 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4609999999999996e-06 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506691+0000", 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1760000000000003e-06 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506728+0000", 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7602999999999999e-05 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506888+0000", 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159689 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507026+0000", 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013757600000000001 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510948+0000", 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039227940000000003 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.540 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69971 5.0 5:0b034e3b:::benchmark_data_smithi037_101035_object69970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506756+0000", 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0057372980000000001, 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006119551, 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69971 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506756+0000", 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506756+0000", 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506756+0000", 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1399999999999997e-07 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506822+0000", 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5217999999999998e-05 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506832+0000", 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9410000000000002e-06 2023-10-08T06:58:07.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506839+0000", 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2579999999999998e-06 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510978+0000", 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004138798 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.511097+0000", 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119698 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.511242+0000", 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144635 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.545 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69972 5.0 5.d5322b60 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.005639359, 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060699949999999999, 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69972 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.546 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.75e-07 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506965+0000", 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110828 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506973+0000", 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7600000000000002e-06 2023-10-08T06:58:07.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506979+0000", 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7780000000000004e-06 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:69969 5.e e36/32 5:7c584df9:::benchmark_data_smithi037_101035_object69968:head v 36'4456, mlcod=36'4453)", 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.507006+0000", 2023-10-08T06:58:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0054869180000000004, 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059610280000000002, 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507006+0000", 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507006+0000", 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507007+0000", 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6899999999999997e-07 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507072+0000", 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5366999999999999e-05 2023-10-08T06:58:07.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507080+0000", 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9500000000000001e-06 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507087+0000", 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6239999999999996e-06 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507144+0000", 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7222999999999997e-05 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507162+0000", 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7784000000000001e-05 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:69973 5.9 e36/20 5:911079c3:::benchmark_data_smithi037_101035_object69972:head v 36'4340, mlcod=36'4338)", 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.507354+0000", 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0051390460000000004, 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056465359999999997, 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507354+0000", 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507354+0000", 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507355+0000", 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1200000000000003e-07 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507416+0000", 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1184000000000002e-05 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507427+0000", 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1269e-05 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507433+0000", 2023-10-08T06:58:07.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1360000000000002e-06 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507484+0000", 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0664000000000001e-05 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.507508+0000", 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4110000000000001e-05 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69974 5.8 5.582f4958 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.508143+0000", 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0043499649999999999, 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048903879999999999, 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69974 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.508143+0000", 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.508143+0000", 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.508144+0000", 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.61e-07 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.508172+0000", 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8574000000000001e-05 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.508185+0000", 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2628e-05 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.508192+0000", 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9009999999999997e-06 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:69976 5.e e36/32 5:71b3deaa:::benchmark_data_smithi037_101035_object69975:head v 36'4457, mlcod=36'4453)", 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.509353+0000", 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0031396520000000002, 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037108240000000002, 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.509353+0000", 2023-10-08T06:58:07.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.509353+0000", 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.509354+0000", 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.13e-07 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.509454+0000", 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100401 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.509464+0000", 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4290000000000007e-06 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.509470+0000", 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5390000000000004e-06 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.511146+0000", 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001675338 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.511163+0000", 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6892e-05 2023-10-08T06:58:07.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:69977 5.a e36/20 5:518c5629:::benchmark_data_smithi037_101035_object69976:head v 36'4333, mlcod=36'4330)", 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.510083+0000", 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0024099529999999998, 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030146270000000002, 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510083+0000", 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510083+0000", 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510084+0000", 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6100000000000001e-07 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510114+0000", 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0454999999999999e-05 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510128+0000", 2023-10-08T06:58:07.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.402e-05 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510133+0000", 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.51e-06 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510184+0000", 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1727999999999997e-05 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510232+0000", 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8109999999999998e-05 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:69978 5.f e36/20 5:f76f3ba9:::benchmark_data_smithi037_101035_object69977:head v 36'4482, mlcod=36'4480)", 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.510204+0000", 2023-10-08T06:58:07.570 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0022887200000000002, 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029330519999999998, 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510204+0000", 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510204+0000", 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510205+0000", 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8999999999999998e-07 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510258+0000", 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3600000000000002e-05 2023-10-08T06:58:07.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510265+0000", 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2700000000000001e-06 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510270+0000", 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8000000000000004e-06 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510310+0000", 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9988999999999999e-05 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510325+0000", 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4457000000000001e-05 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(client.4555.0:69967 5.4 e36/20)", 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.510318+0000", 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021752049999999999, 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028506949999999999, 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510318+0000", 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510318+0000", 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510318+0000", 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5200000000000001e-07 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510319+0000", 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.189e-06 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510324+0000", 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7890000000000002e-06 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.510327+0000", 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0319999999999999e-06 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:69980 5.f e36/20)", 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.512658+0000", 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.999835, 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00053647700000000005, 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.578 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.512658+0000", 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.512658+0000", 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.512659+0000", 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7499999999999999e-07 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.512689+0000", 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0173999999999999e-05 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.512700+0000", 2023-10-08T06:58:07.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0519999999999999e-05 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.512707+0000", 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7600000000000002e-06 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 15 2023-10-08T06:58:07.581 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:07.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:07.583 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:07.581+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:07.683 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:07.683+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:07.754 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:07.754 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:07.754 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:07.754 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:07.754 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:07.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:07.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:07.785+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:07.886 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:07.885+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:07.980 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.112579684, 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.110144928, 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:58:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:58:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.109871465000001, 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.109731694000001, 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:58:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:58:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.109644839000001, 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:58:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.109583931, 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:58:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:58:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.109474732999999, 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:58:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:58:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.106879175, 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.104302427, 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:58:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51442 5.8 5:128c17d7:::benchmark_data_smithi037_101035_object51441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9526533520000005, 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018100852000000001, 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51442 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025179+0000", 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4416999999999999e-05 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025186+0000", 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.452e-06 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025193+0000", 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.674e-06 2023-10-08T06:58:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027741+0000", 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025483200000000002 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027823+0000", 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1264e-05 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027908+0000", 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5137999999999997e-05 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030945+0000", 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030372659999999998 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043185+0000", 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01224039 2023-10-08T06:58:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043222+0000", 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043245+0000", 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2138999999999999e-05 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51448 5.8 5:12d8ea5b:::benchmark_data_smithi037_101035_object51447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9513047819999993, 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018610680000000001, 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51448 2023-10-08T06:58:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026493+0000", 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2500000000000004e-07 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026551+0000", 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7887999999999999e-05 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026568+0000", 2023-10-08T06:58:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886000000000001e-05 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026577+0000", 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6339999999999996e-06 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028861+0000", 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022836639999999999 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028971+0000", 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001094 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029055+0000", 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4484e-05 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032150+0000", 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030947420000000002 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045032+0000", 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012882482000000001 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045068+0000", 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5799000000000001e-05 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045103+0000", 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4876000000000003e-05 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51449 5.0 5:078c55bb:::benchmark_data_smithi037_101035_object51448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9512041030000002, 2023-10-08T06:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019798169000000001, 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51449 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2800000000000002e-07 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026615+0000", 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1171000000000001e-05 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026620+0000", 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6389999999999997e-06 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026624+0000", 2023-10-08T06:58:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7500000000000001e-06 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028853+0000", 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002228701 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028993+0000", 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140741 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029106+0000", 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011309100000000001 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.031364+0000", 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022572999999999998 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046335+0000", 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014971572000000001 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046369+0000", 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3778000000000001e-05 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046391+0000", 2023-10-08T06:58:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1997999999999998e-05 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51451 5.8 5:1f80398c:::benchmark_data_smithi037_101035_object51450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9486566710000002, 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017441129999999999, 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51451 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029141+0000", 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.78e-07 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029229+0000", 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7996000000000002e-05 2023-10-08T06:58:08.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029241+0000", 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2111e-05 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029250+0000", 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7819999999999999e-06 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029939+0000", 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00068897900000000005 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030024+0000", 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4802999999999994e-05 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030108+0000", 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4419000000000006e-05 2023-10-08T06:58:08.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032167+0000", 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020585299999999998 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046534+0000", 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014367322 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046563+0000", 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9286999999999999e-05 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046581+0000", 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8023e-05 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60821 5.0 5:09632156:::benchmark_data_smithi037_101035_object60820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.7512483259999998, 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017726374, 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60821 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226550+0000", 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0200000000000001e-07 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226617+0000", 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7148000000000002e-05 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226627+0000", 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0030000000000001e-05 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226635+0000", 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8679999999999999e-06 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234547+0000", 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079128459999999994 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234636+0000", 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8665999999999994e-05 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234726+0000", 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0251e-05 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.238072+0000", 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033451829999999998 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244212+0000", 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006140899 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244247+0000", 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4879000000000003e-05 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244275+0000", 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7801999999999999e-05 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67165 5.8 5:1d063b33:::benchmark_data_smithi037_101035_object67164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.7886319589999999, 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022537402000000002, 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.073 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67165 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189166+0000", 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2999999999999999e-07 2023-10-08T06:58:08.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189258+0000", 2023-10-08T06:58:08.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2398999999999994e-05 2023-10-08T06:58:08.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189268+0000", 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3300000000000005e-06 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189275+0000", 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.192938+0000", 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036629380000000001 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193029+0000", 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0659000000000001e-05 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193113+0000", 2023-10-08T06:58:08.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4258999999999994e-05 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.196727+0000", 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036139280000000002 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211643+0000", 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014915464999999999 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211678+0000", 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5250999999999998e-05 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211702+0000", 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4559999999999999e-05 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67171 5.0 5:05189d13:::benchmark_data_smithi037_101035_object67170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.7833657700000001, 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017609287000000001, 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67171 2023-10-08T06:58:08.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194432+0000", 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194537+0000", 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104639 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194547+0000", 2023-10-08T06:58:08.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0679000000000001e-05 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194555+0000", 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9929999999999995e-06 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194604+0000", 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8519000000000001e-05 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194738+0000", 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013386800000000001 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194881+0000", 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014271600000000001 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.197760+0000", 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028799289999999998 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211976+0000", 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014216042999999999 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.212008+0000", 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1637999999999998e-05 2023-10-08T06:58:08.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.212041+0000", 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2443000000000001e-05 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67173 5.4 5:27ad57f3:::benchmark_data_smithi037_101035_object67172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:08.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.7832272979999999, 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020388758, 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67173 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:08.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0900000000000001e-07 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194639+0000", 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8362999999999996e-05 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194646+0000", 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194650+0000", 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9689999999999996e-06 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194681+0000", 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331999999999997e-05 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194756+0000", 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5181999999999999e-05 2023-10-08T06:58:08.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194838+0000", 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.196934+0000", 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020954039999999999 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214859+0000", 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017924944000000002 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214918+0000", 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9036000000000002e-05 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214958+0000", 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0771e-05 2023-10-08T06:58:08.094 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67186 5.4 5:27f4af17:::benchmark_data_smithi037_101035_object67185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.7775501739999999, 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017355939000000001, 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67186 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200248+0000", 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200336+0000", 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8630999999999999e-05 2023-10-08T06:58:08.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200346+0000", 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0076e-05 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200355+0000", 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7839999999999992e-06 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202037+0000", 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016818169999999999 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202178+0000", 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014072100000000001 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202346+0000", 2023-10-08T06:58:08.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016863300000000001 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.204741+0000", 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023946530000000001 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217534+0000", 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012793176999999999 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217577+0000", 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2577999999999998e-05 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217603+0000", 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6168000000000001e-05 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67187 5.4 5:240998d0:::benchmark_data_smithi037_101035_object67186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.200512+0000", 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.777285089, 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017239129999999998, 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67187 2023-10-08T06:58:08.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200512+0000", 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200512+0000", 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200513+0000", 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.540000000000001e-07 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200595+0000", 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1809000000000002e-05 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200603+0000", 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7499999999999992e-06 2023-10-08T06:58:08.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200610+0000", 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7750000000000004e-06 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.203484+0000", 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028737039999999999 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.203590+0000", 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105919 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.203679+0000", 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9061000000000007e-05 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.205070+0000", 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013911990000000001 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217651+0000", 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012581292000000001 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217714+0000", 2023-10-08T06:58:08.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2538000000000003e-05 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217751+0000", 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7129000000000003e-05 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69972 5.0 5:06d44cab:::benchmark_data_smithi037_101035_object69971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.47094330600000001, 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0179822, 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69972 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.109 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.75e-07 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506965+0000", 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110828 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506973+0000", 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7600000000000002e-06 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506979+0000", 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7780000000000004e-06 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:08.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514316+0000", 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073367570000000002 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514417+0000", 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101179 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514748+0000", 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000331694 2023-10-08T06:58:08.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.520281+0000", 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055330290000000001 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524775+0000", 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044937609999999998 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524813+0000", 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7645999999999998e-05 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524836+0000", 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3093000000000001e-05 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:08.115 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:08.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:08.116+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:08.117 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:58:08.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:08.217 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:08.217+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:08.308 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:71673 5.4 e36/20 5:2e31312f:::benchmark_data_smithi037_101035_object71672:head v 36'4457, mlcod=36'4452)", 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.304108+0000", 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.003047887, 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030702120000000001, 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.309 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304108+0000", 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304108+0000", 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.310 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304109+0000", 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0499999999999999e-07 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304134+0000", 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5389999999999999e-05 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.311 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304140+0000", 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.139e-06 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304146+0000", 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6550000000000001e-06 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304184+0000", 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8439000000000002e-05 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304201+0000", 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7098000000000001e-05 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.313 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71676 5.e 5:7efbdaf0:::benchmark_data_smithi037_101035_object71675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.304193+0000", 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.002963448, 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003055898, 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71676 2023-10-08T06:58:08.314 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304193+0000", 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304193+0000", 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.315 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304193+0000", 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7300000000000005e-07 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304228+0000", 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4385999999999999e-05 2023-10-08T06:58:08.316 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304235+0000", 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8630000000000002e-06 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304239+0000", 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4819999999999996e-06 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306104+0000", 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0018652009999999999 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306218+0000", 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011317899999999999 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306358+0000", 2023-10-08T06:58:08.318 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014072100000000001 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:71677 5.0 e36/20 5:0ce22205:::benchmark_data_smithi037_101035_object71676:head v 36'4356, mlcod=36'4353)", 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.305093+0000", 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.002063133, 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022288389999999998, 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:08.319 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305093+0000", 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305093+0000", 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305093+0000", 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305153+0000", 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9534000000000003e-05 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305161+0000", 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1780000000000003e-06 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305166+0000", 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8500000000000002e-06 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306289+0000", 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011230140000000001 2023-10-08T06:58:08.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306307+0000", 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7533999999999998e-05 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71679 5.5 5:a078000d:::benchmark_data_smithi037_101035_object71678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.305385+0000", 2023-10-08T06:58:08.323 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0017708629999999999, 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019987329999999999, 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71679 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.324 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305385+0000", 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305385+0000", 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305386+0000", 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4499999999999996e-07 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305458+0000", 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2292999999999994e-05 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305467+0000", 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6740000000000003e-06 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305476+0000", 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2790000000000004e-06 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305527+0000", 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0704000000000001e-05 2023-10-08T06:58:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305659+0000", 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013207 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305827+0000", 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016754899999999999 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.328 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:71680 5.1 e36/20 5:87712092:::benchmark_data_smithi037_101035_object71679:head v 36'4435, mlcod=36'4433)", 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.305867+0000", 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.001289426, 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015980829999999999, 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305867+0000", 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305867+0000", 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305867+0000", 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3399999999999999e-07 2023-10-08T06:58:08.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305947+0000", 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0135000000000004e-05 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305958+0000", 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0074e-05 2023-10-08T06:58:08.331 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.305964+0000", 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9280000000000004e-06 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306010+0000", 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5850999999999999e-05 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306036+0000", 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5525999999999999e-05 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(client.4555.0:71664 5.e e36/32)", 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.306453+0000", 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00070265900000000001, 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001065463, 2023-10-08T06:58:08.333 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306453+0000", 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306453+0000", 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306454+0000", 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.13e-07 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306459+0000", 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5090000000000004e-06 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306467+0000", 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5150000000000006e-06 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306473+0000", 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2820000000000002e-06 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.336 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(client.4555.0:71667 5.e e36/32)", 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.306489+0000", 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00066699800000000003, 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010730519999999999, 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306489+0000", 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.337 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306489+0000", 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306489+0000", 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.28e-07 2023-10-08T06:58:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306492+0000", 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.154e-06 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306498+0000", 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2280000000000003e-06 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.339 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306502+0000", 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2010000000000001e-06 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop_reply(client.4555.0:71671 5.6 e36/20)", 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.306569+0000", 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00058755099999999996, 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010368319999999999, 2023-10-08T06:58:08.340 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306569+0000", 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306569+0000", 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306569+0000", 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1799999999999995e-07 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.346 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.346 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306573+0000", 2023-10-08T06:58:08.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.924e-06 2023-10-08T06:58:08.346 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.346 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.346 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306582+0000", 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9339999999999995e-06 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306588+0000", 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3419999999999996e-06 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.347 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:71678 5.0 e36/20)", 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.306961+0000", 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.00019521100000000001, 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000690732, 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306961+0000", 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306961+0000", 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.306962+0000", 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8299999999999996e-07 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307022+0000", 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9947000000000001e-05 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307034+0000", 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2319e-05 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307041+0000", 2023-10-08T06:58:08.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.827e-06 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:71681 5.8 e36/20)", 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.307059+0000", 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7183999999999997e-05, 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00063564700000000003, 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:08.351 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307059+0000", 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307059+0000", 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307059+0000", 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2199999999999999e-07 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307109+0000", 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9236000000000001e-05 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307118+0000", 2023-10-08T06:58:08.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0299999999999999e-06 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307122+0000", 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2599999999999999e-06 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.354 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71664 5.e 5:7b3013e1:::benchmark_data_smithi037_101035_object71663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.298146+0000", 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0090101499999999998, 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0096014110000000007, 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71664 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298146+0000", 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298146+0000", 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298147+0000", 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1349999999999999e-06 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298211+0000", 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3485999999999995e-05 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298223+0000", 2023-10-08T06:58:08.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2476999999999999e-05 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298232+0000", 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7190000000000007e-06 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298292+0000", 2023-10-08T06:58:08.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0569000000000002e-05 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298419+0000", 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012631099999999999 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.298562+0000", 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000143444 2023-10-08T06:58:08.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303962+0000", 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005399694 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71667 5.e 5:70ad2005:::benchmark_data_smithi037_101035_object71666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.360 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.300123+0000", 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0070329249999999998, 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077200610000000003, 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71667 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300123+0000", 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300123+0000", 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300124+0000", 2023-10-08T06:58:08.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9800000000000003e-07 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300220+0000", 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6507000000000003e-05 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300230+0000", 2023-10-08T06:58:08.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3160000000000003e-06 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300237+0000", 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0049999999999998e-06 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300458+0000", 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00022113100000000001 2023-10-08T06:58:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300592+0000", 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000134461 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300751+0000", 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015876099999999999 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303968+0000", 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003216932 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71669 5.a 5:54f19336:::benchmark_data_smithi037_101035_object71668:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.366 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.300710+0000", 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0064465249999999998, 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071845980000000004, 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71669 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300710+0000", 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300710+0000", 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300710+0000", 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3200000000000004e-07 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300788+0000", 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7824000000000006e-05 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300797+0000", 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1519999999999998e-06 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.300803+0000", 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7749999999999998e-06 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302218+0000", 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014149970000000001 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302346+0000", 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012749199999999999 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302515+0000", 2023-10-08T06:58:08.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016965700000000001 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.307607+0000", 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050920569999999997 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.372 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71671 5.6 5:6b497a97:::benchmark_data_smithi037_101035_object71670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.302598+0000", 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0045578939999999998, 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005351756, 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71671 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.373 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302598+0000", 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302598+0000", 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302599+0000", 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2600000000000001e-07 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302687+0000", 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8157000000000003e-05 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302701+0000", 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4234e-05 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.302709+0000", 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7160000000000003e-06 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303967+0000", 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012578419999999999 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304102+0000", 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135377 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:08.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304254+0000", 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015197600000000001 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71674 5.e 5:71a01a1b:::benchmark_data_smithi037_101035_object71673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.303942+0000", 2023-10-08T06:58:08.378 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.003213647, 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040519509999999998, 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71674 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303942+0000", 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303942+0000", 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303943+0000", 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4199999999999995e-07 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303974+0000", 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1177999999999999e-05 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303984+0000", 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5440000000000004e-06 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.303991+0000", 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1890000000000001e-06 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304041+0000", 2023-10-08T06:58:08.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9449e-05 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304162+0000", 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012102100000000001 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304303+0000", 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014095000000000001 2023-10-08T06:58:08.383 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:71670 5.0 e36/20 5:0def6cdd:::benchmark_data_smithi037_101035_object71669:head v 36'4355, mlcod=36'4353)", 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.304046+0000", 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.0031105569999999999, 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039952670000000003, 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:08.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304046+0000", 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304046+0000", 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304046+0000", 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0900000000000002e-07 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304074+0000", 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7971e-05 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304083+0000", 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7690000000000002e-06 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304089+0000", 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2489999999999998e-06 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:08.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304130+0000", 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.087e-05 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.304151+0000", 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0681000000000001e-05 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:08.388 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.389 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:08.389 INFO:teuthology.orchestra.run.smithi183.stdout: ], 2023-10-08T06:58:08.389 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 16 2023-10-08T06:58:08.389 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:58:08.390 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:08.391 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:08.389+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:58:08.391 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:08.392 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:58:08.393 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:58:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:58:08.394 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 28 16 71800 71784 160.219 133.875 0.00783718 0.00623853 2023-10-08T06:58:08.491 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:08.490+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:08.581 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:08.582 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:08.592 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:08.591+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:08.598 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:58:08.693 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:08.692+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:08.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:08.794+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:08.827 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:08.827 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:08.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:08.895 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:08.894+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:08.996 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:08.995+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:09.025 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:09.025 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:09.037 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:09.097 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:09.096+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:09.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:09.197+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:09.207 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:09.207 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:09.222 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:09.298 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:09.297+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:09.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 29 16 73917 73901 159.256 132.312 0.0132463 0.0062762 2023-10-08T06:58:09.399 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:09.398+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:09.440 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:09.441 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:09.456 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:09.500 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:09.499+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:09.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:09.602+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:09.626 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:09.627 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:09.642 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:09.701 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:09.701+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:09.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:09.802+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:09.810 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:09.810 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:09.824 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:09.903 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:09.902+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:10.005 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:10.003+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:10.031 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:10.031 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:10.044 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T06:58:10.106 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:10.105+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:10.207 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:10.206+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:10.237 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:10.237 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:10.253 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T06:58:10.307 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T06:58:10.306+0000 7f0f3baae700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97714) UID: 0 2023-10-08T06:58:10.327 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T06:58:10.327 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T06:58:10.327 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2023-10-08T06:58:10.327 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T06:58:10.327 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-08T06:58:10.328 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T06:58:10.353 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-08T06:58:10.353 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T06:58:10.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 30 16 76016 76000 158.32 131.188 0.00782642 0.00631346 2023-10-08T06:58:10.377 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-08T06:58:10.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:58:10.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:10.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:10.408+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:10.441 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:10.441 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:10.458 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T06:58:10.508 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:10.508+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:10.555 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:10.575 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:10.597 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:58:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T06:58:10.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:10.609+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:10.694 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T06:58:10.694 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2023-10-08T06:58:10.694 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:14433 5.6 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 26.584225954000001, 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017532516000000001, 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.695 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 14433 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106904+0000", 2023-10-08T06:58:10.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.697 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106905+0000", 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106971+0000", 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5945000000000006e-05 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106979+0000", 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8739999999999995e-06 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.106983+0000", 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3660000000000002e-06 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107023+0000", 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9634e-05 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107137+0000", 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114747 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.107229+0000", 2023-10-08T06:58:10.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1775999999999997e-05 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.108887+0000", 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016575100000000001 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124321+0000", 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015434128 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124374+0000", 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2899000000000003e-05 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:44.124437+0000", 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3016999999999997e-05 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.702 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28697 5.a 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.82065819, 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.029866567, 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28697 2023-10-08T06:58:10.703 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870472+0000", 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870473+0000", 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3200000000000005e-07 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870533+0000", 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9941000000000001e-05 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870549+0000", 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6688e-05 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870555+0000", 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9059999999999999e-06 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870617+0000", 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1309999999999994e-05 2023-10-08T06:58:10.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870732+0000", 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000115198 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.870813+0000", 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1542e-05 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.707 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.874939+0000", 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041253219999999998 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900278+0000", 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025339897 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900315+0000", 2023-10-08T06:58:10.708 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6229999999999997e-05 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900339+0000", 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3901e-05 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.709 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28699 5.a 5:5b28870b:::benchmark_data_smithi037_101035_object28698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.817734541, 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.027162454999999999, 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28699 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.710 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.711 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873396+0000", 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.06e-07 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873473+0000", 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6679000000000002e-05 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873487+0000", 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3597999999999999e-05 2023-10-08T06:58:10.712 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873491+0000", 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.916e-06 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873529+0000", 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7598000000000002e-05 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.713 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873626+0000", 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7367000000000005e-05 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.873729+0000", 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010220799999999999 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880045+0000", 2023-10-08T06:58:10.714 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063162089999999997 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900391+0000", 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020346212999999998 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900514+0000", 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012279700000000001 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900558+0000", 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4264000000000002e-05 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:28704 5.a 5:576041a3:::benchmark_data_smithi037_101035_object28703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.814858222000002, 2023-10-08T06:58:10.716 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.024376907999999999, 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 28704 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:10.717 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876272+0000", 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876273+0000", 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1099999999999995e-07 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.718 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876333+0000", 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0281000000000001e-05 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876341+0000", 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2859999999999999e-06 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.719 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876346+0000", 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9099999999999996e-06 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876382+0000", 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6164000000000001e-05 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876493+0000", 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001111 2023-10-08T06:58:10.720 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.876609+0000", 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000116128 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.880067+0000", 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003457304 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.721 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900600+0000", 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020532749999999999 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900629+0000", 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9323e-05 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.722 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:48.900649+0000", 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0051000000000002e-05 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:30811 5.c 5:33193cdf:::benchmark_data_smithi037_101035_object30810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.031470454000001, 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018643812999999999, 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.723 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 30811 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.724 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659660+0000", 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9500000000000002e-07 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.725 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659715+0000", 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659724+0000", 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7280000000000007e-06 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.659732+0000", 2023-10-08T06:58:10.726 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664288+0000", 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045555680000000003 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664434+0000", 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014595400000000001 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.727 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.664590+0000", 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156599 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.666251+0000", 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016600549999999999 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.728 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678240+0000", 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011989145999999999 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678278+0000", 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8389000000000001e-05 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:49.678304+0000", 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5531e-05 2023-10-08T06:58:10.729 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38563 5.6 5:693ba6d4:::benchmark_data_smithi037_101035_object38562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.945254220999999, 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019052401, 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.730 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38563 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.731 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745876+0000", 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745877+0000", 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.99e-07 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745909+0000", 2023-10-08T06:58:10.732 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2098999999999999e-05 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745917+0000", 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9559999999999997e-06 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745922+0000", 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7749999999999998e-06 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.733 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757816+0000", 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011893733 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.757935+0000", 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011882799999999999 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.734 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.758060+0000", 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000125217 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761820+0000", 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003759872 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.735 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764861+0000", 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030408420000000002 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764895+0000", 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4248999999999997e-05 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764928+0000", 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3231000000000001e-05 2023-10-08T06:58:10.736 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38564 5.6 5:646adcee:::benchmark_data_smithi037_101035_object38563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.945179744000001, 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021880430999999999, 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.737 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38564 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.738 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745950+0000", 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.745951+0000", 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6400000000000002e-07 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746069+0000", 2023-10-08T06:58:10.739 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000117945 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746078+0000", 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4800000000000001e-06 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746084+0000", 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0909999999999998e-06 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.740 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759452+0000", 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013368161 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759548+0000", 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5867999999999998e-05 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.741 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.759671+0000", 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012332700000000001 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764962+0000", 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052914839999999999 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767742+0000", 2023-10-08T06:58:10.742 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027792110000000002 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767792+0000", 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0659999999999999e-05 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767831+0000", 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.854e-05 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.743 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38569 5.6 5:6346498c:::benchmark_data_smithi037_101035_object38568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.944916149000001, 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021737508999999999, 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.744 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38569 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746214+0000", 2023-10-08T06:58:10.745 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746215+0000", 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4499999999999997e-07 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746278+0000", 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3112000000000002e-05 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.746 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746285+0000", 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.746291+0000", 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.993e-06 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.747 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.761964+0000", 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015672927 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762055+0000", 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0352999999999994e-05 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.762165+0000", 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000109961 2023-10-08T06:58:10.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.764998+0000", 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028333960000000002 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767879+0000", 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028805129999999999 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.749 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767921+0000", 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2070999999999998e-05 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767952+0000", 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0898999999999997e-05 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.750 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:38571 5.6 5:66544174:::benchmark_data_smithi037_101035_object38570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.943478391999999, 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.026065827, 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 38571 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.751 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.752 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747652+0000", 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2799999999999996e-07 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747680+0000", 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7137000000000001e-05 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747708+0000", 2023-10-08T06:58:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8674e-05 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.747715+0000", 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.64e-06 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765069+0000", 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017353848000000002 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.754 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765144+0000", 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5306e-05 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.765236+0000", 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2280000000000004e-05 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.755 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.767868+0000", 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026313320000000001 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773659+0000", 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057915329999999998 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773696+0000", 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7081e-05 2023-10-08T06:58:10.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:52.773718+0000", 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1367999999999999e-05 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52025 5.e 5:78ce0172:::benchmark_data_smithi037_101035_object52024:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:10.757 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 12.401347634, 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.017239604, 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52025 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.758 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289783+0000", 2023-10-08T06:58:10.759 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3900000000000004e-07 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289881+0000", 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7559000000000006e-05 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289890+0000", 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8699999999999998e-06 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.760 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289895+0000", 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5740000000000003e-06 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290751+0000", 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00085582900000000001 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2023-10-08T06:58:10.761 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290760+0000", 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7679999999999997e-06 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297332+0000", 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065719400000000001 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297341+0000", 2023-10-08T06:58:10.762 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8249999999999994e-06 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.306177+0000", 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0088363520000001 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307022+0000", 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00084514799999999999 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.763 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52028 5.e 5:7ff4b5d8:::benchmark_data_smithi037_101035_object52027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 12.401224686999999, 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.017449322, 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.764 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52028 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.765 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289906+0000", 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.75e-07 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289982+0000", 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5687999999999998e-05 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289991+0000", 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5880000000000004e-06 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.289998+0000", 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3090000000000001e-06 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290849+0000", 2023-10-08T06:58:10.767 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00085124799999999998 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290856+0000", 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.097e-06 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297370+0000", 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065140500000000004 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.768 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297375+0000", 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7010000000000004e-06 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307299+0000", 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.009924305 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.769 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307355+0000", 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5760999999999997e-05 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:52029 5.e 5:7d9a3073:::benchmark_data_smithi037_101035_object52028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 12.401123310999999, 2023-10-08T06:58:10.770 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0174442429999999, 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 52029 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:10.771 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290007+0000", 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290008+0000", 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8199999999999999e-07 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.772 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290073+0000", 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5423e-05 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290081+0000", 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9640000000000003e-06 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.773 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290089+0000", 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3690000000000007e-06 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290881+0000", 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00079155399999999998 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.290886+0000", 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.95e-06 2023-10-08T06:58:10.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297405+0000", 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065193630000000002 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:58.297417+0000", 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1499e-05 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.775 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307387+0000", 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.009970187 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:57:59.307451+0000", 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4251999999999994e-05 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:67169 5.c 5:3179014e:::benchmark_data_smithi037_101035_object67168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.193816+0000", 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.4973145719999996, 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018879877, 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 67169 2023-10-08T06:58:10.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193816+0000", 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193816+0000", 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193817+0000", 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.24e-06 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193852+0000", 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4999000000000002e-05 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193863+0000", 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0956e-05 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193871+0000", 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7700000000000001e-06 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193917+0000", 2023-10-08T06:58:10.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6125999999999998e-05 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194046+0000", 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000129212 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194193+0000", 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000146551 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.197587+0000", 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033943179999999999 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.212614+0000", 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015027624999999999 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.782 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.212670+0000", 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5210000000000002e-05 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.212696+0000", 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5870000000000001e-05 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.783 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:67165 5.8 e35/20 5:1d063b33:::benchmark_data_smithi037_101035_object67164:head v 35'4181, mlcod=35'4177)", 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.193927+0000", 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.49720283, 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017547917, 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193927+0000", 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193927+0000", 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193928+0000", 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0200000000000001e-07 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193959+0000", 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1146000000000003e-05 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193965+0000", 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.392e-06 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.193970+0000", 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4630000000000003e-06 2023-10-08T06:58:10.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194006+0000", 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6767999999999998e-05 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194025+0000", 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8357999999999999e-05 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.787 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.211420+0000", 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017395687999999999 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.211475+0000", 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.49e-05 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:67173 5.4 e35/20 5:27ad57f3:::benchmark_data_smithi037_101035_object67172:head v 35'4193, mlcod=35'4191)", 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.194960+0000", 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.4961697709999999, 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019794549000000002, 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194960+0000", 2023-10-08T06:58:10.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194960+0000", 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.194961+0000", 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1800000000000001e-07 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195019+0000", 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7741000000000002e-05 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195026+0000", 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8129999999999996e-06 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195040+0000", 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4061e-05 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.196165+0000", 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011244060000000001 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.196182+0000", 2023-10-08T06:58:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6985000000000001e-05 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214716+0000", 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018534001000000001 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214755+0000", 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9124e-05 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.793 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_repop(client.4555.0:67178 5.2 e35/20 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head v 35'4251, mlcod=35'4249)", 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.4959403059999996, 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019075749999999999, 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.794 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195190+0000", 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8400000000000005e-07 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195248+0000", 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7980999999999999e-05 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195256+0000", 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7379999999999994e-06 2023-10-08T06:58:10.796 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.195262+0000", 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7150000000000003e-06 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.197478+0000", 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022158410000000001 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.197497+0000", 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9309000000000001e-05 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214212+0000", 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016715509999999999 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.214266+0000", 2023-10-08T06:58:10.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3171999999999998e-05 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:67520 5.6 5:695b607d:::benchmark_data_smithi037_101035_object67519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.365794+0000", 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.3253360890000003, 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017829123999999998, 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.799 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 67520 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365794+0000", 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.800 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365794+0000", 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365795+0000", 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1999999999999999e-07 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365891+0000", 2023-10-08T06:58:10.801 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6154000000000001e-05 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365899+0000", 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9549999999999992e-06 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.365906+0000", 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.567e-06 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.802 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.366563+0000", 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065726100000000002 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.366711+0000", 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014772900000000001 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.803 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.366873+0000", 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016214800000000001 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.372539+0000", 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056662550000000002 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.383540+0000", 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011001116 2023-10-08T06:58:10.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.383588+0000", 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8115000000000003e-05 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.383623+0000", 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5104000000000001e-05 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.805 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:67586 5.6 5:6b041fcb:::benchmark_data_smithi037_101035_object67585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:06.399924+0000", 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2912061049999997, 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018021911000000002, 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.806 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 67586 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399924+0000", 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399924+0000", 2023-10-08T06:58:10.807 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399926+0000", 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4109999999999999e-06 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399972+0000", 2023-10-08T06:58:10.808 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6056000000000001e-05 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399982+0000", 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0694e-05 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.399989+0000", 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9650000000000002e-06 2023-10-08T06:58:10.809 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.400037+0000", 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8026999999999999e-05 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.400197+0000", 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015956299999999999 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.810 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.400335+0000", 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000138205 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.402717+0000", 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0023814700000000001 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.417838+0000", 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015121005 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.417899+0000", 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1752000000000001e-05 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:06.417946+0000", 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6762999999999999e-05 2023-10-08T06:58:10.812 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71287 5.6 5:6b1d4b3d:::benchmark_data_smithi037_101035_object71286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.111536+0000", 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 2.579594706, 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019162689, 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.813 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71287 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.111536+0000", 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.111536+0000", 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.111536+0000", 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.99e-07 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.111561+0000", 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4777999999999999e-05 2023-10-08T06:58:10.815 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.111570+0000", 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.38e-06 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.111576+0000", 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2009999999999998e-06 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.113971+0000", 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00239529 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.114078+0000", 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106727 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.114192+0000", 2023-10-08T06:58:10.817 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114854 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.118388+0000", 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041957670000000004 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.130621+0000", 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012232608000000001 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.818 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.130663+0000", 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2406e-05 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.130698+0000", 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4978999999999998e-05 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.819 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4555.0:71303 5.6 5:6d1b3394:::benchmark_data_smithi037_101035_object71302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2023-10-08T06:58:08.117030+0000", 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 2.5741000509999998, 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017456449999999998, 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4555", 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 71303 2023-10-08T06:58:10.820 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.117030+0000", 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.117030+0000", 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.821 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.117031+0000", 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7999999999999993e-07 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.117057+0000", 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5882999999999999e-05 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2023-10-08T06:58:10.822 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.117070+0000", 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3047000000000001e-05 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.117077+0000", 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2450000000000001e-06 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.123608+0000", 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065304739999999997 2023-10-08T06:58:10.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.123778+0000", 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017053200000000001 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.123941+0000", 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000162213 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.128101+0000", 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041606250000000003 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.134405+0000", 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063035360000000002 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.134449+0000", 2023-10-08T06:58:10.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4354000000000003e-05 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: { 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2023-10-08T06:58:08.134487+0000", 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7561000000000002e-05 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2023-10-08T06:58:10.826 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T06:58:10.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:10.827+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:10.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:10.929 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:10.928+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:11.004 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77341 5.d 5:baa29c0d:::benchmark_data_smithi037_101035_object77340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:11.000381+0000", 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0031825299999999998, 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003204138, 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77341 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000381+0000", 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000381+0000", 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000381+0000", 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4600000000000005e-07 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000434+0000", 2023-10-08T06:58:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2547999999999999e-05 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000443+0000", 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6999999999999997e-06 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000447+0000", 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8080000000000004e-06 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000521+0000", 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3514000000000001e-05 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000621+0000", 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9644999999999999e-05 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000716+0000", 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5507999999999994e-05 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:77338 5.7 e37/20)", 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:11.003025+0000", 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00053815099999999995, 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00060649599999999999, 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003025+0000", 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003025+0000", 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003026+0000", 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003030+0000", 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1200000000000004e-06 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003046+0000", 2023-10-08T06:58:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5696e-05 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003051+0000", 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5629999999999999e-06 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:77341 5.d e37/32)", 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:11.003201+0000", 2023-10-08T06:58:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.000362512, 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00045829099999999999, 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003201+0000", 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003201+0000", 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003201+0000", 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003204+0000", 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9050000000000001e-06 2023-10-08T06:58:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003212+0000", 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7340000000000008e-06 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003216+0000", 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.155e-06 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77345 5.d 5.17e01ad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:11.003349+0000", 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.000214656, 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00033815000000000001, 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77345 2023-10-08T06:58:11.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003349+0000", 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003349+0000", 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003349+0000", 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2799999999999995e-07 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003399+0000", 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9517e-05 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003410+0000", 2023-10-08T06:58:11.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1358999999999999e-05 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003418+0000", 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8560000000000007e-06 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77323 5.f 5:f7d39f88:::benchmark_data_smithi037_101035_object77322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.015710518999999999, 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015884750999999999, 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77323 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987854+0000", 2023-10-08T06:58:11.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0800000000000003e-07 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987924+0000", 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9880000000000002e-05 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987933+0000", 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5999999999999996e-06 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987939+0000", 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3970000000000002e-06 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989195+0000", 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001256131 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989315+0000", 2023-10-08T06:58:11.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012042199999999999 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989478+0000", 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016272300000000001 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.993935+0000", 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044572429999999996 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.025 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77326 5.d 5:bcd15c70:::benchmark_data_smithi037_101035_object77325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.014067301000000001, 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014287026, 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.026 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77326 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989497+0000", 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9100000000000002e-07 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989541+0000", 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4508999999999997e-05 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989550+0000", 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3939999999999996e-06 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989555+0000", 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4870000000000002e-06 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989608+0000", 2023-10-08T06:58:11.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2908000000000002e-05 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989712+0000", 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103788 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989799+0000", 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6812999999999997e-05 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.993980+0000", 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041815369999999999 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77327 5.2 5:4c5e2a6f:::benchmark_data_smithi037_101035_object77326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.991981+0000", 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.011581829, 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011845862, 2023-10-08T06:58:11.031 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77327 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.991981+0000", 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.991981+0000", 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.991982+0000", 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6700000000000003e-07 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992013+0000", 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0416000000000002e-05 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992024+0000", 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0844e-05 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992030+0000", 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6560000000000003e-06 2023-10-08T06:58:11.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992085+0000", 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5033e-05 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992207+0000", 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121847 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992396+0000", 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000188884 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.997558+0000", 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051616730000000003 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77328 5.7 5:e02631e7:::benchmark_data_smithi037_101035_object77327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.992049+0000", 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.01151424, 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011823904, 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77328 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992049+0000", 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992049+0000", 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992050+0000", 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992092+0000", 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2240000000000002e-05 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992099+0000", 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1149999999999996e-06 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992103+0000", 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7840000000000001e-06 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992146+0000", 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3093000000000002e-05 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992270+0000", 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000123695 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.992426+0000", 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015601499999999999 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.001233+0000", 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088076200000000004 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.041 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77332 5.9 5:9d4fa933:::benchmark_data_smithi037_101035_object77331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.994223+0000", 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0093400970000000003, 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096954090000000003, 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.042 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77332 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994223+0000", 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994223+0000", 2023-10-08T06:58:11.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994224+0000", 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6700000000000002e-07 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994292+0000", 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8161e-05 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994300+0000", 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.401e-06 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994304+0000", 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8339999999999998e-06 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994350+0000", 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5272999999999998e-05 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994434+0000", 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4604000000000005e-05 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994520+0000", 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6031000000000004e-05 2023-10-08T06:58:11.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.999607+0000", 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050868110000000001 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77333 5.7 5:e9bcf4e5:::benchmark_data_smithi037_101035_object77332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.994318+0000", 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0092454649999999996, 2023-10-08T06:58:11.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096469250000000006, 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77333 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994318+0000", 2023-10-08T06:58:11.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994318+0000", 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994318+0000", 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2199999999999999e-07 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994354+0000", 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5546999999999997e-05 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994360+0000", 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7440000000000004e-06 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994363+0000", 2023-10-08T06:58:11.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7780000000000001e-06 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994395+0000", 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1408999999999997e-05 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994469+0000", 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3769999999999993e-05 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.994561+0000", 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1989000000000003e-05 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.001315+0000", 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067545820000000003 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77334 5.1 5:8edf4d1a:::benchmark_data_smithi037_101035_object77333:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.996167+0000", 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0073967909999999998, 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078426820000000001, 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77334 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996167+0000", 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996167+0000", 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996167+0000", 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0200000000000001e-07 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996223+0000", 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6085999999999998e-05 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996233+0000", 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.55e-06 2023-10-08T06:58:11.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996238+0000", 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1030000000000001e-06 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996284+0000", 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5878999999999999e-05 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996396+0000", 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112577 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996496+0000", 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9754999999999996e-05 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.003114+0000", 2023-10-08T06:58:11.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066183029999999999 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77335 5.1 5:8600e877:::benchmark_data_smithi037_101035_object77334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.996365+0000", 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0071986189999999999, 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076885399999999998, 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77335 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996365+0000", 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996365+0000", 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996365+0000", 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1100000000000001e-07 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996537+0000", 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017139100000000001 2023-10-08T06:58:11.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996548+0000", 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1187e-05 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996552+0000", 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3630000000000004e-06 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998023+0000", 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001471244 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998117+0000", 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4055000000000007e-05 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998211+0000", 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3642999999999998e-05 2023-10-08T06:58:11.062 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77338 5.7 5:ef854c46:::benchmark_data_smithi037_101035_object77337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.996568+0000", 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0069949720000000003, 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00752581, 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.063 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77338 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996568+0000", 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996568+0000", 2023-10-08T06:58:11.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996569+0000", 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0100000000000005e-07 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996597+0000", 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7679999999999999e-05 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996606+0000", 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1560000000000001e-06 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996609+0000", 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8039999999999999e-06 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996664+0000", 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4716000000000003e-05 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996814+0000", 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014982600000000001 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.996995+0000", 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018072300000000001 2023-10-08T06:58:11.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77339 5.f 5:f3e9b284:::benchmark_data_smithi037_101035_object77338:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.998830+0000", 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0047334889999999996, 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053258630000000001, 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.068 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77339 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998830+0000", 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998830+0000", 2023-10-08T06:58:11.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998830+0000", 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4999999999999998e-07 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998888+0000", 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7892000000000001e-05 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998898+0000", 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4879999999999996e-06 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.998902+0000", 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6990000000000002e-06 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.001275+0000", 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00237309 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.001417+0000", 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000141481 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.001576+0000", 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000159512 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:77333 5.7 e37/20 ondisk, result = 0)", 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:11.000219+0000", 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0033440269999999999, 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039760819999999997, 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000219+0000", 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000219+0000", 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000220+0000", 2023-10-08T06:58:11.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0999999999999999e-07 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000223+0000", 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2959999999999999e-06 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000233+0000", 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5550000000000008e-06 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.000252+0000", 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8868e-05 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.001288+0000", 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0010366520000000001 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.001296+0000", 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6129999999999998e-06 2023-10-08T06:58:11.076 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.077 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.077 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.077 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.077 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:11.077 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 15 2023-10-08T06:58:11.077 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:11.078 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:11.079 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:11.077+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:11.179 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:11.178+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:11.256 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:11.256 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:11.256 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:11.256 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:11.256 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:11.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:11.279 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:11.279+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:58:11.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 31 16 78105 78089 157.425 130.562 0.00388273 0.00634917 2023-10-08T06:58:11.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:11.381+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.339669657999998, 2023-10-08T06:58:11.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:58:11.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:58:11.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.455 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.573415917999998, 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:11.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.462 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.566581530000001, 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:11.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:11.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:50899 5.f 5:f78f4ca7:::benchmark_data_smithi037_101035_object50898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:11.469 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.660778006999999, 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016993019000000002, 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 50899 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786193+0000", 2023-10-08T06:58:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4799999999999998e-07 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786222+0000", 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9499e-05 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786232+0000", 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8830000000000001e-06 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786238+0000", 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1680000000000001e-06 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789392+0000", 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031532930000000002 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789506+0000", 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114697 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789630+0000", 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012329100000000001 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.794834+0000", 2023-10-08T06:58:11.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052047309999999998 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803096+0000", 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082619519999999995 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803149+0000", 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.304e-05 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803185+0000", 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5917000000000002e-05 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57920 5.2 5:4b015bf8:::benchmark_data_smithi037_101035_object57919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.5471658789999996, 2023-10-08T06:58:11.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017795800000000001, 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57920 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899805+0000", 2023-10-08T06:58:11.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900121+0000", 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031621900000000002 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900127+0000", 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2859999999999996e-06 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900131+0000", 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4369999999999999e-06 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906312+0000", 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061814790000000001 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906420+0000", 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010733700000000001 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906504+0000", 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4794000000000002e-05 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.909717+0000", 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032127689999999999 2023-10-08T06:58:11.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917514+0000", 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077965819999999998 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917559+0000", 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5618999999999998e-05 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917600+0000", 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0908999999999997e-05 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57922 5.2 5:47786b04:::benchmark_data_smithi037_101035_object57921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.5468345079999999, 2023-10-08T06:58:11.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017617088999999999, 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57922 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:11.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9700000000000003e-07 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900176+0000", 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0093999999999999e-05 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900185+0000", 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.918e-06 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900189+0000", 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1810000000000003e-06 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.907989+0000", 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078000559999999997 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908154+0000", 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016444300000000001 2023-10-08T06:58:11.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908326+0000", 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017191999999999999 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.911360+0000", 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003033956 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917653+0000", 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062937280000000002 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917719+0000", 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5865999999999996e-05 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917753+0000", 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3630000000000002e-05 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58515 5.7 5:e5bd311c:::benchmark_data_smithi037_101035_object58514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.2753749560000003, 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019075253, 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58515 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171596+0000", 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171630+0000", 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4464000000000001e-05 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171637+0000", 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171641+0000", 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6030000000000001e-06 2023-10-08T06:58:11.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177693+0000", 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060519090000000003 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177783+0000", 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0705000000000007e-05 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177924+0000", 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140815 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181053+0000", 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003129204 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190584+0000", 2023-10-08T06:58:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095309550000000007 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190633+0000", 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8715999999999999e-05 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190671+0000", 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2023-10-08T06:58:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58528 5.f 5:fc8a38c2:::benchmark_data_smithi037_101035_object58527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.2691437190000006, 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016426361, 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58528 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9500000000000001e-07 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177933+0000", 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000106019 2023-10-08T06:58:11.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177959+0000", 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5918000000000002e-05 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177975+0000", 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5333e-05 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181064+0000", 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030889899999999998 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181233+0000", 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016972999999999999 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181383+0000", 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014949200000000001 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184425+0000", 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030423490000000002 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194169+0000", 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097436050000000007 2023-10-08T06:58:11.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194217+0000", 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7927999999999999e-05 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194253+0000", 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6202000000000003e-05 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67177 5.7 5:eceead93:::benchmark_data_smithi037_101035_object67176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.2522517759999996, 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018827831, 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67177 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:11.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194808+0000", 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8851999999999996e-05 2023-10-08T06:58:11.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194813+0000", 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5380000000000002e-06 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194817+0000", 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6219999999999998e-06 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196266+0000", 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014492940000000001 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196360+0000", 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3331999999999993e-05 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196452+0000", 2023-10-08T06:58:11.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2529999999999997e-05 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197982+0000", 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015301030000000001 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213446+0000", 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015463563 2023-10-08T06:58:11.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213510+0000", 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3689999999999995e-05 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213546+0000", 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6828e-05 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.2521399510000002, 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.511 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:11.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:11.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67184 5.2 5:4ca6e80a:::benchmark_data_smithi037_101035_object67183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.248384969, 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017158867000000001, 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.518 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67184 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198586+0000", 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8899999999999998e-07 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198642+0000", 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5687999999999999e-05 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198653+0000", 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1345000000000001e-05 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198661+0000", 2023-10-08T06:58:11.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.233e-06 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198709+0000", 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8390999999999998e-05 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198786+0000", 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6852000000000002e-05 2023-10-08T06:58:11.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198891+0000", 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105643 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.200969+0000", 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020771600000000002 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215641+0000", 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014672304000000001 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215709+0000", 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8456999999999999e-05 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215744+0000", 2023-10-08T06:58:11.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4904999999999999e-05 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67436 5.7 5:e2f7cac5:::benchmark_data_smithi037_101035_object67435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.1200731819999996, 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017493584, 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.525 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67436 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326898+0000", 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.569999999999999e-07 2023-10-08T06:58:11.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326935+0000", 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7011999999999997e-05 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326946+0000", 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0446e-05 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326953+0000", 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3100000000000003e-06 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330129+0000", 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003176183 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330249+0000", 2023-10-08T06:58:11.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119702 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330391+0000", 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014252399999999999 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.336180+0000", 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057887770000000002 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344304+0000", 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081237419999999998 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344349+0000", 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4866e-05 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344391+0000", 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2064999999999998e-05 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68298 5.9 5:920090b0:::benchmark_data_smithi037_101035_object68297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.7208655940000002, 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017738614, 2023-10-08T06:58:11.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68298 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726106+0000", 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0279999999999999e-06 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726184+0000", 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8300000000000006e-05 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726196+0000", 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.201e-05 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726203+0000", 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1029999999999996e-06 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726266+0000", 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2346000000000002e-05 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726431+0000", 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016508899999999999 2023-10-08T06:58:11.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726617+0000", 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018605299999999999 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733386+0000", 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067696600000000003 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743760+0000", 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010373339000000001 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743814+0000", 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4151999999999999e-05 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743843+0000", 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9533999999999999e-05 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68304 5.1 5:836c7fad:::benchmark_data_smithi037_101035_object68303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.7173735319999999, 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016799999999999999, 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.539 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68304 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729628+0000", 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0830000000000001e-05 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729642+0000", 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3570999999999999e-05 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729649+0000", 2023-10-08T06:58:11.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4309999999999997e-06 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731268+0000", 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001619241 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731382+0000", 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113522 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731534+0000", 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015160099999999999 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733712+0000", 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021787970000000001 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746333+0000", 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012620350000000001 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746375+0000", 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2151999999999999e-05 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746397+0000", 2023-10-08T06:58:11.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1943999999999999e-05 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:70072 5.2 5:4f26b367:::benchmark_data_smithi037_101035_object70071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8875408849999999, 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017011773000000001, 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.546 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 70072 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559430+0000", 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.82e-07 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559478+0000", 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7802000000000001e-05 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559487+0000", 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1249999999999999e-06 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559500+0000", 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3343000000000001e-05 2023-10-08T06:58:11.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562403+0000", 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029030760000000001 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562544+0000", 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014036800000000001 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562717+0000", 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017288899999999999 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.564640+0000", 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001923237 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576345+0000", 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011704786 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576401+0000", 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6697999999999998e-05 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576441+0000", 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9867000000000003e-05 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75643706600000005, 2023-10-08T06:58:11.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:11.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:11.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77019 5.2 5:44f51aeb:::benchmark_data_smithi037_101035_object77018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.560 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.59853651600000002, 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016770778, 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77019 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3e-07 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848516+0000", 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1154000000000003e-05 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848525+0000", 2023-10-08T06:58:11.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6719999999999999e-06 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848530+0000", 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0089999999999998e-06 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.851949+0000", 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034188679999999998 2023-10-08T06:58:11.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.852059+0000", 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010998 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.852199+0000", 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000139596 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.855699+0000", 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035000809999999999 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.865129+0000", 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094301469999999998 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.865178+0000", 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9159000000000001e-05 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.865205+0000", 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6482000000000002e-05 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.567 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77323 5.f 5:f7d39f88:::benchmark_data_smithi037_101035_object77322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.45911755799999998, 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016677328000000002, 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77323 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987854+0000", 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0800000000000003e-07 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987924+0000", 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9880000000000002e-05 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987933+0000", 2023-10-08T06:58:11.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5999999999999996e-06 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987939+0000", 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3970000000000002e-06 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989195+0000", 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001256131 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989315+0000", 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012042199999999999 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989478+0000", 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016272300000000001 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.993935+0000", 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044572429999999996 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.004455+0000", 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010519957 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.004498+0000", 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2907000000000001e-05 2023-10-08T06:58:11.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.004530+0000", 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2159999999999997e-05 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77326 5.d 5:bcd15c70:::benchmark_data_smithi037_101035_object77325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:11.574 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.45747433999999998, 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016961079, 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77326 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989497+0000", 2023-10-08T06:58:11.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9100000000000002e-07 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989541+0000", 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4508999999999997e-05 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989550+0000", 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3939999999999996e-06 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989555+0000", 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4870000000000002e-06 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989608+0000", 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2908000000000002e-05 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989712+0000", 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103788 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989799+0000", 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6812999999999997e-05 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.993980+0000", 2023-10-08T06:58:11.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041815369999999999 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.006381+0000", 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012400873 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.006417+0000", 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5315999999999999e-05 2023-10-08T06:58:11.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.006457+0000", 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0562999999999998e-05 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:77582 5.c e37/20 5:30e31b53:::benchmark_data_smithi037_101035_object77581:head v 37'5042, mlcod=37'5040)", 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:11.114301+0000", 2023-10-08T06:58:11.581 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.332668992, 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016636016, 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114301+0000", 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114301+0000", 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114302+0000", 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114357+0000", 2023-10-08T06:58:11.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4852000000000003e-05 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114366+0000", 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3680000000000008e-06 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114373+0000", 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8360000000000003e-06 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114434+0000", 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1180999999999996e-05 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114457+0000", 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2322000000000001e-05 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:11.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.130893+0000", 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016436624 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.130937+0000", 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4095999999999999e-05 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:11.586 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:11.587 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:11.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:11.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:11.587+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:11.689 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:11.688+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:11.765 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:11.765 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:11.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.765 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:78968 5.4 5:28723851:::benchmark_data_smithi037_101035_object78967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:11.765 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.754305+0000", 2023-10-08T06:58:11.765 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0097952990000000004, 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098270389999999992, 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 78968 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.766 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754305+0000", 2023-10-08T06:58:11.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754305+0000", 2023-10-08T06:58:11.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754306+0000", 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6700000000000003e-07 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754438+0000", 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013185200000000001 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754448+0000", 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.961e-06 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754453+0000", 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7790000000000001e-06 2023-10-08T06:58:11.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754503+0000", 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9530999999999997e-05 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754643+0000", 2023-10-08T06:58:11.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013976700000000001 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754801+0000", 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015817500000000001 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762267+0000", 2023-10-08T06:58:11.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074663129999999996 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:78971 5.4 5:25996d01:::benchmark_data_smithi037_101035_object78970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.754468+0000", 2023-10-08T06:58:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0096324919999999994, 2023-10-08T06:58:11.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0097197780000000001, 2023-10-08T06:58:11.774 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.774 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:11.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:11.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 78971 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754468+0000", 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754468+0000", 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754468+0000", 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9700000000000002e-07 2023-10-08T06:58:11.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754508+0000", 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9391999999999998e-05 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754513+0000", 2023-10-08T06:58:11.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5369999999999997e-06 2023-10-08T06:58:11.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754517+0000", 2023-10-08T06:58:11.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7340000000000002e-06 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.757006+0000", 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024888620000000001 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.757153+0000", 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014753699999999999 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.757316+0000", 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000162802 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762270+0000", 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049542659999999997 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.781 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:78973 5.4 5:24edef5f:::benchmark_data_smithi037_101035_object78972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:11.781 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.754585+0000", 2023-10-08T06:58:11.781 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0095149980000000002, 2023-10-08T06:58:11.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0096635509999999994, 2023-10-08T06:58:11.781 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.781 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 78973 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754585+0000", 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754585+0000", 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754586+0000", 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7100000000000002e-07 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754617+0000", 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0828999999999999e-05 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754623+0000", 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5189999999999998e-06 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.754629+0000", 2023-10-08T06:58:11.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.604e-06 2023-10-08T06:58:11.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.758738+0000", 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041093060000000001 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.758908+0000", 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170163 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.759128+0000", 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021995599999999999 2023-10-08T06:58:11.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:78979 5.a e38/20 5:5898fe4f:::benchmark_data_smithi037_101035_object78978:head v 38'4937, mlcod=38'4934)", 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.761461+0000", 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0026394959999999999, 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00285973, 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761461+0000", 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761461+0000", 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761461+0000", 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4400000000000001e-07 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761510+0000", 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8860000000000003e-05 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761518+0000", 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6510000000000001e-06 2023-10-08T06:58:11.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761524+0000", 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6279999999999999e-06 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761570+0000", 2023-10-08T06:58:11.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5899000000000002e-05 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761589+0000", 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8664999999999998e-05 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:78982 5.e e38/32 5:7105d9f2:::benchmark_data_smithi037_101035_object78981:head v 38'5020, mlcod=38'5018)", 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.761637+0000", 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002463149, 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027478049999999999, 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761637+0000", 2023-10-08T06:58:11.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761637+0000", 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761638+0000", 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3599999999999999e-07 2023-10-08T06:58:11.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761699+0000", 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1099999999999994e-05 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761708+0000", 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1009999999999998e-06 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761713+0000", 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0760000000000002e-06 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761763+0000", 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0232000000000003e-05 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761785+0000", 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2055000000000001e-05 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:78983 5.8 5:1ec47606:::benchmark_data_smithi037_101035_object78982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.761922+0000", 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021785020000000001, 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002502495, 2023-10-08T06:58:11.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 78983 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761922+0000", 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761922+0000", 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761923+0000", 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4399999999999999e-07 2023-10-08T06:58:11.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761977+0000", 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4116000000000002e-05 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761986+0000", 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5710000000000004e-06 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.761993+0000", 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5980000000000002e-06 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762067+0000", 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3732999999999994e-05 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762220+0000", 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015367899999999999 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762374+0000", 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000154115 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:78985 5.b 5:d62dddd8:::benchmark_data_smithi037_101035_object78984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.762379+0000", 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0017209969999999999, 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020996080000000002, 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 78985 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.803 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762379+0000", 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762379+0000", 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762380+0000", 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2099999999999995e-07 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762474+0000", 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3357999999999996e-05 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762486+0000", 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2384999999999999e-05 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762493+0000", 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4320000000000002e-06 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762550+0000", 2023-10-08T06:58:11.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6622000000000001e-05 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762643+0000", 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2774000000000003e-05 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762734+0000", 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1471000000000006e-05 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.807 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:78986 5.4 5:292eada4:::benchmark_data_smithi037_101035_object78985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.762646+0000", 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001454805, 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001900187, 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:11.808 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 78986 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762646+0000", 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762646+0000", 2023-10-08T06:58:11.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762646+0000", 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2099999999999996e-07 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762706+0000", 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0018e-05 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762714+0000", 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2630000000000003e-06 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762721+0000", 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2179999999999996e-06 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:11.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762768+0000", 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.778e-05 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.762887+0000", 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011841399999999999 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.763028+0000", 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141383 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.812 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:11.813 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.813 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:11.813 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:11.813 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2023-10-08T06:58:11.813 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:11.815 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:11.815 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:11.813+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:11.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:11.915+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:12.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:12.015+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:12.028 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:12.029 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:12.044 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:12.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:12.117+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:12.215 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:12.215 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:12.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.347348497999999, 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:12.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:12.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.344913741999999, 2023-10-08T06:58:12.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:12.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:58:12.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.344640279, 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.344500507999999, 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:58:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:58:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:58:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.344413653, 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:58:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:58:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.344352744999998, 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:58:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:58:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:58:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:58:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.344243547000001, 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:58:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:58:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:58:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.341647988999998, 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.339071240999999, 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:58:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:58:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:58:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51442 5.8 5:128c17d7:::benchmark_data_smithi037_101035_object51441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.187422165999999, 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018100852000000001, 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51442 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025179+0000", 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4416999999999999e-05 2023-10-08T06:58:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025186+0000", 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.452e-06 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025193+0000", 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.674e-06 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027741+0000", 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025483200000000002 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027823+0000", 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1264e-05 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027908+0000", 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5137999999999997e-05 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030945+0000", 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030372659999999998 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043185+0000", 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01224039 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043222+0000", 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043245+0000", 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2138999999999999e-05 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51448 5.8 5:12d8ea5b:::benchmark_data_smithi037_101035_object51447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.186073596, 2023-10-08T06:58:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018610680000000001, 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51448 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026493+0000", 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2500000000000004e-07 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026551+0000", 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7887999999999999e-05 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026568+0000", 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886000000000001e-05 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026577+0000", 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6339999999999996e-06 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028861+0000", 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022836639999999999 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028971+0000", 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001094 2023-10-08T06:58:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029055+0000", 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4484e-05 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032150+0000", 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030947420000000002 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045032+0000", 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012882482000000001 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045068+0000", 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5799000000000001e-05 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045103+0000", 2023-10-08T06:58:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4876000000000003e-05 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51449 5.0 5:078c55bb:::benchmark_data_smithi037_101035_object51448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.185972917000001, 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019798169000000001, 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51449 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2800000000000002e-07 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026615+0000", 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1171000000000001e-05 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026620+0000", 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6389999999999997e-06 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026624+0000", 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7500000000000001e-06 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028853+0000", 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002228701 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028993+0000", 2023-10-08T06:58:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140741 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029106+0000", 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011309100000000001 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.031364+0000", 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022572999999999998 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046335+0000", 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014971572000000001 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046369+0000", 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3778000000000001e-05 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046391+0000", 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1997999999999998e-05 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51451 5.8 5:1f80398c:::benchmark_data_smithi037_101035_object51450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.183425485000001, 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017441129999999999, 2023-10-08T06:58:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51451 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029141+0000", 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.78e-07 2023-10-08T06:58:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029229+0000", 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7996000000000002e-05 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029241+0000", 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2111e-05 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029250+0000", 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7819999999999999e-06 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029939+0000", 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00068897900000000005 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030024+0000", 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4802999999999994e-05 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030108+0000", 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4419000000000006e-05 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032167+0000", 2023-10-08T06:58:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020585299999999998 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046534+0000", 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014367322 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046563+0000", 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9286999999999999e-05 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046581+0000", 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8023e-05 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60821 5.0 5:09632156:::benchmark_data_smithi037_101035_object60820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9860171399999995, 2023-10-08T06:58:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017726374, 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60821 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226550+0000", 2023-10-08T06:58:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0200000000000001e-07 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226617+0000", 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7148000000000002e-05 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226627+0000", 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0030000000000001e-05 2023-10-08T06:58:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226635+0000", 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8679999999999999e-06 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234547+0000", 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079128459999999994 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234636+0000", 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8665999999999994e-05 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234726+0000", 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0251e-05 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.238072+0000", 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033451829999999998 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244212+0000", 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006140899 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244247+0000", 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4879000000000003e-05 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244275+0000", 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7801999999999999e-05 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67165 5.8 5:1d063b33:::benchmark_data_smithi037_101035_object67164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.0234007729999997, 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022537402000000002, 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67165 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189166+0000", 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2999999999999999e-07 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189258+0000", 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2398999999999994e-05 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189268+0000", 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3300000000000005e-06 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189275+0000", 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.192938+0000", 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036629380000000001 2023-10-08T06:58:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193029+0000", 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0659000000000001e-05 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193113+0000", 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4258999999999994e-05 2023-10-08T06:58:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.196727+0000", 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036139280000000002 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211643+0000", 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014915464999999999 2023-10-08T06:58:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211678+0000", 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5250999999999998e-05 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211702+0000", 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4559999999999999e-05 2023-10-08T06:58:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67171 5.0 5:05189d13:::benchmark_data_smithi037_101035_object67170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.0181345840000002, 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017609287000000001, 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67171 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194432+0000", 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194537+0000", 2023-10-08T06:58:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104639 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194547+0000", 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0679000000000001e-05 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194555+0000", 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9929999999999995e-06 2023-10-08T06:58:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194604+0000", 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8519000000000001e-05 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194738+0000", 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013386800000000001 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194881+0000", 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014271600000000001 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.197760+0000", 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028799289999999998 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211976+0000", 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014216042999999999 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.212008+0000", 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1637999999999998e-05 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.212041+0000", 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2443000000000001e-05 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67173 5.4 5:27ad57f3:::benchmark_data_smithi037_101035_object67172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.0179961119999996, 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020388758, 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67173 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0900000000000001e-07 2023-10-08T06:58:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194639+0000", 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8362999999999996e-05 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194646+0000", 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194650+0000", 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9689999999999996e-06 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194681+0000", 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331999999999997e-05 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194756+0000", 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5181999999999999e-05 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194838+0000", 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.196934+0000", 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020954039999999999 2023-10-08T06:58:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214859+0000", 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017924944000000002 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214918+0000", 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9036000000000002e-05 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214958+0000", 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0771e-05 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67186 5.4 5:27f4af17:::benchmark_data_smithi037_101035_object67185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.0123189879999996, 2023-10-08T06:58:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017355939000000001, 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67186 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200248+0000", 2023-10-08T06:58:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200336+0000", 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8630999999999999e-05 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200346+0000", 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0076e-05 2023-10-08T06:58:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200355+0000", 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7839999999999992e-06 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202037+0000", 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016818169999999999 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202178+0000", 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014072100000000001 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202346+0000", 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016863300000000001 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.204741+0000", 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023946530000000001 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217534+0000", 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012793176999999999 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217577+0000", 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2577999999999998e-05 2023-10-08T06:58:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217603+0000", 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6168000000000001e-05 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69972 5.0 5:06d44cab:::benchmark_data_smithi037_101035_object69971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.7057121200000003, 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0179822, 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69972 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.75e-07 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506965+0000", 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110828 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506973+0000", 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7600000000000002e-06 2023-10-08T06:58:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506979+0000", 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7780000000000004e-06 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514316+0000", 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073367570000000002 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514417+0000", 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101179 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514748+0000", 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000331694 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.520281+0000", 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055330290000000001 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524775+0000", 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044937609999999998 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524813+0000", 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7645999999999998e-05 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524836+0000", 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3093000000000001e-05 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:79243 5.0 5:0d107c00:::benchmark_data_smithi037_101035_object79242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.883142+0000", 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.32942354000000001, 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018395644999999999, 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 79243 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883142+0000", 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883142+0000", 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883143+0000", 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6599999999999996e-07 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883172+0000", 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9546000000000001e-05 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883179+0000", 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3210000000000001e-06 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883183+0000", 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2679999999999996e-06 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.887069+0000", 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038860990000000001 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.887172+0000", 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102938 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.887265+0000", 2023-10-08T06:58:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2697999999999999e-05 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.895784+0000", 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085190049999999996 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.901446+0000", 2023-10-08T06:58:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056619030000000002 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.901499+0000", 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3548000000000003e-05 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.901538+0000", 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8753e-05 2023-10-08T06:58:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:12.359 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:12.360 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:12.359+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:12.361 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:12.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 32 16 80271 80255 156.735 135.375 0.00837134 0.0063772 2023-10-08T06:58:12.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:12.461+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:12.538 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:12.538 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:80631 5.6 e38/20 5:6805fbfa:::benchmark_data_smithi037_101035_object80630:head v 38'5108, mlcod=38'5105)", 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.533455+0000", 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0043040600000000002, 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043237049999999997, 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533455+0000", 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533455+0000", 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533455+0000", 2023-10-08T06:58:12.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8500000000000001e-07 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533575+0000", 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119727 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533585+0000", 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4720000000000001e-06 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533591+0000", 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4289999999999998e-06 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533630+0000", 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8668999999999999e-05 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533643+0000", 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2843999999999999e-05 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:80636 5.2 5:48b6c345:::benchmark_data_smithi037_101035_object80635:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.533705+0000", 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0040541659999999997, 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041194079999999998, 2023-10-08T06:58:12.543 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 80636 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533705+0000", 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533705+0000", 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533706+0000", 2023-10-08T06:58:12.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1710000000000001e-06 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533793+0000", 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6805999999999995e-05 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533817+0000", 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4627e-05 2023-10-08T06:58:12.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533838+0000", 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0639e-05 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533893+0000", 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5089000000000001e-05 2023-10-08T06:58:12.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.534029+0000", 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013636599999999999 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.534177+0000", 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014793 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.548 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:80638 5.1 5:86f9390e:::benchmark_data_smithi037_101035_object80637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.533858+0000", 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0039008319999999999, 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040141939999999996, 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:12.549 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 80638 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533858+0000", 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533858+0000", 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533859+0000", 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.68e-07 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533891+0000", 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2023000000000002e-05 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533899+0000", 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9999999999999996e-06 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533905+0000", 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.533950+0000", 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.494e-05 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.534039+0000", 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9907000000000005e-05 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.534128+0000", 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8998000000000004e-05 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:80641 5.9 5:943a26f8:::benchmark_data_smithi037_101035_object80640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.536197+0000", 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0015615539999999999, 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001719117, 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.555 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 80641 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536197+0000", 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536197+0000", 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536198+0000", 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6099999999999999e-07 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536250+0000", 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1848000000000002e-05 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536260+0000", 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0002e-05 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536268+0000", 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7619999999999995e-06 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536319+0000", 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1465999999999998e-05 2023-10-08T06:58:12.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536419+0000", 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9240999999999994e-05 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:12.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536512+0000", 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3448000000000004e-05 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:80639 5.5 e38/20 5:a70330f6:::benchmark_data_smithi037_101035_object80638:head v 38'4986, mlcod=38'4983)", 2023-10-08T06:58:12.561 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.536658+0000", 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001100983, 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0013017630000000001, 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536658+0000", 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536658+0000", 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536658+0000", 2023-10-08T06:58:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.72e-07 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536692+0000", 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3704999999999997e-05 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536702+0000", 2023-10-08T06:58:12.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8660000000000001e-06 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536708+0000", 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1129999999999997e-06 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536755+0000", 2023-10-08T06:58:12.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7284999999999999e-05 2023-10-08T06:58:12.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536780+0000", 2023-10-08T06:58:12.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4584999999999999e-05 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:80642 5.1 5:8dde157f:::benchmark_data_smithi037_101035_object80641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.536758+0000", 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0010012549999999999, 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012385320000000001, 2023-10-08T06:58:12.567 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 80642 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536758+0000", 2023-10-08T06:58:12.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536758+0000", 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536758+0000", 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7899999999999997e-07 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536815+0000", 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6153000000000003e-05 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536827+0000", 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2044e-05 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536835+0000", 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9219999999999997e-06 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536874+0000", 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9128000000000002e-05 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537022+0000", 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148531 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537168+0000", 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014598700000000001 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:80644 5.f 5:fa6ce158:::benchmark_data_smithi037_101035_object80643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.536904+0000", 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00085536800000000001, 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001136139, 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.573 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 80644 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536904+0000", 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536904+0000", 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536904+0000", 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536980+0000", 2023-10-08T06:58:12.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6129000000000002e-05 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.536991+0000", 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0291e-05 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537002+0000", 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0925e-05 2023-10-08T06:58:12.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537053+0000", 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1542999999999998e-05 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537173+0000", 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120067 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537323+0000", 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000149481 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:80645 5.7 5:ec438c8f:::benchmark_data_smithi037_101035_object80644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:12.537020+0000", 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00073926799999999996, 2023-10-08T06:58:12.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0010649629999999999, 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 80645 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537020+0000", 2023-10-08T06:58:12.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537020+0000", 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537020+0000", 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3900000000000005e-07 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:12.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537053+0000", 2023-10-08T06:58:12.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2396e-05 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537062+0000", 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2250000000000006e-06 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537069+0000", 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0360000000000001e-06 2023-10-08T06:58:12.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537108+0000", 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9520000000000001e-05 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537225+0000", 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011624399999999999 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:12.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:12.537366+0000", 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014172300000000001 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 8 2023-10-08T06:58:12.584 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:12.586 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:12.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:12.585+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:12.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:12.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:12.687+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:12.768 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:12.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:12.788+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:12.789 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:12.802 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:12.802 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:12.810 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2023-10-08T06:58:12.811 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:12.811 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:12.811 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T06:58:12.815 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:12.889 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:12.888+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:12.989 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:12.989+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:13.033 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:13.033 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:13.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:13.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:13.090+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:13.191 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:13.190+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:13.226 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:13.226 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:13.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:13.325 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:13.324+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:13.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:58:13.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 33 16 82417 82401 156.049 134.125 0.00908221 0.0064055 2023-10-08T06:58:13.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:13.393+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:13.453 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:13.453 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:13.468 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:13.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:13.494+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:13.595 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:13.594+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:13.658 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:13.658 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:13.672 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:13.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:13.716+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:13.798 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:13.797+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:13.849 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:13.849 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:13.865 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:13.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:13.906+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:14.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:14.000+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:14.082 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:14.082 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:14.097 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:14.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:14.139+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:14.202 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:14.201+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:14.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:14.303+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:14.313 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:14.314 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:14.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:58:14.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 34 16 84376 84360 155.061 122.438 0.0101309 0.00644249 2023-10-08T06:58:14.378 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T06:58:14.404 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:14.403+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:14.464 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:14.464 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:14.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:14.488 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-08T06:58:14.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:14.506+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:14.606 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:14.606+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:14.641 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:14.641 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:14.651 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:14.735 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:14.734+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:14.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:14.808+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:14.818 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:14.818 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:14.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:14.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:14.909 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:14.908+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:14.960 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:14.960 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:14.970 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:14.978 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:14.998 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:15.001 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:15.001 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:15.010 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:15.010+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:15.097 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:15.098 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:15.107 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:15.111 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:15.111+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:15.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:15.211+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:14433 5.6 e23/20 5:62e53c00:::benchmark_data_smithi037_101035_object14432:head v 23'894, mlcod=23'891)", 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:15.237 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.127551238999999, 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016857810000000001, 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107301+0000", 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107358+0000", 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6091000000000002e-05 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107373+0000", 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5750999999999999e-05 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107381+0000", 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2389999999999996e-06 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107423+0000", 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2477e-05 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.107435+0000", 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2232000000000001e-05 2023-10-08T06:58:15.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124119+0000", 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01668379 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:44.124159+0000", 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9478999999999999e-05 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.361297498999999, 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.243 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:15.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:15.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:15.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:15.250 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.354463111000001, 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.251 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:15.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:15.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:15.258 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.258 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.258 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:50899 5.f 5:f78f4ca7:::benchmark_data_smithi037_101035_object50898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.448659588000002, 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016993019000000002, 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.259 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.260 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.261 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 50899 2023-10-08T06:58:15.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.261 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786192+0000", 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786193+0000", 2023-10-08T06:58:15.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4799999999999998e-07 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786222+0000", 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9499e-05 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786232+0000", 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8830000000000001e-06 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.786238+0000", 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1680000000000001e-06 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789392+0000", 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031532930000000002 2023-10-08T06:58:15.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789506+0000", 2023-10-08T06:58:15.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114697 2023-10-08T06:58:15.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.789630+0000", 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012329100000000001 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.794834+0000", 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052047309999999998 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803096+0000", 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082619519999999995 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803149+0000", 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.304e-05 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:57.803185+0000", 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5917000000000002e-05 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57920 5.2 5:4b015bf8:::benchmark_data_smithi037_101035_object57919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:15.268 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.33504746, 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017795800000000001, 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57920 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:15.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899805+0000", 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900121+0000", 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031621900000000002 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900127+0000", 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2859999999999996e-06 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900131+0000", 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4369999999999999e-06 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906312+0000", 2023-10-08T06:58:15.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061814790000000001 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906420+0000", 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010733700000000001 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906504+0000", 2023-10-08T06:58:15.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4794000000000002e-05 2023-10-08T06:58:15.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.909717+0000", 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032127689999999999 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917514+0000", 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077965819999999998 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917559+0000", 2023-10-08T06:58:15.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5618999999999998e-05 2023-10-08T06:58:15.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917600+0000", 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0908999999999997e-05 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57922 5.2 5:47786b04:::benchmark_data_smithi037_101035_object57921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.334716089, 2023-10-08T06:58:15.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017617088999999999, 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57922 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:15.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9700000000000003e-07 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900176+0000", 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0093999999999999e-05 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900185+0000", 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.918e-06 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900189+0000", 2023-10-08T06:58:15.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1810000000000003e-06 2023-10-08T06:58:15.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.907989+0000", 2023-10-08T06:58:15.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078000559999999997 2023-10-08T06:58:15.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908154+0000", 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016444300000000001 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908326+0000", 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017191999999999999 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.911360+0000", 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003033956 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917653+0000", 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062937280000000002 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917719+0000", 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5865999999999996e-05 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917753+0000", 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3630000000000002e-05 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58515 5.7 5:e5bd311c:::benchmark_data_smithi037_101035_object58514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:15.286 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:15.286 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.063256537000001, 2023-10-08T06:58:15.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019075253, 2023-10-08T06:58:15.286 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.286 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.286 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.287 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.287 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.287 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58515 2023-10-08T06:58:15.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.287 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171596+0000", 2023-10-08T06:58:15.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171630+0000", 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4464000000000001e-05 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171637+0000", 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171641+0000", 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6030000000000001e-06 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177693+0000", 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060519090000000003 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177783+0000", 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0705000000000007e-05 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177924+0000", 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140815 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181053+0000", 2023-10-08T06:58:15.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003129204 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190584+0000", 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095309550000000007 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190633+0000", 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8715999999999999e-05 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190671+0000", 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58528 5.f 5:fc8a38c2:::benchmark_data_smithi037_101035_object58527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.057025299999999, 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016426361, 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.294 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58528 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177827+0000", 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9500000000000001e-07 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177933+0000", 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000106019 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177959+0000", 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5918000000000002e-05 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177975+0000", 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5333e-05 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181064+0000", 2023-10-08T06:58:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030889899999999998 2023-10-08T06:58:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181233+0000", 2023-10-08T06:58:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016972999999999999 2023-10-08T06:58:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181383+0000", 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014949200000000001 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.184425+0000", 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030423490000000002 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194169+0000", 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097436050000000007 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194217+0000", 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7927999999999999e-05 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.194253+0000", 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6202000000000003e-05 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67177 5.7 5:eceead93:::benchmark_data_smithi037_101035_object67176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0401333570000002, 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018827831, 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67177 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194808+0000", 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8851999999999996e-05 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194813+0000", 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5380000000000002e-06 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194817+0000", 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6219999999999998e-06 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196266+0000", 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014492940000000001 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196360+0000", 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3331999999999993e-05 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196452+0000", 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2529999999999997e-05 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197982+0000", 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015301030000000001 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213446+0000", 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015463563 2023-10-08T06:58:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213510+0000", 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3689999999999995e-05 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213546+0000", 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6828e-05 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0400215320000008, 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67184 5.2 5:4ca6e80a:::benchmark_data_smithi037_101035_object67183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0362665500000006, 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017158867000000001, 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67184 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198586+0000", 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8899999999999998e-07 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198642+0000", 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5687999999999999e-05 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198653+0000", 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1345000000000001e-05 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198661+0000", 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.233e-06 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198709+0000", 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8390999999999998e-05 2023-10-08T06:58:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198786+0000", 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6852000000000002e-05 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198891+0000", 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105643 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.200969+0000", 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020771600000000002 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215641+0000", 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014672304000000001 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215709+0000", 2023-10-08T06:58:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8456999999999999e-05 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215744+0000", 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4904999999999999e-05 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67436 5.7 5:e2f7cac5:::benchmark_data_smithi037_101035_object67435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.9079547629999993, 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017493584, 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67436 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326898+0000", 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.569999999999999e-07 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326935+0000", 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7011999999999997e-05 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326946+0000", 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0446e-05 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326953+0000", 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3100000000000003e-06 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330129+0000", 2023-10-08T06:58:15.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003176183 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330249+0000", 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119702 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330391+0000", 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014252399999999999 2023-10-08T06:58:15.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.336180+0000", 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057887770000000002 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344304+0000", 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081237419999999998 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344349+0000", 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4866e-05 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344391+0000", 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2064999999999998e-05 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.330 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68298 5.9 5:920090b0:::benchmark_data_smithi037_101035_object68297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5087471749999999, 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017738614, 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.331 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68298 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:15.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726106+0000", 2023-10-08T06:58:15.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0279999999999999e-06 2023-10-08T06:58:15.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726184+0000", 2023-10-08T06:58:15.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8300000000000006e-05 2023-10-08T06:58:15.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726196+0000", 2023-10-08T06:58:15.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.201e-05 2023-10-08T06:58:15.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726203+0000", 2023-10-08T06:58:15.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1029999999999996e-06 2023-10-08T06:58:15.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726266+0000", 2023-10-08T06:58:15.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2346000000000002e-05 2023-10-08T06:58:15.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726431+0000", 2023-10-08T06:58:15.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016508899999999999 2023-10-08T06:58:15.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726617+0000", 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018605299999999999 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733386+0000", 2023-10-08T06:58:15.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067696600000000003 2023-10-08T06:58:15.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743760+0000", 2023-10-08T06:58:15.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010373339000000001 2023-10-08T06:58:15.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743814+0000", 2023-10-08T06:58:15.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4151999999999999e-05 2023-10-08T06:58:15.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743843+0000", 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9533999999999999e-05 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68304 5.1 5:836c7fad:::benchmark_data_smithi037_101035_object68303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5052551130000005, 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016799999999999999, 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68304 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.343 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729597+0000", 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729628+0000", 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0830000000000001e-05 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729642+0000", 2023-10-08T06:58:15.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3570999999999999e-05 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.729649+0000", 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4309999999999997e-06 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731268+0000", 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001619241 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731382+0000", 2023-10-08T06:58:15.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113522 2023-10-08T06:58:15.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.731534+0000", 2023-10-08T06:58:15.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015160099999999999 2023-10-08T06:58:15.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733712+0000", 2023-10-08T06:58:15.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021787970000000001 2023-10-08T06:58:15.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746333+0000", 2023-10-08T06:58:15.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012620350000000001 2023-10-08T06:58:15.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746375+0000", 2023-10-08T06:58:15.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2151999999999999e-05 2023-10-08T06:58:15.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.746397+0000", 2023-10-08T06:58:15.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1943999999999999e-05 2023-10-08T06:58:15.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.351 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.352 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:70072 5.2 5:4f26b367:::benchmark_data_smithi037_101035_object70071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:15.352 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:15.352 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 7.6754224659999997, 2023-10-08T06:58:15.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017011773000000001, 2023-10-08T06:58:15.353 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.353 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.353 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.353 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.353 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.354 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 70072 2023-10-08T06:58:15.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.354 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:15.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559430+0000", 2023-10-08T06:58:15.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.82e-07 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559478+0000", 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7802000000000001e-05 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559487+0000", 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1249999999999999e-06 2023-10-08T06:58:15.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559500+0000", 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3343000000000001e-05 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562403+0000", 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029030760000000001 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562544+0000", 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014036800000000001 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562717+0000", 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017288899999999999 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.564640+0000", 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001923237 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576345+0000", 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011704786 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576401+0000", 2023-10-08T06:58:15.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6697999999999998e-05 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576441+0000", 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9867000000000003e-05 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:15.360 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5443186469999999, 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.361 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:15.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.362 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:15.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:15.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:15.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:15.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:15.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:15.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:15.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:15.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:15.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:15.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:15.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:15.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:15.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:15.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:15.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:15.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:15.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:15.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:15.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:15.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:15.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:15.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.373 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.374 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77019 5.2 5:44f51aeb:::benchmark_data_smithi037_101035_object77018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:15.374 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:15.374 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.386418097, 2023-10-08T06:58:15.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016770778, 2023-10-08T06:58:15.375 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.375 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.375 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.375 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.375 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.376 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77019 2023-10-08T06:58:15.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.376 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:15.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:15.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848434+0000", 2023-10-08T06:58:15.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3e-07 2023-10-08T06:58:15.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848516+0000", 2023-10-08T06:58:15.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1154000000000003e-05 2023-10-08T06:58:15.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848525+0000", 2023-10-08T06:58:15.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6719999999999999e-06 2023-10-08T06:58:15.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.848530+0000", 2023-10-08T06:58:15.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0089999999999998e-06 2023-10-08T06:58:15.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.851949+0000", 2023-10-08T06:58:15.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034188679999999998 2023-10-08T06:58:15.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.852059+0000", 2023-10-08T06:58:15.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010998 2023-10-08T06:58:15.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:15.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.852199+0000", 2023-10-08T06:58:15.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000139596 2023-10-08T06:58:15.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.855699+0000", 2023-10-08T06:58:15.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035000809999999999 2023-10-08T06:58:15.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.865129+0000", 2023-10-08T06:58:15.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094301469999999998 2023-10-08T06:58:15.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.865178+0000", 2023-10-08T06:58:15.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9159000000000001e-05 2023-10-08T06:58:15.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.865205+0000", 2023-10-08T06:58:15.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6482000000000002e-05 2023-10-08T06:58:15.388 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.388 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.388 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.388 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77323 5.f 5:f7d39f88:::benchmark_data_smithi037_101035_object77322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:15.389 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:15.389 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.2469991389999997, 2023-10-08T06:58:15.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016677328000000002, 2023-10-08T06:58:15.389 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.389 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.390 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.390 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.390 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.390 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77323 2023-10-08T06:58:15.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.391 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:15.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987853+0000", 2023-10-08T06:58:15.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987854+0000", 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0800000000000003e-07 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987924+0000", 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9880000000000002e-05 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987933+0000", 2023-10-08T06:58:15.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5999999999999996e-06 2023-10-08T06:58:15.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.987939+0000", 2023-10-08T06:58:15.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3970000000000002e-06 2023-10-08T06:58:15.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989195+0000", 2023-10-08T06:58:15.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001256131 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989315+0000", 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012042199999999999 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989478+0000", 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016272300000000001 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.993935+0000", 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044572429999999996 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.004455+0000", 2023-10-08T06:58:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010519957 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.004498+0000", 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2907000000000001e-05 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.004530+0000", 2023-10-08T06:58:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2159999999999997e-05 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:77326 5.d 5:bcd15c70:::benchmark_data_smithi037_101035_object77325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.2453559209999998, 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016961079, 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 77326 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989496+0000", 2023-10-08T06:58:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989497+0000", 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9100000000000002e-07 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989541+0000", 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4508999999999997e-05 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989550+0000", 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3939999999999996e-06 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989555+0000", 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4870000000000002e-06 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989608+0000", 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2908000000000002e-05 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989712+0000", 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103788 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.989799+0000", 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6812999999999997e-05 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.993980+0000", 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041815369999999999 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.006381+0000", 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012400873 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.006417+0000", 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5315999999999999e-05 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.006457+0000", 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0562999999999998e-05 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4555.0:77582 5.c e37/20 5:30e31b53:::benchmark_data_smithi037_101035_object77581:head v 37'5042, mlcod=37'5040)", 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:11.114301+0000", 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.120550573, 2023-10-08T06:58:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016636016, 2023-10-08T06:58:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114301+0000", 2023-10-08T06:58:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114301+0000", 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114302+0000", 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114357+0000", 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4852000000000003e-05 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114366+0000", 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3680000000000008e-06 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114373+0000", 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8360000000000003e-06 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114434+0000", 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1180999999999996e-05 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.114457+0000", 2023-10-08T06:58:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2322000000000001e-05 2023-10-08T06:58:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.130893+0000", 2023-10-08T06:58:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016436624 2023-10-08T06:58:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:11.130937+0000", 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4095999999999999e-05 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:15.413 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:15.414 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 35 16 84384 84368 150.644 0.5 1.02944 0.00653916 2023-10-08T06:58:15.415 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:15.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:15.413+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:15.515 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:15.515+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:15.596 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84951 5.0 5:057c36cf:::benchmark_data_smithi037_101035_object84950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.589994+0000", 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.005506019, 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055371810000000004, 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84951 2023-10-08T06:58:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.589994+0000", 2023-10-08T06:58:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.589994+0000", 2023-10-08T06:58:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.589995+0000", 2023-10-08T06:58:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2099999999999995e-07 2023-10-08T06:58:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.590065+0000", 2023-10-08T06:58:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0122000000000004e-05 2023-10-08T06:58:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.590076+0000", 2023-10-08T06:58:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1596999999999999e-05 2023-10-08T06:58:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.590092+0000", 2023-10-08T06:58:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5846999999999999e-05 2023-10-08T06:58:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.590157+0000", 2023-10-08T06:58:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5006999999999996e-05 2023-10-08T06:58:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.590293+0000", 2023-10-08T06:58:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000135819 2023-10-08T06:58:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84953 5.4 5:2279d385:::benchmark_data_smithi037_101035_object84952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.591326+0000", 2023-10-08T06:58:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0041738369999999997, 2023-10-08T06:58:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042873470000000004, 2023-10-08T06:58:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84953 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591326+0000", 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591326+0000", 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591327+0000", 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9800000000000003e-07 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591392+0000", 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5772000000000007e-05 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591407+0000", 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4936999999999999e-05 2023-10-08T06:58:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591415+0000", 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4909999999999999e-06 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591460+0000", 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5371000000000003e-05 2023-10-08T06:58:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591571+0000", 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111279 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84954 5.0 5:0b933b2a:::benchmark_data_smithi037_101035_object84953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.591433+0000", 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0040672620000000003, 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042577479999999996, 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84954 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591433+0000", 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591433+0000", 2023-10-08T06:58:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591433+0000", 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3200000000000005e-07 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591491+0000", 2023-10-08T06:58:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7448000000000003e-05 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591499+0000", 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7090000000000008e-06 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591506+0000", 2023-10-08T06:58:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2750000000000001e-06 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592722+0000", 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001216801 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592870+0000", 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147131 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84956 5.4 5:2d92eeb2:::benchmark_data_smithi037_101035_object84955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.591525+0000", 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0039749090000000004, 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042358659999999996, 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84956 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591525+0000", 2023-10-08T06:58:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591525+0000", 2023-10-08T06:58:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591525+0000", 2023-10-08T06:58:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8500000000000001e-07 2023-10-08T06:58:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591579+0000", 2023-10-08T06:58:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3922999999999999e-05 2023-10-08T06:58:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591589+0000", 2023-10-08T06:58:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6600000000000007e-06 2023-10-08T06:58:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.591596+0000", 2023-10-08T06:58:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5849999999999996e-06 2023-10-08T06:58:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594283+0000", 2023-10-08T06:58:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026878330000000001 2023-10-08T06:58:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594376+0000", 2023-10-08T06:58:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454000000000006e-05 2023-10-08T06:58:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:84955 5.d e40/32 5:b575101c:::benchmark_data_smithi037_101035_object84954:head v 40'5177, mlcod=40'5175)", 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.592538+0000", 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0029622730000000001, 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032900889999999999, 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592538+0000", 2023-10-08T06:58:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592538+0000", 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592538+0000", 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8000000000000005e-07 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592598+0000", 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9219999999999999e-05 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592608+0000", 2023-10-08T06:58:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0492999999999999e-05 2023-10-08T06:58:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592613+0000", 2023-10-08T06:58:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3700000000000003e-06 2023-10-08T06:58:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592686+0000", 2023-10-08T06:58:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2213999999999997e-05 2023-10-08T06:58:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592706+0000", 2023-10-08T06:58:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0052e-05 2023-10-08T06:58:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:84957 5.9 e40/20 5:992a293a:::benchmark_data_smithi037_101035_object84956:head v 40'5272, mlcod=40'5268)", 2023-10-08T06:58:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.592633+0000", 2023-10-08T06:58:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0028663019999999998, 2023-10-08T06:58:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032510939999999999, 2023-10-08T06:58:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592633+0000", 2023-10-08T06:58:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592633+0000", 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592634+0000", 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1600000000000002e-07 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592668+0000", 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3933000000000002e-05 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592676+0000", 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6989999999999992e-06 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592682+0000", 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8300000000000001e-06 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592721+0000", 2023-10-08T06:58:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8401e-05 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.592738+0000", 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7346999999999998e-05 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84960 5.a 5:5ea20e0d:::benchmark_data_smithi037_101035_object84959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.594370+0000", 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001129683, 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001575103, 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84960 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594370+0000", 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594370+0000", 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594371+0000", 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.144e-06 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594475+0000", 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104257 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594486+0000", 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0783e-05 2023-10-08T06:58:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594502+0000", 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.596e-05 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594563+0000", 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0912000000000002e-05 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594691+0000", 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012773600000000001 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84961 5.8 5:123109e5:::benchmark_data_smithi037_101035_object84960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.594536+0000", 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00096397400000000004, 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014777150000000001, 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84961 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594536+0000", 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594536+0000", 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594537+0000", 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1299999999999999e-07 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594584+0000", 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7618999999999999e-05 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594593+0000", 2023-10-08T06:58:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0720000000000006e-06 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594600+0000", 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.455e-06 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594809+0000", 2023-10-08T06:58:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020976799999999999 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594934+0000", 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012429699999999999 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84962 5.8 5.8aaa2d08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.594614+0000", 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00088538799999999997, 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014607699999999999, 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84962 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594614+0000", 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594614+0000", 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594615+0000", 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0500000000000003e-07 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594649+0000", 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.358e-05 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594657+0000", 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1009999999999992e-06 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594663+0000", 2023-10-08T06:58:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9789999999999998e-06 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:84964 5.4 5.92195484 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.594807+0000", 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00069256799999999996, 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013242779999999999, 2023-10-08T06:58:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 84964 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594807+0000", 2023-10-08T06:58:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594807+0000", 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594808+0000", 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6300000000000004e-07 2023-10-08T06:58:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594872+0000", 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4086999999999998e-05 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594882+0000", 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7140000000000005e-06 2023-10-08T06:58:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594889+0000", 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2080000000000003e-06 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:84959 5.f e40/20 5:f4f36f7b:::benchmark_data_smithi037_101035_object84958:head v 40'5413, mlcod=40'5410)", 2023-10-08T06:58:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:15.594959+0000", 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00054126000000000001, 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012632399999999999, 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594959+0000", 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594959+0000", 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.594959+0000", 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6300000000000005e-07 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.595008+0000", 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8637000000000002e-05 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.595014+0000", 2023-10-08T06:58:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6619999999999999e-06 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.595019+0000", 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.639e-06 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.595059+0000", 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9564999999999998e-05 2023-10-08T06:58:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:15.595074+0000", 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5065999999999999e-05 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 11 2023-10-08T06:58:15.662 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:15.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:15.664 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:15.662+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:15.764 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:15.763+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:15.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:15.864+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:15.877 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:15.877 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:15.877 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:15.877 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:15.877 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:15.891 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:15.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:15.965+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:16.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:16.066+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:16.112 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:16.112 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:16.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:16.112 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:16.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.112 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.112 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.243828718, 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:16.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:16.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.241393962, 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.120 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:58:16.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:58:16.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.126 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.241120499000001, 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:16.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:16.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.240980728, 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.134 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:58:16.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.240893873000001, 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.142 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:58:16.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:58:16.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:58:16.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.240832964999999, 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:58:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:58:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:58:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.240723766999999, 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:58:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.238128208999999, 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.235551461, 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:58:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:58:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:58:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51442 5.8 5:128c17d7:::benchmark_data_smithi037_101035_object51441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.083902385999998, 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018100852000000001, 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51442 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025144+0000", 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025179+0000", 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4416999999999999e-05 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025186+0000", 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.452e-06 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.025193+0000", 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.674e-06 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027741+0000", 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025483200000000002 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027823+0000", 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1264e-05 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.027908+0000", 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5137999999999997e-05 2023-10-08T06:58:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030945+0000", 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030372659999999998 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043185+0000", 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01224039 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043222+0000", 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.043245+0000", 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2138999999999999e-05 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51448 5.8 5:12d8ea5b:::benchmark_data_smithi037_101035_object51447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.082553816000001, 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018610680000000001, 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51448 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026492+0000", 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026493+0000", 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2500000000000004e-07 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026551+0000", 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7887999999999999e-05 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026568+0000", 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886000000000001e-05 2023-10-08T06:58:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026577+0000", 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6339999999999996e-06 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028861+0000", 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022836639999999999 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028971+0000", 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001094 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029055+0000", 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4484e-05 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032150+0000", 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030947420000000002 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045032+0000", 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012882482000000001 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045068+0000", 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5799000000000001e-05 2023-10-08T06:58:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.045103+0000", 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4876000000000003e-05 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51449 5.0 5:078c55bb:::benchmark_data_smithi037_101035_object51448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.082453137000002, 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019798169000000001, 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51449 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026593+0000", 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2800000000000002e-07 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026615+0000", 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1171000000000001e-05 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026620+0000", 2023-10-08T06:58:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6389999999999997e-06 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.026624+0000", 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7500000000000001e-06 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028853+0000", 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002228701 2023-10-08T06:58:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.028993+0000", 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140741 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029106+0000", 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011309100000000001 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.031364+0000", 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022572999999999998 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046335+0000", 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014971572000000001 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046369+0000", 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3778000000000001e-05 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046391+0000", 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1997999999999998e-05 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:51451 5.8 5:1f80398c:::benchmark_data_smithi037_101035_object51450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.079905705000002, 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017441129999999999, 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51451 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029140+0000", 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029141+0000", 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.78e-07 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029229+0000", 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7996000000000002e-05 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029241+0000", 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2111e-05 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029250+0000", 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7819999999999999e-06 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.029939+0000", 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00068897900000000005 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030024+0000", 2023-10-08T06:58:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4802999999999994e-05 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.030108+0000", 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4419000000000006e-05 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.032167+0000", 2023-10-08T06:58:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020585299999999998 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046534+0000", 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014367322 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046563+0000", 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9286999999999999e-05 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:58.046581+0000", 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8023e-05 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:60821 5.0 5:09632156:::benchmark_data_smithi037_101035_object60820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.88249736, 2023-10-08T06:58:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017726374, 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 60821 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226549+0000", 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226550+0000", 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0200000000000001e-07 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226617+0000", 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7148000000000002e-05 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226627+0000", 2023-10-08T06:58:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0030000000000001e-05 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.226635+0000", 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8679999999999999e-06 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234547+0000", 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079128459999999994 2023-10-08T06:58:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234636+0000", 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8665999999999994e-05 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.234726+0000", 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0251e-05 2023-10-08T06:58:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.238072+0000", 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033451829999999998 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244212+0000", 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006140899 2023-10-08T06:58:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244247+0000", 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4879000000000003e-05 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:03.244275+0000", 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7801999999999999e-05 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67165 5.8 5:1d063b33:::benchmark_data_smithi037_101035_object67164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9198809929999996, 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022537402000000002, 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67165 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189166+0000", 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2999999999999999e-07 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189258+0000", 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2398999999999994e-05 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189268+0000", 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3300000000000005e-06 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189275+0000", 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.192938+0000", 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036629380000000001 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193029+0000", 2023-10-08T06:58:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0659000000000001e-05 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193113+0000", 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4258999999999994e-05 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.196727+0000", 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036139280000000002 2023-10-08T06:58:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211643+0000", 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014915464999999999 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211678+0000", 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5250999999999998e-05 2023-10-08T06:58:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211702+0000", 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4559999999999999e-05 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67171 5.0 5:05189d13:::benchmark_data_smithi037_101035_object67170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9146148039999993, 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017609287000000001, 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67171 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194431+0000", 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194432+0000", 2023-10-08T06:58:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194537+0000", 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104639 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194547+0000", 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0679000000000001e-05 2023-10-08T06:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194555+0000", 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9929999999999995e-06 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194604+0000", 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8519000000000001e-05 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194738+0000", 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013386800000000001 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194881+0000", 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014271600000000001 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.197760+0000", 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028799289999999998 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211976+0000", 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014216042999999999 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.212008+0000", 2023-10-08T06:58:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1637999999999998e-05 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.212041+0000", 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2443000000000001e-05 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67173 5.4 5:27ad57f3:::benchmark_data_smithi037_101035_object67172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9144763319999996, 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020388758, 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67173 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194570+0000", 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0900000000000001e-07 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194639+0000", 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8362999999999996e-05 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194646+0000", 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194650+0000", 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9689999999999996e-06 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194681+0000", 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331999999999997e-05 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194756+0000", 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5181999999999999e-05 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.194838+0000", 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.196934+0000", 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020954039999999999 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214859+0000", 2023-10-08T06:58:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017924944000000002 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214918+0000", 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9036000000000002e-05 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.214958+0000", 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0771e-05 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67186 5.4 5:27f4af17:::benchmark_data_smithi037_101035_object67185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9087992079999996, 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017355939000000001, 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67186 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200247+0000", 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200248+0000", 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200336+0000", 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8630999999999999e-05 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200346+0000", 2023-10-08T06:58:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0076e-05 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.200355+0000", 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7839999999999992e-06 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202037+0000", 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016818169999999999 2023-10-08T06:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202178+0000", 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014072100000000001 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.202346+0000", 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016863300000000001 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.204741+0000", 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023946530000000001 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217534+0000", 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012793176999999999 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217577+0000", 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2577999999999998e-05 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.217603+0000", 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6168000000000001e-05 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:69972 5.0 5:06d44cab:::benchmark_data_smithi037_101035_object69971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6021923400000002, 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0179822, 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 69972 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506854+0000", 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.75e-07 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506965+0000", 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110828 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506973+0000", 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7600000000000002e-06 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.506979+0000", 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7780000000000004e-06 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514316+0000", 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073367570000000002 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514417+0000", 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101179 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.514748+0000", 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000331694 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.520281+0000", 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055330290000000001 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524775+0000", 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044937609999999998 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524813+0000", 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7645999999999998e-05 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:07.524836+0000", 2023-10-08T06:58:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3093000000000001e-05 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:79243 5.0 5:0d107c00:::benchmark_data_smithi037_101035_object79242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:11.883142+0000", 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.2259037599999996, 2023-10-08T06:58:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018395644999999999, 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 79243 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883142+0000", 2023-10-08T06:58:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883142+0000", 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883143+0000", 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6599999999999996e-07 2023-10-08T06:58:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883172+0000", 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9546000000000001e-05 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883179+0000", 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3210000000000001e-06 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.883183+0000", 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2679999999999996e-06 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.887069+0000", 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038860990000000001 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.887172+0000", 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102938 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.887265+0000", 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2697999999999999e-05 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.895784+0000", 2023-10-08T06:58:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085190049999999996 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.901446+0000", 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056619030000000002 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.901499+0000", 2023-10-08T06:58:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3548000000000003e-05 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:11.901538+0000", 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8753e-05 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:16.257 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:16.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:16.257+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:16.258 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:16.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:58:16.358 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:16.357+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:16.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 36 16 86862 86846 150.762 154.875 0.00772701 0.00663037 2023-10-08T06:58:16.447 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:16.447 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87016 5.6 5:69b8086b:::benchmark_data_smithi037_101035_object87015:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.441325+0000", 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0050160489999999999, 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050521569999999998, 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.448 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87016 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441325+0000", 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441325+0000", 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441326+0000", 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.09e-07 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441402+0000", 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5465999999999999e-05 2023-10-08T06:58:16.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441409+0000", 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5399999999999998e-06 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441414+0000", 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1320000000000002e-06 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441449+0000", 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4700000000000003e-05 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441538+0000", 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8792e-05 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87017 5.c 5:36251092:::benchmark_data_smithi037_101035_object87016:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.441429+0000", 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.004912184, 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049983550000000003, 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87017 2023-10-08T06:58:16.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441429+0000", 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441429+0000", 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441430+0000", 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0900000000000001e-07 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441503+0000", 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2776999999999998e-05 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441508+0000", 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.429e-06 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441512+0000", 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0339999999999998e-06 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441556+0000", 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3476999999999997e-05 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441671+0000", 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115058 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87019 5.d 5:ba6f7e99:::benchmark_data_smithi037_101035_object87018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.441526+0000", 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0048153359999999999, 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049434860000000004, 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.458 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87019 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441526+0000", 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441526+0000", 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441527+0000", 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7800000000000002e-07 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441565+0000", 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8841999999999998e-05 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441573+0000", 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7100000000000007e-06 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441579+0000", 2023-10-08T06:58:16.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441651+0000", 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2101999999999995e-05 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441780+0000", 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012858300000000001 2023-10-08T06:58:16.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441926+0000", 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014598200000000001 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87020 5.5 5:a8425f0d:::benchmark_data_smithi037_101035_object87019:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.441596+0000", 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0047459889999999999, 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049179419999999998, 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87020 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.464 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441596+0000", 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441596+0000", 2023-10-08T06:58:16.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441596+0000", 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4300000000000003e-07 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441647+0000", 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1304999999999998e-05 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441655+0000", 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441663+0000", 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6699999999999994e-06 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441777+0000", 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113668 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441913+0000", 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013620599999999999 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.468 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87021 5.d 5:b7072902:::benchmark_data_smithi037_101035_object87020:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.441675+0000", 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00466644, 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048790860000000004, 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87021 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441675+0000", 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441675+0000", 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441676+0000", 2023-10-08T06:58:16.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441712+0000", 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5933000000000003e-05 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441719+0000", 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9260000000000003e-06 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441725+0000", 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0990000000000004e-06 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443874+0000", 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002149574 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443981+0000", 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107287 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.444120+0000", 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013818599999999999 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.473 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87022 5.2 5:4b68054d:::benchmark_data_smithi037_101035_object87021:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.441734+0000", 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0046079420000000003, 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048641470000000001, 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87022 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441734+0000", 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441734+0000", 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441734+0000", 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2799999999999996e-07 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441767+0000", 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2455e-05 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441774+0000", 2023-10-08T06:58:16.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2439999999999996e-06 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441780+0000", 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0870000000000003e-06 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441899+0000", 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011889500000000001 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442017+0000", 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118417 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87023 5.6 5:6976076d:::benchmark_data_smithi037_101035_object87022:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.441794+0000", 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0045470229999999999, 2023-10-08T06:58:16.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048423570000000003, 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87023 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441794+0000", 2023-10-08T06:58:16.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441794+0000", 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441795+0000", 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2099999999999996e-07 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441823+0000", 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8215999999999999e-05 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441832+0000", 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4759999999999998e-06 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.441838+0000", 2023-10-08T06:58:16.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9370000000000001e-06 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443732+0000", 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018943720000000001 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443878+0000", 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014572200000000001 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.482 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87024 5.c 5:3eb89cdc:::benchmark_data_smithi037_101035_object87023:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.442185+0000", 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0041569119999999996, 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044933919999999997, 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87024 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442185+0000", 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442185+0000", 2023-10-08T06:58:16.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442185+0000", 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5799999999999998e-07 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442212+0000", 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6375000000000001e-05 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442223+0000", 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1157e-05 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442231+0000", 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.303e-06 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443736+0000", 2023-10-08T06:58:16.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015047260000000001 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443859+0000", 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012343900000000001 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87026 5.7 5:e8d9602c:::benchmark_data_smithi037_101035_object87025:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.487 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.442787+0000", 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0035546829999999999, 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039304509999999997, 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87026 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442787+0000", 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442787+0000", 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442788+0000", 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.09e-07 2023-10-08T06:58:16.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442844+0000", 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6616999999999997e-05 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442853+0000", 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9439999999999994e-06 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442860+0000", 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9879999999999998e-06 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.442909+0000", 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8819999999999997e-05 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443052+0000", 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000143373 2023-10-08T06:58:16.491 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.492 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.492 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.493 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87027 5.1 5:8a4ebbbf:::benchmark_data_smithi037_101035_object87026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.493 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.443416+0000", 2023-10-08T06:58:16.493 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0029256379999999999, 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033412659999999999, 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87027 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443416+0000", 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443416+0000", 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443416+0000", 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9400000000000005e-07 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443482+0000", 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5605000000000006e-05 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443496+0000", 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3546999999999999e-05 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443503+0000", 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5839999999999997e-06 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443556+0000", 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2355999999999998e-05 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.443704+0000", 2023-10-08T06:58:16.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148121 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87028 5.9 5:95d1f18d:::benchmark_data_smithi037_101035_object87027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.445366+0000", 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00097514599999999998, 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014302939999999999, 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:16.498 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87028 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445366+0000", 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445366+0000", 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445367+0000", 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6899999999999996e-07 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445415+0000", 2023-10-08T06:58:16.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7375e-05 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445425+0000", 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0419e-05 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445433+0000", 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1519999999999992e-06 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445656+0000", 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00022256700000000001 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445782+0000", 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012624500000000001 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445932+0000", 2023-10-08T06:58:16.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000150197 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87029 5.5 5.fbad3b5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.445451+0000", 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00089092900000000005, 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001386499, 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:16.503 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87029 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445451+0000", 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445451+0000", 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445451+0000", 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5499999999999998e-07 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445484+0000", 2023-10-08T06:58:16.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3065000000000003e-05 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445492+0000", 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1869999999999997e-06 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445498+0000", 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9900000000000002e-06 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.506 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87030 5.f 5:f12936a0:::benchmark_data_smithi037_101035_object87029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.445746+0000", 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00059591899999999998, 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011245059999999999, 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.507 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87030 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445746+0000", 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445746+0000", 2023-10-08T06:58:16.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445746+0000", 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2399999999999997e-07 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445808+0000", 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1532999999999995e-05 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445817+0000", 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9789999999999999e-06 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445824+0000", 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2699999999999999e-06 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445870+0000", 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5488999999999998e-05 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.446000+0000", 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013017000000000001 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.446145+0000", 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000145377 2023-10-08T06:58:16.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87031 5.9 5.16176a19 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.445840+0000", 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00050159, 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001070367, 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:16.512 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87031 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445840+0000", 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445840+0000", 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445840+0000", 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0299999999999999e-07 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445876+0000", 2023-10-08T06:58:16.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5358999999999998e-05 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445885+0000", 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0480000000000004e-06 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445891+0000", 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0530000000000003e-06 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.515 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:87019 5.d e40/32)", 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.445923+0000", 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00041844400000000002, 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0010201069999999999, 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445923+0000", 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445923+0000", 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445923+0000", 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7500000000000001e-07 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445926+0000", 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4710000000000001e-06 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445934+0000", 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0080000000000002e-06 2023-10-08T06:58:16.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445944+0000", 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9250000000000007e-06 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87032 5.f 5.7fd15ccf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.445900+0000", 2023-10-08T06:58:16.519 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00044124300000000002, 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0010697079999999999, 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87032 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445900+0000", 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445900+0000", 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445901+0000", 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2399999999999998e-07 2023-10-08T06:58:16.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445935+0000", 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4204e-05 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445943+0000", 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9249999999999995e-06 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445950+0000", 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7259999999999996e-06 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87033 5.9 5.564d4709 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.445959+0000", 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00038216200000000002, 2023-10-08T06:58:16.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0010409060000000001, 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87033 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445959+0000", 2023-10-08T06:58:16.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445959+0000", 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445960+0000", 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5199999999999997e-07 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445991+0000", 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1245000000000003e-05 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.445999+0000", 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4630000000000004e-06 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.446005+0000", 2023-10-08T06:58:16.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2570000000000004e-06 2023-10-08T06:58:16.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.527 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.527 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:16.527 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 17 2023-10-08T06:58:16.527 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:16.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:16.529 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:16.527+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:16.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-08T06:58:16.629 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:16.628+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:16.718 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:16.718 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:16.730 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:16.730+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:16.733 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:16.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:16.830+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.053701325999999, 2023-10-08T06:58:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.046866938000001, 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57920 5.2 5:4b015bf8:::benchmark_data_smithi037_101035_object57919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 15.027451287, 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017795800000000001, 2023-10-08T06:58:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57920 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899805+0000", 2023-10-08T06:58:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900121+0000", 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031621900000000002 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900127+0000", 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2859999999999996e-06 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900131+0000", 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4369999999999999e-06 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906312+0000", 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061814790000000001 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906420+0000", 2023-10-08T06:58:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010733700000000001 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906504+0000", 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4794000000000002e-05 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.909717+0000", 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032127689999999999 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917514+0000", 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077965819999999998 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917559+0000", 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5618999999999998e-05 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917600+0000", 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0908999999999997e-05 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57922 5.2 5:47786b04:::benchmark_data_smithi037_101035_object57921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 15.027119916, 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017617088999999999, 2023-10-08T06:58:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57922 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9700000000000003e-07 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900176+0000", 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0093999999999999e-05 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900185+0000", 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.918e-06 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900189+0000", 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1810000000000003e-06 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.907989+0000", 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078000559999999997 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908154+0000", 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016444300000000001 2023-10-08T06:58:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908326+0000", 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017191999999999999 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.911360+0000", 2023-10-08T06:58:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003033956 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917653+0000", 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062937280000000002 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917719+0000", 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5865999999999996e-05 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917753+0000", 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3630000000000002e-05 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58515 5.7 5:e5bd311c:::benchmark_data_smithi037_101035_object58514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.755660364000001, 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019075253, 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58515 2023-10-08T06:58:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171596+0000", 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171630+0000", 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4464000000000001e-05 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171637+0000", 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171641+0000", 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6030000000000001e-06 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177693+0000", 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060519090000000003 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177783+0000", 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0705000000000007e-05 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177924+0000", 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140815 2023-10-08T06:58:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181053+0000", 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003129204 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190584+0000", 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095309550000000007 2023-10-08T06:58:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190633+0000", 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8715999999999999e-05 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190671+0000", 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67177 5.7 5:eceead93:::benchmark_data_smithi037_101035_object67176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.732537184, 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018827831, 2023-10-08T06:58:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67177 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:58:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194808+0000", 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8851999999999996e-05 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194813+0000", 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5380000000000002e-06 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194817+0000", 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6219999999999998e-06 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196266+0000", 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014492940000000001 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196360+0000", 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3331999999999993e-05 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196452+0000", 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2529999999999997e-05 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197982+0000", 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015301030000000001 2023-10-08T06:58:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213446+0000", 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015463563 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213510+0000", 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3689999999999995e-05 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213546+0000", 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6828e-05 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.732425359, 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67184 5.2 5:4ca6e80a:::benchmark_data_smithi037_101035_object67183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.728670377, 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017158867000000001, 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67184 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198586+0000", 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8899999999999998e-07 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198642+0000", 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5687999999999999e-05 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198653+0000", 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1345000000000001e-05 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198661+0000", 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.233e-06 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198709+0000", 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8390999999999998e-05 2023-10-08T06:58:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198786+0000", 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6852000000000002e-05 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198891+0000", 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105643 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.200969+0000", 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020771600000000002 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215641+0000", 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014672304000000001 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215709+0000", 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8456999999999999e-05 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215744+0000", 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4904999999999999e-05 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67436 5.7 5:e2f7cac5:::benchmark_data_smithi037_101035_object67435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.600358590000001, 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017493584, 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67436 2023-10-08T06:58:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326898+0000", 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.569999999999999e-07 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326935+0000", 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7011999999999997e-05 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326946+0000", 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0446e-05 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326953+0000", 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3100000000000003e-06 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330129+0000", 2023-10-08T06:58:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003176183 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330249+0000", 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119702 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330391+0000", 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014252399999999999 2023-10-08T06:58:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.336180+0000", 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057887770000000002 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344304+0000", 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081237419999999998 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344349+0000", 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4866e-05 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344391+0000", 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2064999999999998e-05 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68298 5.9 5:920090b0:::benchmark_data_smithi037_101035_object68297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.201151002, 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017738614, 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68298 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726106+0000", 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0279999999999999e-06 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726184+0000", 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8300000000000006e-05 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726196+0000", 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.201e-05 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726203+0000", 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1029999999999996e-06 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726266+0000", 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2346000000000002e-05 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726431+0000", 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016508899999999999 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726617+0000", 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018605299999999999 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733386+0000", 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067696600000000003 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743760+0000", 2023-10-08T06:58:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010373339000000001 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743814+0000", 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4151999999999999e-05 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743843+0000", 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9533999999999999e-05 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:70072 5.2 5:4f26b367:::benchmark_data_smithi037_101035_object70071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.3678262930000002, 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017011773000000001, 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 70072 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559429+0000", 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559430+0000", 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.82e-07 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559478+0000", 2023-10-08T06:58:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7802000000000001e-05 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559487+0000", 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1249999999999999e-06 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.559500+0000", 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3343000000000001e-05 2023-10-08T06:58:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562403+0000", 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029030760000000001 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562544+0000", 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014036800000000001 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.562717+0000", 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017288899999999999 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.564640+0000", 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001923237 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576345+0000", 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011704786 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576401+0000", 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6697999999999998e-05 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:07.576441+0000", 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9867000000000003e-05 2023-10-08T06:58:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 6.2367224739999996, 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:85203 5.9 5:949b80ce:::benchmark_data_smithi037_101035_object85202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2390600169999999, 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019048018999999999, 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 85203 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688266+0000", 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9358999999999998e-05 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688274+0000", 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7059999999999993e-06 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688281+0000", 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1290000000000001e-06 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696142+0000", 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078615239999999999 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696239+0000", 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7238000000000007e-05 2023-10-08T06:58:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696326+0000", 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6526999999999993e-05 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.698888+0000", 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025619420000000002 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707157+0000", 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082691139999999993 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707207+0000", 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0488999999999997e-05 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707244+0000", 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6371000000000001e-05 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:86439 5.5 5:aaa57de9:::benchmark_data_smithi037_101035_object86438:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.73672706700000001, 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017017879, 2023-10-08T06:58:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 86439 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1699999999999999e-07 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190584+0000", 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4601000000000001e-05 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190589+0000", 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3850000000000001e-06 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190593+0000", 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8890000000000004e-06 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.196948+0000", 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0063548839999999999 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.197023+0000", 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5517000000000002e-05 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.207417+0000", 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010393767999999999 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.207472+0000", 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4525999999999999e-05 2023-10-08T06:58:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.207547+0000", 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4892000000000001e-05 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87239 5.1 5:89fd9011:::benchmark_data_smithi037_101035_object87238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.526259+0000", 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.40099642000000002, 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017029655000000001, 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87239 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526259+0000", 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526259+0000", 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526260+0000", 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526289+0000", 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9048e-05 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526297+0000", 2023-10-08T06:58:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1470000000000001e-06 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526303+0000", 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9669999999999998e-06 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.529108+0000", 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028044089999999999 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.529234+0000", 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126098 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.543207+0000", 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013973058 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.543245+0000", 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8554999999999999e-05 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.543289+0000", 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3652000000000002e-05 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87289 5.9 5:98d1113d:::benchmark_data_smithi037_101035_object87288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.37911340599999999, 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019973653000000001, 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87289 2023-10-08T06:58:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548143+0000", 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.16e-07 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548198+0000", 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4746000000000001e-05 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548209+0000", 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.101e-05 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548217+0000", 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9780000000000005e-06 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557493+0000", 2023-10-08T06:58:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092760280000000004 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557596+0000", 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010299800000000001 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557689+0000", 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3498000000000005e-05 2023-10-08T06:58:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.560241+0000", 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025519380000000001 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568028+0000", 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077864780000000003 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568076+0000", 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8010999999999998e-05 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568116+0000", 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0151999999999998e-05 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87472 5.5 5:a7cead30:::benchmark_data_smithi037_101035_object87471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.29721639500000002, 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018645680000000001, 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87472 2023-10-08T06:58:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630040+0000", 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630068+0000", 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8051999999999998e-05 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630075+0000", 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630081+0000", 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3620000000000002e-06 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.638291+0000", 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082094690000000005 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.638464+0000", 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017341599999999999 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648549+0000", 2023-10-08T06:58:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010085333 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648608+0000", 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8851000000000003e-05 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648685+0000", 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6857e-05 2023-10-08T06:58:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87541 5.f 5:f3546f4f:::benchmark_data_smithi037_101035_object87540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.26729326399999997, 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017142335000000002, 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87541 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5099999999999998e-07 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.660039+0000", 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5648000000000005e-05 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.660049+0000", 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0294e-05 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.660056+0000", 2023-10-08T06:58:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9369999999999998e-06 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.669367+0000", 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093108489999999995 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.669503+0000", 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013596999999999999 2023-10-08T06:58:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.669646+0000", 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142748 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.672028+0000", 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0023824369999999998 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.677018+0000", 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049896510000000003 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.677070+0000", 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1915e-05 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.677105+0000", 2023-10-08T06:58:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4934999999999997e-05 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87884 5.9 5:94066ae9:::benchmark_data_smithi037_101035_object87883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.118564268, 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018118507999999998, 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87884 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808692+0000", 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.72e-07 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808782+0000", 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9810999999999998e-05 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808787+0000", 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1139999999999997e-06 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808790+0000", 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.534e-06 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808830+0000", 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9931000000000001e-05 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808950+0000", 2023-10-08T06:58:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120207 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.809094+0000", 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014389700000000001 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.815082+0000", 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059875049999999997 2023-10-08T06:58:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826722+0000", 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011640113000000001 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826773+0000", 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1487999999999999e-05 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826810+0000", 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6535999999999997e-05 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:88083 5.9 5:95223a19:::benchmark_data_smithi037_101035_object88082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.030100078999999998, 2023-10-08T06:58:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017205376000000001, 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 88083 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0200000000000002e-07 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897218+0000", 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1858000000000003e-05 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897227+0000", 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9260000000000006e-06 2023-10-08T06:58:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897233+0000", 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.899863+0000", 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002629541 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.901702+0000", 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001839219 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.901881+0000", 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017920600000000001 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.905070+0000", 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031884930000000001 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.914254+0000", 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0091842599999999996 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.914315+0000", 2023-10-08T06:58:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0704e-05 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.914361+0000", 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6405e-05 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:17.072 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:17.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:17.075 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:17.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:17.072+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:17.174 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.173+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.229 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:17.244 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88890 5.a 5:5046161c:::benchmark_data_smithi037_101035_object88889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.233797+0000", 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0097629870000000007, 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0097908179999999997, 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88890 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.233797+0000", 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.233797+0000", 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.233798+0000", 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4499999999999996e-07 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.233920+0000", 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122197 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.233929+0000", 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1919999999999994e-06 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.233936+0000", 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8530000000000003e-06 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.235451+0000", 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015150750000000001 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.235543+0000", 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1979999999999997e-05 2023-10-08T06:58:17.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:88894 5.d e40/32 5:b26d5408:::benchmark_data_smithi037_101035_object88893:head v 40'5431, mlcod=40'5428)", 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.236403+0000", 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0071564829999999999, 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0072593919999999999, 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.250 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236403+0000", 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236403+0000", 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236404+0000", 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236467+0000", 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2397999999999994e-05 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236478+0000", 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1377e-05 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236484+0000", 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4749999999999998e-06 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236526+0000", 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1598999999999999e-05 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236541+0000", 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4555e-05 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.254 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88895 5.0 5:0e51ed3d:::benchmark_data_smithi037_101035_object88894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.236003+0000", 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0075571989999999997, 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077260580000000001, 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88895 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236003+0000", 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236003+0000", 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.236003+0000", 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4799999999999998e-07 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237162+0000", 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011582929999999999 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237174+0000", 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2490000000000001e-05 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237182+0000", 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5089999999999996e-06 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237233+0000", 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1059e-05 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237331+0000", 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8220000000000005e-05 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88896 5.0 5:033eac5f:::benchmark_data_smithi037_101035_object88895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.237200+0000", 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0063599540000000001, 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066015860000000004, 2023-10-08T06:58:17.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88896 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237200+0000", 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237200+0000", 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237201+0000", 2023-10-08T06:58:17.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3e-07 2023-10-08T06:58:17.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237229+0000", 2023-10-08T06:58:17.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8381000000000002e-05 2023-10-08T06:58:17.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237236+0000", 2023-10-08T06:58:17.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2790000000000001e-06 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237242+0000", 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.239277+0000", 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00203476 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.239363+0000", 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6642000000000002e-05 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88897 5.8 5:1e0d78f2:::benchmark_data_smithi037_101035_object88896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.237384+0000", 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0061755079999999997, 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064853589999999996, 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88897 2023-10-08T06:58:17.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237384+0000", 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237384+0000", 2023-10-08T06:58:17.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237385+0000", 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4899999999999995e-07 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237447+0000", 2023-10-08T06:58:17.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1964999999999994e-05 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237455+0000", 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4060000000000005e-06 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237461+0000", 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9229999999999999e-06 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.239269+0000", 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001807648 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.239421+0000", 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000152566 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88898 5.0 5:070b0ccd:::benchmark_data_smithi037_101035_object88897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.237872+0000", 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0056882599999999997, 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060645880000000001, 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.272 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88898 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237872+0000", 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237872+0000", 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237872+0000", 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5400000000000001e-07 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237972+0000", 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9815000000000006e-05 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237983+0000", 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1243000000000001e-05 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.237990+0000", 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1160000000000001e-06 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241127+0000", 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031367600000000002 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241264+0000", 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013644300000000001 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.276 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88901 5.a 5:52e00407:::benchmark_data_smithi037_101035_object88900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.238517+0000", 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0050425940000000001, 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054860339999999999, 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88901 2023-10-08T06:58:17.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238517+0000", 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238517+0000", 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238518+0000", 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5499999999999998e-07 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238579+0000", 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1498e-05 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238586+0000", 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0180000000000004e-06 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238592+0000", 2023-10-08T06:58:17.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1210000000000003e-06 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238646+0000", 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3146000000000002e-05 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.238794+0000", 2023-10-08T06:58:17.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014833700000000001 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88903 5.0 5:06680cf3:::benchmark_data_smithi037_101035_object88902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.241101+0000", 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0024589239999999999, 2023-10-08T06:58:17.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029717400000000001, 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88903 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241101+0000", 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241101+0000", 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241102+0000", 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241162+0000", 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0189999999999998e-05 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241175+0000", 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2584e-05 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.241185+0000", 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.013e-05 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243097+0000", 2023-10-08T06:58:17.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019120579999999999 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243242+0000", 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014551700000000001 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:88905 5.d e40/32 5:bb2ad2c7:::benchmark_data_smithi037_101035_object88904:head v 40'5432, mlcod=40'5429)", 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.242251+0000", 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0013090529999999999, 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001894651, 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242251+0000", 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242251+0000", 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242252+0000", 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242299+0000", 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7280999999999997e-05 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242310+0000", 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1311999999999999e-05 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242318+0000", 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4590000000000001e-06 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242373+0000", 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5559000000000001e-05 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.242390+0000", 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6515999999999999e-05 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:88910 5.e 5:770ff97a:::benchmark_data_smithi037_101035_object88909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.243135+0000", 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00042445299999999998, 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001075199, 2023-10-08T06:58:17.292 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 88910 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243135+0000", 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243135+0000", 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243137+0000", 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2419999999999999e-06 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243189+0000", 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2651000000000001e-05 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243200+0000", 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1054e-05 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243213+0000", 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2745000000000001e-05 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243267+0000", 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3436999999999997e-05 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243387+0000", 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012012 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:88909 5.9 e40/20 5:913d3732:::benchmark_data_smithi037_101035_object88908:head v 40'5516, mlcod=40'5514)", 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:17.243576+0000", 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9999838, 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000700758, 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243576+0000", 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243576+0000", 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243577+0000", 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1699999999999998e-07 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243625+0000", 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8000000000000001e-05 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243634+0000", 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5400000000000001e-06 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243640+0000", 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5500000000000002e-06 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243686+0000", 2023-10-08T06:58:17.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6263000000000001e-05 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:17.243702+0000", 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5753999999999999e-05 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 11 2023-10-08T06:58:17.301 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:17.303 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:17.304 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:17.304 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:17.304 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.302+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.305 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:17.305 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:17.305 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:17.305 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:58:17.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 37 16 89193 89177 150.624 145.688 0.00317603 0.00663601 2023-10-08T06:58:17.404 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.403+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.504 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.503+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.517 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:17.518 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:17.534 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:17.619 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.618+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.706 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.706+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.751 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:17.751 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:17.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:17.808 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.807+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.909 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:17.908+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:17.949 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:17.949 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:17.966 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:18.009 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:18.008+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:18.111 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:18.110+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:18.147 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:18.148 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:18.163 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:18.211 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:18.210+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:18.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:18.311+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:18.352 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:18.352 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:18.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 38 16 91558 91542 150.55 147.812 0.00718151 0.00663968 2023-10-08T06:58:18.369 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:18.414 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:18.413+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:18.489 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T06:58:18.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:18.514+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:18.546 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:18.546 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:18.562 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:18.598 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-08T06:58:18.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:18.614+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:18.699 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-08T06:58:18.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:18.715+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:18.778 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:18.778 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:18.793 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:18.836 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:18.835+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:18.918 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:18.917+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:18.967 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:18.967 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:18.981 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:19.023 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:19.022+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:19.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.119+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:19.161 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:19.162 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:19.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:19.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.220+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:19.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:19.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.321+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:19.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 39 16 93910 93894 150.459 147 0.00648362 0.00664368 2023-10-08T06:58:19.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:58:19.402 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:19.402 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:19.418 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:19.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.458+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:19.463 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:19.485 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:19.489 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:19.489 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:19.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.522+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:19.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.623+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:19.640 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.763982434999999, 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.757148047000001, 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57920 5.2 5:4b015bf8:::benchmark_data_smithi037_101035_object57919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.737732395999998, 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017795800000000001, 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57920 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899805+0000", 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900121+0000", 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031621900000000002 2023-10-08T06:58:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900127+0000", 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2859999999999996e-06 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900131+0000", 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4369999999999999e-06 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906312+0000", 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061814790000000001 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906420+0000", 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010733700000000001 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906504+0000", 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4794000000000002e-05 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.909717+0000", 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032127689999999999 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917514+0000", 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077965819999999998 2023-10-08T06:58:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917559+0000", 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5618999999999998e-05 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917600+0000", 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0908999999999997e-05 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57922 5.2 5:47786b04:::benchmark_data_smithi037_101035_object57921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.737401025, 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017617088999999999, 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57922 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9700000000000003e-07 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900176+0000", 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0093999999999999e-05 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900185+0000", 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.918e-06 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900189+0000", 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1810000000000003e-06 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.907989+0000", 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078000559999999997 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908154+0000", 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016444300000000001 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908326+0000", 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017191999999999999 2023-10-08T06:58:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.911360+0000", 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003033956 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917653+0000", 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062937280000000002 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917719+0000", 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5865999999999996e-05 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917753+0000", 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3630000000000002e-05 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58515 5.7 5:e5bd311c:::benchmark_data_smithi037_101035_object58514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.465941473000001, 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019075253, 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58515 2023-10-08T06:58:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171596+0000", 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171630+0000", 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4464000000000001e-05 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171637+0000", 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171641+0000", 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6030000000000001e-06 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177693+0000", 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060519090000000003 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177783+0000", 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0705000000000007e-05 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177924+0000", 2023-10-08T06:58:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140815 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181053+0000", 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003129204 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190584+0000", 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095309550000000007 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190633+0000", 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8715999999999999e-05 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190671+0000", 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67177 5.7 5:eceead93:::benchmark_data_smithi037_101035_object67176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.442818293, 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018827831, 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67177 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194808+0000", 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8851999999999996e-05 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194813+0000", 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5380000000000002e-06 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194817+0000", 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6219999999999998e-06 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196266+0000", 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014492940000000001 2023-10-08T06:58:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196360+0000", 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3331999999999993e-05 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196452+0000", 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2529999999999997e-05 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197982+0000", 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015301030000000001 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213446+0000", 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015463563 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213510+0000", 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3689999999999995e-05 2023-10-08T06:58:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213546+0000", 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6828e-05 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.442706468000001, 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67184 5.2 5:4ca6e80a:::benchmark_data_smithi037_101035_object67183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.438951486000001, 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017158867000000001, 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67184 2023-10-08T06:58:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198585+0000", 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198586+0000", 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8899999999999998e-07 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198642+0000", 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5687999999999999e-05 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198653+0000", 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1345000000000001e-05 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198661+0000", 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.233e-06 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198709+0000", 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8390999999999998e-05 2023-10-08T06:58:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198786+0000", 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6852000000000002e-05 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.198891+0000", 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105643 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.200969+0000", 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020771600000000002 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215641+0000", 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014672304000000001 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215709+0000", 2023-10-08T06:58:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8456999999999999e-05 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215744+0000", 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4904999999999999e-05 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67436 5.7 5:e2f7cac5:::benchmark_data_smithi037_101035_object67435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.310639698999999, 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017493584, 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67436 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326897+0000", 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326898+0000", 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.569999999999999e-07 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326935+0000", 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7011999999999997e-05 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326946+0000", 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0446e-05 2023-10-08T06:58:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.326953+0000", 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3100000000000003e-06 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330129+0000", 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003176183 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330249+0000", 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119702 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.330391+0000", 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014252399999999999 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.336180+0000", 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057887770000000002 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344304+0000", 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081237419999999998 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344349+0000", 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4866e-05 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.344391+0000", 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2064999999999998e-05 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68298 5.9 5:920090b0:::benchmark_data_smithi037_101035_object68297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.911432111, 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017738614, 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68298 2023-10-08T06:58:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726106+0000", 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0279999999999999e-06 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726184+0000", 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8300000000000006e-05 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726196+0000", 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.201e-05 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726203+0000", 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1029999999999996e-06 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726266+0000", 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2346000000000002e-05 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726431+0000", 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016508899999999999 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726617+0000", 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018605299999999999 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733386+0000", 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067696600000000003 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743760+0000", 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010373339000000001 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743814+0000", 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4151999999999999e-05 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743843+0000", 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9533999999999999e-05 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.9470035830000008, 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:85203 5.9 5:949b80ce:::benchmark_data_smithi037_101035_object85202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.9493411260000002, 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019048018999999999, 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 85203 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688266+0000", 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9358999999999998e-05 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688274+0000", 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7059999999999993e-06 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688281+0000", 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1290000000000001e-06 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696142+0000", 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078615239999999999 2023-10-08T06:58:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696239+0000", 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7238000000000007e-05 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696326+0000", 2023-10-08T06:58:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6526999999999993e-05 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.698888+0000", 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025619420000000002 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707157+0000", 2023-10-08T06:58:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082691139999999993 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707207+0000", 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0488999999999997e-05 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707244+0000", 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6371000000000001e-05 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:86439 5.5 5:aaa57de9:::benchmark_data_smithi037_101035_object86438:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.4470081759999998, 2023-10-08T06:58:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017017879, 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 86439 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190529+0000", 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1699999999999999e-07 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190584+0000", 2023-10-08T06:58:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4601000000000001e-05 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190589+0000", 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3850000000000001e-06 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.190593+0000", 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8890000000000004e-06 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.196948+0000", 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0063548839999999999 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.197023+0000", 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5517000000000002e-05 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.207417+0000", 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010393767999999999 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.207472+0000", 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4525999999999999e-05 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.207547+0000", 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4892000000000001e-05 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87239 5.1 5:89fd9011:::benchmark_data_smithi037_101035_object87238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.526259+0000", 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.1112775290000001, 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017029655000000001, 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87239 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526259+0000", 2023-10-08T06:58:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526259+0000", 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526260+0000", 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526289+0000", 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9048e-05 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526297+0000", 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1470000000000001e-06 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.526303+0000", 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9669999999999998e-06 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.529108+0000", 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028044089999999999 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.529234+0000", 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126098 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.543207+0000", 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013973058 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.543245+0000", 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8554999999999999e-05 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.543289+0000", 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3652000000000002e-05 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87289 5.9 5:98d1113d:::benchmark_data_smithi037_101035_object87288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.089394515, 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019973653000000001, 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87289 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548143+0000", 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.16e-07 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548198+0000", 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4746000000000001e-05 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548209+0000", 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.101e-05 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548217+0000", 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9780000000000005e-06 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557493+0000", 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092760280000000004 2023-10-08T06:58:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557596+0000", 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010299800000000001 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557689+0000", 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3498000000000005e-05 2023-10-08T06:58:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.560241+0000", 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025519380000000001 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568028+0000", 2023-10-08T06:58:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077864780000000003 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568076+0000", 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8010999999999998e-05 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568116+0000", 2023-10-08T06:58:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0151999999999998e-05 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87472 5.5 5:a7cead30:::benchmark_data_smithi037_101035_object87471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.0074975039999998, 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018645680000000001, 2023-10-08T06:58:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87472 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630040+0000", 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630068+0000", 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8051999999999998e-05 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630075+0000", 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630081+0000", 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3620000000000002e-06 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.638291+0000", 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082094690000000005 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.638464+0000", 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017341599999999999 2023-10-08T06:58:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648549+0000", 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010085333 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648608+0000", 2023-10-08T06:58:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8851000000000003e-05 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648685+0000", 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6857e-05 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87541 5.f 5:f3546f4f:::benchmark_data_smithi037_101035_object87540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.9775743729999999, 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017142335000000002, 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87541 2023-10-08T06:58:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.659963+0000", 2023-10-08T06:58:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5099999999999998e-07 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.660039+0000", 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5648000000000005e-05 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.660049+0000", 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0294e-05 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.660056+0000", 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9369999999999998e-06 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.669367+0000", 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093108489999999995 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.669503+0000", 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013596999999999999 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.669646+0000", 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142748 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.672028+0000", 2023-10-08T06:58:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0023824369999999998 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.677018+0000", 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049896510000000003 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.677070+0000", 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1915e-05 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.677105+0000", 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4934999999999997e-05 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87884 5.9 5:94066ae9:::benchmark_data_smithi037_101035_object87883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.8288453769999999, 2023-10-08T06:58:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018118507999999998, 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87884 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808692+0000", 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.72e-07 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808782+0000", 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9810999999999998e-05 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808787+0000", 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1139999999999997e-06 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808790+0000", 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.534e-06 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808830+0000", 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9931000000000001e-05 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808950+0000", 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120207 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.809094+0000", 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014389700000000001 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.815082+0000", 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059875049999999997 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826722+0000", 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011640113000000001 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826773+0000", 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1487999999999999e-05 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826810+0000", 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6535999999999997e-05 2023-10-08T06:58:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:88083 5.9 5:95223a19:::benchmark_data_smithi037_101035_object88082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.7403811879999997, 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017205376000000001, 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 88083 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897156+0000", 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0200000000000002e-07 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897218+0000", 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1858000000000003e-05 2023-10-08T06:58:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897227+0000", 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9260000000000006e-06 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.897233+0000", 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.899863+0000", 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002629541 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.901702+0000", 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001839219 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.901881+0000", 2023-10-08T06:58:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017920600000000001 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.905070+0000", 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031884930000000001 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.914254+0000", 2023-10-08T06:58:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0091842599999999996 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.914315+0000", 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0704e-05 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.914361+0000", 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6405e-05 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:88372 5.6 5:6c009f6d:::benchmark_data_smithi037_101035_object88371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:17.015814+0000", 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 2.621723067, 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017368934999999999, 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 88372 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.015814+0000", 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.015814+0000", 2023-10-08T06:58:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.015815+0000", 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8100000000000002e-07 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.015901+0000", 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6499e-05 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.015911+0000", 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0013000000000001e-05 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.015918+0000", 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1670000000000002e-06 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.016579+0000", 2023-10-08T06:58:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00066024300000000003 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.016672+0000", 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3170000000000004e-05 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.033031+0000", 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016359192000000002 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.033100+0000", 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8891000000000002e-05 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:17.033183+0000", 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2979000000000006e-05 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:19.791 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:19.791 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:19.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:19.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.791+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:19.947 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.060784266000000003, 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060816851999999998, 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:19.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:19.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:19.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:19.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.952 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.057794222999999999, 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.057873158000000001, 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5.49ae54c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.056443294999999997, 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.056557955, 2023-10-08T06:58:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5.bd9ccf00 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.056304531999999997, 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.056448049, 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.961 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:19.964 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.055926068000000002, 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.056100744000000001, 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:19.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.061223694000000002, 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.061436511999999999, 2023-10-08T06:58:19.969 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:19.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.061120836999999997, 2023-10-08T06:58:19.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.061371230999999998, 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:19.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.061057543999999998, 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.061344818000000002, 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:19.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:19.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:19.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2023-10-08T06:58:19.984 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:19.986 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:19.986 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:19.892+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:19.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:19.992+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:20.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:20.093+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:20.161 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:20.161 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:20.161 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:20.161 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:20.161 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:20.173 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:20.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:20.195+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:20.296 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:20.295+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:20.355 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.487111686999999, 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28689 5.b 5:d0207a48:::benchmark_data_smithi037_101035_object28688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.484676930999999, 2023-10-08T06:58:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025999918, 2023-10-08T06:58:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28689 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867652+0000", 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867653+0000", 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9100000000000003e-07 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867710+0000", 2023-10-08T06:58:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7408000000000003e-05 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867719+0000", 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3270000000000001e-06 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867724+0000", 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2310000000000004e-06 2023-10-08T06:58:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867757+0000", 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2838e-05 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867840+0000", 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3361000000000004e-05 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867919+0000", 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9368000000000003e-05 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870062+0000", 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021427180000000001 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893566+0000", 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023503535999999998 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893615+0000", 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893652+0000", 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6686000000000001e-05 2023-10-08T06:58:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.484403468, 2023-10-08T06:58:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28692 5.d 5:b692d047:::benchmark_data_smithi037_101035_object28691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.484263696999999, 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026101996999999998, 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28692 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868065+0000", 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868066+0000", 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0800000000000004e-07 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868110+0000", 2023-10-08T06:58:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4119999999999998e-05 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868121+0000", 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1139e-05 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868127+0000", 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868168+0000", 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0751999999999999e-05 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868262+0000", 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3543999999999997e-05 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868350+0000", 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8073999999999997e-05 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894068+0000", 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025718215999999999 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894083+0000", 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894136+0000", 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2308000000000001e-05 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894167+0000", 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1603999999999998e-05 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28693 5.4 5:2d5742f1:::benchmark_data_smithi037_101035_object28692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.484176842, 2023-10-08T06:58:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025747814000000001, 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28693 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868152+0000", 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868153+0000", 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8299999999999997e-07 2023-10-08T06:58:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868184+0000", 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1154e-05 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868192+0000", 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8159999999999994e-06 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868198+0000", 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.117e-06 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868237+0000", 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8729999999999997e-05 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868313+0000", 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6373999999999998e-05 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868413+0000", 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100379 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893045+0000", 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024632049999999999 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893817+0000", 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077152600000000003 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893865+0000", 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8038000000000003e-05 2023-10-08T06:58:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893900+0000", 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5046999999999998e-05 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28695 5.b 5:d965b6d6:::benchmark_data_smithi037_101035_object28694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.484115933999998, 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025518918000000002, 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28695 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868213+0000", 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868214+0000", 2023-10-08T06:58:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999997e-07 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868289+0000", 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868297+0000", 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1089999999999998e-06 2023-10-08T06:58:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868304+0000", 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868667+0000", 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036353299999999998 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868775+0000", 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107459 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868895+0000", 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120009 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892776+0000", 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023881293000000001 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893658+0000", 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088256800000000002 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893696+0000", 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7864000000000002e-05 2023-10-08T06:58:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893732+0000", 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5675e-05 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28696 5.d 5:bce39c10:::benchmark_data_smithi037_101035_object28695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.484006736000001, 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026063296, 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28696 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868322+0000", 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868323+0000", 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868355+0000", 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1684999999999999e-05 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868362+0000", 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.007e-06 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868368+0000", 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8210000000000004e-06 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869165+0000", 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079621499999999997 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869239+0000", 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3998999999999994e-05 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.869316+0000", 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894176+0000", 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024859662000000001 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894297+0000", 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001211 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894346+0000", 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8343000000000001e-05 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894386+0000", 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-05 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.481411177999998, 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28700 5.8 5:1024477c:::benchmark_data_smithi037_101035_object28699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.478834429999999, 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026740291999999999, 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28700 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873495+0000", 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873496+0000", 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.59e-06 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016645200000000001 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892543+0000", 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018880588 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892572+0000", 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8428999999999998e-05 2023-10-08T06:58:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892645+0000", 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3190999999999998e-05 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892769+0000", 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124015 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892904+0000", 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013479799999999999 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.897626+0000", 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047219100000000002 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900145+0000", 2023-10-08T06:58:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519524 2023-10-08T06:58:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900201+0000", 2023-10-08T06:58:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5723000000000002e-05 2023-10-08T06:58:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900235+0000", 2023-10-08T06:58:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4072000000000002e-05 2023-10-08T06:58:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:67165 5.8 5:1d063b33:::benchmark_data_smithi037_101035_object67164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.163163962, 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022537402000000002, 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 67165 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189165+0000", 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189166+0000", 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2999999999999999e-07 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189258+0000", 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2398999999999994e-05 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189268+0000", 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3300000000000005e-06 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.189275+0000", 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.192938+0000", 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036629380000000001 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193029+0000", 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0659000000000001e-05 2023-10-08T06:58:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.193113+0000", 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4258999999999994e-05 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.196727+0000", 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036139280000000002 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211643+0000", 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014915464999999999 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211678+0000", 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5250999999999998e-05 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:06.211702+0000", 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4559999999999999e-05 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.46637031600000001, 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.466267459, 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:20.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:20.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.46620416599999998, 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:20.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:20.454 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.46593088799999999, 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.455 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:20.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.46294084499999999, 2023-10-08T06:58:20.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.468 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.46158991700000002, 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.469 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:20.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:20.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:20.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.46145115399999997, 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:20.476 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:20.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:20.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:20.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:20.483 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.46107269000000001, 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:20.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:20.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:20.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:20.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:20.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:20.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:20.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:20.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:20.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:20.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:20.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:20.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.491 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.45891115599999999, 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:20.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:20.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:20.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:20.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:20.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:20.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.45057227300000002, 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:20.499 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:20.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:20.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:20.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:20.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:20.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:20.505 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:20.506 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2023-10-08T06:58:20.364995+0000 min lat: 0.0012103 max lat: 1.03311 avg lat: 0.0066536 2023-10-08T06:58:20.506 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-10-08T06:58:20.507 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 40 16 96178 96162 150.241 141.75 0.00622364 0.0066536 2023-10-08T06:58:20.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:20.505+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:20.508 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:58:20.508 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:20.608 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:20.607+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:20.705 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:20.705 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:20.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.705 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96985 5.d 5:b5390b87:::benchmark_data_smithi037_101035_object96984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.705 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.699546+0000", 2023-10-08T06:58:20.705 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0041965550000000003, 2023-10-08T06:58:20.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042240919999999996, 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96985 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699546+0000", 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699546+0000", 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699547+0000", 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6700000000000003e-07 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699622+0000", 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4901000000000007e-05 2023-10-08T06:58:20.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699629+0000", 2023-10-08T06:58:20.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5089999999999996e-06 2023-10-08T06:58:20.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699636+0000", 2023-10-08T06:58:20.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8669999999999996e-06 2023-10-08T06:58:20.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699688+0000", 2023-10-08T06:58:20.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2521000000000001e-05 2023-10-08T06:58:20.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699823+0000", 2023-10-08T06:58:20.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013493700000000001 2023-10-08T06:58:20.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:20.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699975+0000", 2023-10-08T06:58:20.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015198300000000001 2023-10-08T06:58:20.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:20.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702751+0000", 2023-10-08T06:58:20.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027752430000000002 2023-10-08T06:58:20.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.714 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.715 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96987 5.7 5:e7adc6e6:::benchmark_data_smithi037_101035_object96986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.715 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.699707+0000", 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0040358140000000004, 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004151872, 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96987 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699707+0000", 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699707+0000", 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699707+0000", 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7999999999999995e-07 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699745+0000", 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7243999999999998e-05 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699751+0000", 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4570000000000002e-06 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699757+0000", 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.694e-06 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699818+0000", 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1078e-05 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699966+0000", 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148226 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96989 5.5 5:a7a80a0b:::benchmark_data_smithi037_101035_object96988:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.699769+0000", 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00397328, 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041605339999999996, 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96989 2023-10-08T06:58:20.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699769+0000", 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699769+0000", 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699770+0000", 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6499999999999999e-07 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699856+0000", 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5656999999999997e-05 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699864+0000", 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0790000000000001e-06 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699870+0000", 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3849999999999999e-06 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.699909+0000", 2023-10-08T06:58:20.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9499000000000002e-05 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700020+0000", 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011082399999999999 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96991 5.7 5:e9fe2736:::benchmark_data_smithi037_101035_object96990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.725 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.700007+0000", 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0037351369999999999, 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039959289999999996, 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96991 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700007+0000", 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700007+0000", 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700008+0000", 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700090+0000", 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1848000000000006e-05 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700099+0000", 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6969999999999999e-06 2023-10-08T06:58:20.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700105+0000", 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3759999999999996e-06 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702066+0000", 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019606379999999998 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702221+0000", 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015492699999999999 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96992 5.6 5:6de5aa25:::benchmark_data_smithi037_101035_object96991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.700119+0000", 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0036232629999999998, 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039578859999999999, 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.730 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96992 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700119+0000", 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700119+0000", 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700120+0000", 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.75e-07 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700151+0000", 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0837000000000003e-05 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700158+0000", 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9879999999999998e-06 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.700163+0000", 2023-10-08T06:58:20.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1109999999999999e-06 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.701529+0000", 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0013663499999999999 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.701648+0000", 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011874099999999999 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96993 5.5 5:a012fef8:::benchmark_data_smithi037_101035_object96992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.702389+0000", 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0013531420000000001, 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001760218, 2023-10-08T06:58:20.735 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96993 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702389+0000", 2023-10-08T06:58:20.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702389+0000", 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702391+0000", 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.432e-06 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702481+0000", 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0486000000000001e-05 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702498+0000", 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6980999999999999e-05 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702509+0000", 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0919e-05 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702567+0000", 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7843000000000002e-05 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702719+0000", 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015190700000000001 2023-10-08T06:58:20.739 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96994 5.3 5:c9a08388:::benchmark_data_smithi037_101035_object96993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.702529+0000", 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001213155, 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016915949999999999, 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.740 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96994 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702529+0000", 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702529+0000", 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702530+0000", 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7999999999999995e-07 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702568+0000", 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7880000000000003e-05 2023-10-08T06:58:20.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702577+0000", 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1500000000000005e-06 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702584+0000", 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6320000000000002e-06 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702638+0000", 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.482e-05 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.702769+0000", 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013059500000000001 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.744 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96997 5.2 5:4d41b7a9:::benchmark_data_smithi037_101035_object96996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.703931+0000", 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9998116, 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036498100000000001, 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96997 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.703931+0000", 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.703931+0000", 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.703932+0000", 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1800000000000005e-07 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704039+0000", 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107191 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704047+0000", 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7290000000000006e-06 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704053+0000", 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3789999999999997e-06 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704105+0000", 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2275999999999999e-05 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704230+0000", 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012497699999999999 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96998 5.c 5:3525318b:::benchmark_data_smithi037_101035_object96997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.704070+0000", 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9996729, 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000305008, 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.749 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96998 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704070+0000", 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704070+0000", 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704070+0000", 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3200000000000005e-07 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704107+0000", 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6958000000000001e-05 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704112+0000", 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4240000000000001e-06 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704116+0000", 2023-10-08T06:58:20.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8759999999999998e-06 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704166+0000", 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9336999999999999e-05 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704274+0000", 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000108361 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.753 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:96999 5.3 5.7a5417f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.704127+0000", 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9996157, 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00033545999999999999, 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "reached pg", 2023-10-08T06:58:20.754 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 96999 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704127+0000", 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704127+0000", 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704128+0000", 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704165+0000", 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7867999999999997e-05 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704172+0000", 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9489999999999999e-06 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704180+0000", 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.571e-06 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704451+0000", 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00027100699999999998 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:97000 5.5 5.df85c6c5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:20.704390+0000", 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9993525, 2023-10-08T06:58:20.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013683900000000001, 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 97000 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704390+0000", 2023-10-08T06:58:20.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704390+0000", 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704391+0000", 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8800000000000001e-07 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704441+0000", 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9799000000000002e-05 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704450+0000", 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.935e-06 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:20.704461+0000", 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0648e-05 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 11 2023-10-08T06:58:20.762 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:20.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:20.764 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:20.762+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:20.864 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:20.863+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:20.951 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:20.951 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:20.951 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:20.951 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:20.952 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:20.965 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:20.964+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:20.965 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:21.066 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:21.065+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.275765544000002, 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.268931156000001, 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57920 5.2 5:4b015bf8:::benchmark_data_smithi037_101035_object57919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.249515505000002, 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017795800000000001, 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57920 2023-10-08T06:58:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899804+0000", 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.899805+0000", 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6899999999999998e-07 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900121+0000", 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031621900000000002 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900127+0000", 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2859999999999996e-06 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900131+0000", 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4369999999999999e-06 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906312+0000", 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061814790000000001 2023-10-08T06:58:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906420+0000", 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010733700000000001 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.906504+0000", 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4794000000000002e-05 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.909717+0000", 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032127689999999999 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917514+0000", 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077965819999999998 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917559+0000", 2023-10-08T06:58:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5618999999999998e-05 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917600+0000", 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0908999999999997e-05 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:57922 5.2 5:47786b04:::benchmark_data_smithi037_101035_object57921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.249184134, 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017617088999999999, 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 57922 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900136+0000", 2023-10-08T06:58:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9700000000000003e-07 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900176+0000", 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0093999999999999e-05 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900185+0000", 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.918e-06 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.900189+0000", 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1810000000000003e-06 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.907989+0000", 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078000559999999997 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908154+0000", 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016444300000000001 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.908326+0000", 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017191999999999999 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.911360+0000", 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003033956 2023-10-08T06:58:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917653+0000", 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062937280000000002 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917719+0000", 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5865999999999996e-05 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:01.917753+0000", 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3630000000000002e-05 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:58515 5.7 5:e5bd311c:::benchmark_data_smithi037_101035_object58514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.977724582, 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019075253, 2023-10-08T06:58:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 58515 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171595+0000", 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171596+0000", 2023-10-08T06:58:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171630+0000", 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4464000000000001e-05 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171637+0000", 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.171641+0000", 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6030000000000001e-06 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177693+0000", 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060519090000000003 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177783+0000", 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0705000000000007e-05 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.177924+0000", 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000140815 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.181053+0000", 2023-10-08T06:58:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003129204 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190584+0000", 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095309550000000007 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190633+0000", 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8715999999999999e-05 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:02.190671+0000", 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67177 5.7 5:eceead93:::benchmark_data_smithi037_101035_object67176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.954601402, 2023-10-08T06:58:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018827831, 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67177 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194719+0000", 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194808+0000", 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8851999999999996e-05 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194813+0000", 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5380000000000002e-06 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194817+0000", 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6219999999999998e-06 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196266+0000", 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014492940000000001 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196360+0000", 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3331999999999993e-05 2023-10-08T06:58:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.196452+0000", 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2529999999999997e-05 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197982+0000", 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015301030000000001 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213446+0000", 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015463563 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213510+0000", 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3689999999999995e-05 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.213546+0000", 2023-10-08T06:58:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6828e-05 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.954489577, 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:68298 5.9 5:920090b0:::benchmark_data_smithi037_101035_object68297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.423215219999999, 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017738614, 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 68298 2023-10-08T06:58:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726105+0000", 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726106+0000", 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0279999999999999e-06 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726184+0000", 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8300000000000006e-05 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726196+0000", 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.201e-05 2023-10-08T06:58:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726203+0000", 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1029999999999996e-06 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726266+0000", 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2346000000000002e-05 2023-10-08T06:58:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726431+0000", 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016508899999999999 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.726617+0000", 2023-10-08T06:58:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00018605299999999999 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.733386+0000", 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067696600000000003 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743760+0000", 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010373339000000001 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743814+0000", 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4151999999999999e-05 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.743843+0000", 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9533999999999999e-05 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.458786692, 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:85203 5.9 5:949b80ce:::benchmark_data_smithi037_101035_object85202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.4611242349999998, 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019048018999999999, 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 85203 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688196+0000", 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688266+0000", 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9358999999999998e-05 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688274+0000", 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7059999999999993e-06 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.688281+0000", 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1290000000000001e-06 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696142+0000", 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078615239999999999 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696239+0000", 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7238000000000007e-05 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.696326+0000", 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6526999999999993e-05 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.698888+0000", 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025619420000000002 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707157+0000", 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082691139999999993 2023-10-08T06:58:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707207+0000", 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0488999999999997e-05 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:15.707244+0000", 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6371000000000001e-05 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87289 5.9 5:98d1113d:::benchmark_data_smithi037_101035_object87288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.601177624, 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019973653000000001, 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87289 2023-10-08T06:58:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548143+0000", 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.16e-07 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548198+0000", 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4746000000000001e-05 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548209+0000", 2023-10-08T06:58:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.101e-05 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548217+0000", 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9780000000000005e-06 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557493+0000", 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092760280000000004 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557596+0000", 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010299800000000001 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557689+0000", 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3498000000000005e-05 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.560241+0000", 2023-10-08T06:58:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025519380000000001 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568028+0000", 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077864780000000003 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568076+0000", 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8010999999999998e-05 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568116+0000", 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0151999999999998e-05 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87472 5.5 5:a7cead30:::benchmark_data_smithi037_101035_object87471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5192806130000003, 2023-10-08T06:58:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018645680000000001, 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87472 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630039+0000", 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630040+0000", 2023-10-08T06:58:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630068+0000", 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8051999999999998e-05 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630075+0000", 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7479999999999996e-06 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.630081+0000", 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3620000000000002e-06 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.638291+0000", 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082094690000000005 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.638464+0000", 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017341599999999999 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648549+0000", 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010085333 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648608+0000", 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8851000000000003e-05 2023-10-08T06:58:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.648685+0000", 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6857e-05 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87884 5.9 5:94066ae9:::benchmark_data_smithi037_101035_object87883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.340628486, 2023-10-08T06:58:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018118507999999998, 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87884 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808691+0000", 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808692+0000", 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.72e-07 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808782+0000", 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9810999999999998e-05 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808787+0000", 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1139999999999997e-06 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808790+0000", 2023-10-08T06:58:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.534e-06 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808830+0000", 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9931000000000001e-05 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.808950+0000", 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120207 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.809094+0000", 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014389700000000001 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.815082+0000", 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059875049999999997 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826722+0000", 2023-10-08T06:58:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011640113000000001 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826773+0000", 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1487999999999999e-05 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.826810+0000", 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6535999999999997e-05 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2585532740000001, 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.240 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:21.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:21.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.246 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2568369719999999, 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:21.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:21.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2550191509999999, 2023-10-08T06:58:21.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:21.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:21.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.253014855, 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.260 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:21.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:21.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.266 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.252898539, 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.267 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:21.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:21.273 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2450085909999999, 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:21.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:21.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:21.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:21.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:21.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:21.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2422623960000001, 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:21.281 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:21.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:21.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:21.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:21.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:21.288 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:21.288 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:21.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:21.289 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:21.277+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:21.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 41 16 98588 98572 150.25 150.625 0.00366133 0.00665327 2023-10-08T06:58:21.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:21.378+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:21.466 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:98821 5.f e42/20 5:fbb6ee1d:::benchmark_data_smithi037_101035_object98820:head v 42'6270, mlcod=42'6266)", 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.463334+0000", 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002020184, 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020414349999999999, 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463334+0000", 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463334+0000", 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463335+0000", 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6299999999999993e-07 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463396+0000", 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1106999999999996e-05 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463406+0000", 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0210000000000001e-05 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463414+0000", 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7209999999999994e-06 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463459+0000", 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4388000000000003e-05 2023-10-08T06:58:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463480+0000", 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1614e-05 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:98830 5.b 5:dbdc977f:::benchmark_data_smithi037_101035_object98829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.463722+0000", 2023-10-08T06:58:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0016323519999999999, 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001736869, 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 98830 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463722+0000", 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463722+0000", 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463723+0000", 2023-10-08T06:58:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8700000000000005e-07 2023-10-08T06:58:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463776+0000", 2023-10-08T06:58:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3034000000000001e-05 2023-10-08T06:58:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463786+0000", 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0281e-05 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463794+0000", 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5410000000000003e-06 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463842+0000", 2023-10-08T06:58:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8337999999999997e-05 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.463930+0000", 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8058000000000003e-05 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:98829 5.f e42/20 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head v 42'6271, mlcod=42'6266)", 2023-10-08T06:58:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.465002+0000", 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00035191200000000001, 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000526407, 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465002+0000", 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465002+0000", 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465003+0000", 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0100000000000004e-07 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465056+0000", 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2432999999999998e-05 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465065+0000", 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4020000000000008e-06 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465072+0000", 2023-10-08T06:58:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0430000000000002e-06 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465236+0000", 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016405599999999999 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465255+0000", 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8839e-05 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:98834 5.0 5:0d999d56:::benchmark_data_smithi037_101035_object98833:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.465407+0000", 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9999471, 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018506800000000001, 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:21.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 98834 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465407+0000", 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465407+0000", 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465409+0000", 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.195e-06 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465468+0000", 2023-10-08T06:58:21.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9364000000000003e-05 2023-10-08T06:58:21.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465478+0000", 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0454e-05 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465486+0000", 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7009999999999996e-06 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.465528+0000", 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1703999999999999e-05 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:98813 5.a 5:521764c5:::benchmark_data_smithi037_101035_object98812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.457821+0000", 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0075330609999999998, 2023-10-08T06:58:21.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078484309999999995, 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 98813 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.457821+0000", 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.457821+0000", 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.457822+0000", 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.032e-06 2023-10-08T06:58:21.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.457884+0000", 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1546999999999999e-05 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.457897+0000", 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.293e-05 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.457904+0000", 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5789999999999998e-06 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.457963+0000", 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8226000000000001e-05 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.458097+0000", 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013393699999999999 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:98817 5.a 5:578be77b:::benchmark_data_smithi037_101035_object98816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:21.495 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.459337+0000", 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0060177390000000002, 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064121079999999997, 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 98817 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459337+0000", 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459337+0000", 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459338+0000", 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459386+0000", 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8807000000000002e-05 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459396+0000", 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9879999999999999e-06 2023-10-08T06:58:21.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459404+0000", 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9880000000000004e-06 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.460187+0000", 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00078246700000000001 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.460317+0000", 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000130106 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:98819 5.a 5:59503159:::benchmark_data_smithi037_101035_object98818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.459545+0000", 2023-10-08T06:58:21.500 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0058089500000000002, 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062695989999999998, 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 98819 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459545+0000", 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459545+0000", 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459546+0000", 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7000000000000004e-07 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459605+0000", 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8804999999999997e-05 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459616+0000", 2023-10-08T06:58:21.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0766e-05 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.459623+0000", 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0419999999999997e-06 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.462336+0000", 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027128819999999998 2023-10-08T06:58:21.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.462477+0000", 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014152199999999999 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:98823 5.a 5:50005ea1:::benchmark_data_smithi037_101035_object98822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:21.505 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.461013+0000", 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0043413760000000001, 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048435639999999999, 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 98823 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461013+0000", 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461013+0000", 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461014+0000", 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0100000000000005e-07 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461079+0000", 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5026999999999999e-05 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461087+0000", 2023-10-08T06:58:21.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3499999999999997e-06 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461091+0000", 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0539999999999996e-06 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.464733+0000", 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036421840000000001 2023-10-08T06:58:21.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.464872+0000", 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000138775 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:98825 5.4 5:23827187:::benchmark_data_smithi037_101035_object98824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.461234+0000", 2023-10-08T06:58:21.510 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0041208219999999997, 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046622599999999997, 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 98825 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:21.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461234+0000", 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461234+0000", 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461234+0000", 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8500000000000001e-07 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461270+0000", 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6084000000000002e-05 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:21.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461281+0000", 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0733e-05 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461287+0000", 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1809999999999998e-06 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461333+0000", 2023-10-08T06:58:21.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5861e-05 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.461449+0000", 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115846 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 9 2023-10-08T06:58:21.515 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:21.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:21.517 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:21.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:21.516+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:21.618 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:21.617+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:21.673 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:21.682 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:21.682 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:21.682 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:21.682 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:21.682 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:21.692 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:21.733 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:21.732+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:21.750 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:21.753 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:21.753 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:21.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:21.821+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:21.906 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:21.906 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:21.922 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:21.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:21.923+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:22.026 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:22.025+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:22.105 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:22.106 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:22.122 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:22.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:22.165+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:22.229 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:22.227+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:22.301 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:22.301 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:22.317 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:22.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:22.358+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:22.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 42 16 100675 100659 149.778 130.438 0.00437643 0.00667401 2023-10-08T06:58:22.430 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:22.429+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:22.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2023-10-08T06:58:22.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:58:22.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:22.530+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:22.542 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:22.543 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:22.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:22.632 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:22.631+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:22.733 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:22.732+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:22.736 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:22.736 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:22.753 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:22.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:22.833+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:22.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:22.934+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:22.962 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:22.962 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:22.976 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:23.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:23.035+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:23.137 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:23.136+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:23.156 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:23.156 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:23.169 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:23.239 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:23.238+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:23.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:23.338+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:23.356 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:23.356 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:23.364 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 43 16 103068 103052 149.772 149.562 0.00970047 0.00667408 2023-10-08T06:58:23.369 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:58:23.440 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:23.439+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:23.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:23.539+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:23.590 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:23.590 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:23.605 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:23.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:23.645+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:23.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:23.742+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:23.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:23.801 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2023-10-08T06:58:23.801 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T06:58:23.801 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2023-10-08T06:58:23.802 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T06:58:23.802 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-08T06:58:23.802 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-08T06:58:23.824 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-08T06:58:23.826 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T06:58:23.835 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:23.836 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:23.844 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:23.843+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:23.846 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:23.849 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-08T06:58:23.905 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:23.927 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:23.930 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:23.930 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:23.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:23.944+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:24.018 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:24.018 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:24.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:104594 5.9 e43/20 5:9ca3b69b:::benchmark_data_smithi037_101035_object104593:head v 43'6524, mlcod=43'6521)", 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:24.015334+0000", 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00296744, 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029850329999999998, 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015334+0000", 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015334+0000", 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015335+0000", 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4000000000000002e-07 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015401+0000", 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6586000000000002e-05 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015410+0000", 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8810000000000002e-06 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015415+0000", 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8319999999999996e-06 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015458+0000", 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2945999999999998e-05 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.015474+0000", 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.668e-05 2023-10-08T06:58:24.022 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:104595 5.9 e43/20 5:920a7b12:::benchmark_data_smithi037_101035_object104594:head v 43'6525, mlcod=43'6521)", 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:24.017050+0000", 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0012516929999999999, 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013090210000000001, 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017050+0000", 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017050+0000", 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017050+0000", 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9900000000000001e-07 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017109+0000", 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9030000000000002e-05 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017125+0000", 2023-10-08T06:58:24.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6222000000000002e-05 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017131+0000", 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9780000000000002e-06 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017171+0000", 2023-10-08T06:58:24.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9780000000000002e-05 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017183+0000", 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1915e-05 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:104598 5.f e43/20 5:ff9e91ab:::benchmark_data_smithi037_101035_object104597:head v 43'6654, mlcod=43'6650)", 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:24.017903+0000", 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00039822700000000002, 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049001399999999999, 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:24.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017903+0000", 2023-10-08T06:58:24.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017903+0000", 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017904+0000", 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0399999999999996e-07 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017987+0000", 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3789999999999996e-05 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.017994+0000", 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3899999999999998e-06 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.018000+0000", 2023-10-08T06:58:24.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8200000000000002e-06 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.018038+0000", 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8770999999999999e-05 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:24.018057+0000", 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8578999999999999e-05 2023-10-08T06:58:24.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.033 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:24.033 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 3 2023-10-08T06:58:24.033 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:24.034 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:24.080 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:24.079+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:24.146 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:24.146+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:24.206 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:24.206 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:24.206 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:24.206 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:24.206 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:24.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:24.264 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:24.263+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:24.349 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:24.348+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:24.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 44 16 105449 105433 149.75 148.812 0.00942768 0.00667516 2023-10-08T06:58:24.448 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:24.448 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:24.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:24.448 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:24.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.448 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.580519852999998, 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.449 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:24.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:24.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.455 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.577811634, 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:24.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:24.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.574819343999998, 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:24.463 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:24.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5597784820000005, 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:24.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:24.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:24.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:24.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:24.477 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5596756249999997, 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:24.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:24.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5596123320000004, 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:24.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5593390539999996, 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.490 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:24.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.556349011, 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.496 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:24.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5549980830000001, 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:24.502 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:24.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5548593200000003, 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.508 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:24.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:24.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5544808559999996, 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:24.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5523193219999998, 2023-10-08T06:58:24.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:24.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:24.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:24.524 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5439804390000003, 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:24.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:24.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:24.530 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.7805516209999999, 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:24.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:24.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.7800069600000001, 2023-10-08T06:58:24.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:24.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:24.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:24.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.7799187010000002, 2023-10-08T06:58:24.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:24.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:24.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.7798842750000001, 2023-10-08T06:58:24.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:24.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:24.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:24.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:24.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.7787896989999998, 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:24.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:24.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:24.559 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.7782658659999999, 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:24.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:24.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:24.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:24.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:24.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.777307644, 2023-10-08T06:58:24.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:24.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:24.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:24.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:24.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:24.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:24.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:24.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:24.574 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:24.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:24.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:24.574+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:24.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:24.675+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:24.760 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:24.760 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:24.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.760 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106417 5.2 5:48c723a7:::benchmark_data_smithi037_101035_object106416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.760 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.757105+0000", 2023-10-08T06:58:24.760 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0020470779999999999, 2023-10-08T06:58:24.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020678150000000002, 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106417 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757105+0000", 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757105+0000", 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757106+0000", 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8999999999999995e-07 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757176+0000", 2023-10-08T06:58:24.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0609000000000001e-05 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757186+0000", 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0610000000000002e-06 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757193+0000", 2023-10-08T06:58:24.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4390000000000003e-06 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757241+0000", 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8361e-05 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757366+0000", 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012424499999999999 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106418 5.c 5:3b99f134:::benchmark_data_smithi037_101035_object106417:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.757250+0000", 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001901862, 2023-10-08T06:58:24.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019709250000000001, 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106418 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757250+0000", 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757250+0000", 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757251+0000", 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3200000000000004e-07 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757364+0000", 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112884 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757373+0000", 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1290000000000002e-06 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757380+0000", 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4660000000000002e-06 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757418+0000", 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7274999999999998e-05 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757494+0000", 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6299999999999998e-05 2023-10-08T06:58:24.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106401 5.d 5:b157cd4c:::benchmark_data_smithi037_101035_object106400:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.750201+0000", 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0089513419999999993, 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0090631340000000005, 2023-10-08T06:58:24.772 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106401 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750201+0000", 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750201+0000", 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750201+0000", 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2600000000000002e-07 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750233+0000", 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2193000000000002e-05 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750240+0000", 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9800000000000001e-06 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750246+0000", 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.592e-06 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752441+0000", 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002195102 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752580+0000", 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013844500000000001 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752696+0000", 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116575 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756903+0000", 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042072760000000002 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106402 5.d 5:bec4a3f7:::benchmark_data_smithi037_101035_object106401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.750296+0000", 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0088562039999999995, 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0090157180000000007, 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106402 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750296+0000", 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750296+0000", 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750296+0000", 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1600000000000001e-07 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750340+0000", 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3866000000000003e-05 2023-10-08T06:58:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750348+0000", 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3860000000000001e-06 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.750353+0000", 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3970000000000002e-06 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754287+0000", 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003934028 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754407+0000", 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119901 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754550+0000", 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014278699999999999 2023-10-08T06:58:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106404 5.5 5:abc128b1:::benchmark_data_smithi037_101035_object106403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.752179+0000", 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0069728029999999996, 2023-10-08T06:58:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071853669999999998, 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106404 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752179+0000", 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752179+0000", 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752180+0000", 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9000000000000005e-07 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752252+0000", 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2217000000000003e-05 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752267+0000", 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.482e-05 2023-10-08T06:58:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752276+0000", 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2099999999999993e-06 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754276+0000", 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020002869999999999 2023-10-08T06:58:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754402+0000", 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125897 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106405 5.2 5:47bac60c:::benchmark_data_smithi037_101035_object106404:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.752489+0000", 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.006662861, 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069160599999999999, 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106405 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752489+0000", 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752489+0000", 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752490+0000", 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8100000000000001e-07 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752560+0000", 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0394000000000004e-05 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752571+0000", 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0723999999999999e-05 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752580+0000", 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9630000000000004e-06 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752633+0000", 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3276000000000003e-05 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752756+0000", 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012258000000000001 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106407 5.9 5:9a655094:::benchmark_data_smithi037_101035_object106406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.752976+0000", 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0061764180000000004, 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006469776, 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106407 2023-10-08T06:58:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752976+0000", 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752976+0000", 2023-10-08T06:58:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.752977+0000", 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.17e-06 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.753070+0000", 2023-10-08T06:58:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3104999999999997e-05 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.753082+0000", 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2115e-05 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.753090+0000", 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4470000000000006e-06 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.753648+0000", 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055762599999999998 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.753767+0000", 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011914 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.753860+0000", 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2614999999999993e-05 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757035+0000", 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031755720000000002 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106408 5.3 5:c79eaac3:::benchmark_data_smithi037_101035_object106407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.754048+0000", 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0051042099999999997, 2023-10-08T06:58:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054466489999999996, 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106408 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754048+0000", 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754048+0000", 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754049+0000", 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6500000000000008e-07 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754136+0000", 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6958000000000003e-05 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754145+0000", 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5510000000000005e-06 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754152+0000", 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1280000000000002e-06 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754200+0000", 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7895000000000001e-05 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.754330+0000", 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013004299999999999 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:106410 5.1 5:80f8e99b:::benchmark_data_smithi037_101035_object106409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:24.756740+0000", 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0024119390000000001, 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027945489999999999, 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 106410 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756740+0000", 2023-10-08T06:58:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756740+0000", 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756741+0000", 2023-10-08T06:58:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.61e-07 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756880+0000", 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000139586 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756888+0000", 2023-10-08T06:58:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6769999999999995e-06 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756893+0000", 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0719999999999999e-06 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.756944+0000", 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0337000000000003e-05 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:24.757041+0000", 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7139999999999995e-05 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 9 2023-10-08T06:58:24.817 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:24.818 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:24.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:24.817+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:24.919 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:24.918+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:25.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:25.018+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:25.041 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:25.041 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:25.042 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:25.042 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:25.042 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:25.057 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:25.121 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:25.120+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:25.221 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:25.220+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:25.283 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.407642006000003, 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:25.284 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:25.292 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.400807618000002, 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.293 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:25.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:25.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:25.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:25.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:25.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:25.304 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.086366039000001, 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:25.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.590663154, 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.313 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:25.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.314 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:25.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:25.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:25.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:25.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:25.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.320 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87289 5.9 5:98d1113d:::benchmark_data_smithi037_101035_object87288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.7330540859999992, 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019973653000000001, 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.321 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87289 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:25.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548143+0000", 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.16e-07 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548198+0000", 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4746000000000001e-05 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548209+0000", 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.101e-05 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548217+0000", 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9780000000000005e-06 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557493+0000", 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092760280000000004 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557596+0000", 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010299800000000001 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557689+0000", 2023-10-08T06:58:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3498000000000005e-05 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.560241+0000", 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025519380000000001 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568028+0000", 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077864780000000003 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568076+0000", 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8010999999999998e-05 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568116+0000", 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0151999999999998e-05 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.3904297359999997, 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:25.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:25.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.334 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.3887134339999996, 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.335 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:25.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:25.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.3868956130000001, 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.343 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:25.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:25.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.349 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.3848913170000001, 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.350 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:25.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:25.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.356 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.3847750010000004, 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.357 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:25.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:25.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.363 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.3768850529999996, 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.364 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:25.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:25.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.3741388580000002, 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:25.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:25.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.378 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8175287620000002, 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.379 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8167674429999998, 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.387 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:25.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8128517369999999, 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:25.394 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:25.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:25.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:25.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:25.400 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8126888569999999, 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:25.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:25.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:25.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:25.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8110258730000002, 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:25.407 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:25.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:25.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.413 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8107594210000002, 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:25.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:25.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.808004054, 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.420 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:25.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:25.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.8056937319999999, 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:25.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:25.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:25.430 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:25.431 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:25.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:58:25.432 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 45 16 107845 107829 149.75 149.75 0.00561537 0.00667531 2023-10-08T06:58:25.433 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:25.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:25.431+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:25.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:25.532+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:25.613 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108444 5.4 5:2d683666:::benchmark_data_smithi037_101035_object108443:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.605783+0000", 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0071046420000000004, 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071242110000000001, 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108444 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.605783+0000", 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.605783+0000", 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.605784+0000", 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9100000000000004e-07 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.605845+0000", 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1597e-05 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.605852+0000", 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9739999999999996e-06 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.605857+0000", 2023-10-08T06:58:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9089999999999999e-06 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610326+0000", 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004468573 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610478+0000", 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000152285 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108451 5.b 5:d72e07a2:::benchmark_data_smithi037_101035_object108450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.609166+0000", 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0037216879999999999, 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037884770000000002, 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108451 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609166+0000", 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609166+0000", 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609167+0000", 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8899999999999998e-07 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609203+0000", 2023-10-08T06:58:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6449999999999998e-05 2023-10-08T06:58:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609218+0000", 2023-10-08T06:58:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4859e-05 2023-10-08T06:58:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609226+0000", 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5820000000000004e-06 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609282+0000", 2023-10-08T06:58:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5940000000000003e-05 2023-10-08T06:58:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.609472+0000", 2023-10-08T06:58:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190633 2023-10-08T06:58:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108454 5.4 5:2edea52d:::benchmark_data_smithi037_101035_object108453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.610720+0000", 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002167979, 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022756510000000001, 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108454 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610720+0000", 2023-10-08T06:58:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610720+0000", 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610721+0000", 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610784+0000", 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3258999999999999e-05 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610796+0000", 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2286999999999999e-05 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.610806+0000", 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9250000000000007e-06 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612479+0000", 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016728050000000001 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612598+0000", 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118788 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108455 5.b 5:d3760747:::benchmark_data_smithi037_101035_object108454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.611091+0000", 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0017967409999999999, 2023-10-08T06:58:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019433530000000001, 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108455 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611091+0000", 2023-10-08T06:58:25.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611091+0000", 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611092+0000", 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1900000000000002e-07 2023-10-08T06:58:25.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611172+0000", 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0054000000000003e-05 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611181+0000", 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4239999999999999e-06 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611188+0000", 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3319999999999997e-06 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611290+0000", 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010254700000000001 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611465+0000", 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017448299999999999 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108458 5.0 5:0ba1897d:::benchmark_data_smithi037_101035_object108457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.611970+0000", 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00091795099999999997, 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001104086, 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.635 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108458 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611970+0000", 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611970+0000", 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.611971+0000", 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3799999999999996e-07 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612069+0000", 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.789e-05 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612085+0000", 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6109000000000001e-05 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612093+0000", 2023-10-08T06:58:25.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2910000000000007e-06 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612152+0000", 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8718999999999998e-05 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612296+0000", 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014456000000000001 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.639 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108462 5.4 5.13b74e54 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.612433+0000", 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00045428299999999999, 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00068234299999999997, 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108462 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612433+0000", 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612433+0000", 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612434+0000", 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.02e-07 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612522+0000", 2023-10-08T06:58:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7665999999999997e-05 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612534+0000", 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2234e-05 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612546+0000", 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1472e-05 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.643 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108463 5.b 5.dc24b9ab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.612563+0000", 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00032433599999999999, 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058911900000000004, 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.644 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108463 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612563+0000", 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612563+0000", 2023-10-08T06:58:25.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612564+0000", 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8100000000000002e-07 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612602+0000", 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8121999999999999e-05 2023-10-08T06:58:25.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612612+0000", 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8260000000000005e-06 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612618+0000", 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1040000000000003e-06 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:108464 5.b 5.321243eb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:25.612632+0000", 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00025593700000000003, 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00056747600000000003, 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:25.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 108464 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612632+0000", 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612632+0000", 2023-10-08T06:58:25.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612632+0000", 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6700000000000003e-07 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612667+0000", 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4276999999999997e-05 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612676+0000", 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0399999999999998e-06 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:25.612682+0000", 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5409999999999997e-06 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:25.652 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:25.652 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2023-10-08T06:58:25.652 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:25.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:25.654 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:25.652+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:25.754 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:25.753+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:25.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:25.854+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:25.873 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:25.873 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:25.873 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:25.873 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:25.873 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:25.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:25.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:25.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:25.955+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:26.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:26.056+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:26.085 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:26.105 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:26.105 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:26.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:26.105 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:26.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.237460714999997, 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:26.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:26.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:26.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:26.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:26.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:26.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.234752495999999, 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:26.113 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:26.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.231760205999997, 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.120 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:26.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:26.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:26.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:26.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:26.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2167193440000004, 2023-10-08T06:58:26.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:26.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:26.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2166164869999996, 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:26.133 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:26.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2165531940000003, 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:26.139 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:26.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2162799160000004, 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:26.145 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:26.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.151 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2132898729999999, 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:26.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:26.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.211938945, 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:26.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2118001820000002, 2023-10-08T06:58:26.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:26.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2114217180000004, 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.171 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:26.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2092601839999997, 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:26.176 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:26.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:26.181 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.2009213010000002, 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:26.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:26.187 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4374924829999998, 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:26.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:26.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:26.193 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4369478219999996, 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:26.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:26.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4368595629999996, 2023-10-08T06:58:26.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:26.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:26.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:26.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.205 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4368251369999996, 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:26.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4357305609999997, 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.211 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:26.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4352067279999998, 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.217 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:26.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4342485060000003, 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:26.223 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:26.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:26.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:26.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:26.228 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:26.229 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:26.230 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:26.231 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:26.229+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:26.231 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:26.232 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:26.232 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:26.232 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:26.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:26.330+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:26.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 46 16 110333 110317 149.875 155.5 0.00706119 0.00666988 2023-10-08T06:58:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:58:26.422 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:26.423 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:26.432 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:26.431+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:26.438 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:26.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:26.532+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:26.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:26.632+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:26.663 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:26.663 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:26.677 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:26.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:26.763+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:26.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:26.834+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:26.915 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:26.915 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:26.931 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:26.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:26.971+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:27.037 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:27.036+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:27.104 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:27.105 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:27.118 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:27.159 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:27.158+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:27.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:27.238+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:27.333 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:27.334 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:27.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:27.339+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:27.350 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:27.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 47 16 112728 112712 149.87 149.688 0.00538279 0.0066699 2023-10-08T06:58:27.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:27.439+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:27.530 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:27.530 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:27.542 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:27.541+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:27.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:27.642 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:27.641+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:27.725 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:27.725 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:27.739 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:27.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:27.782+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:27.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:27.843+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:27.850 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T06:58:27.928 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:27.928 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:27.944 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:27.960 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-08T06:58:27.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:27.984+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:28.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:28.045+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:28.147 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:28.146+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:28.169 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:28.169 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:28.186 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:28.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:28.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2023-10-08T06:58:28.250 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:28.247+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:28.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:28.347+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:28.358 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:28.359 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:28.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 48 16 115095 115079 149.83 147.938 0.00246431 0.00667165 2023-10-08T06:58:28.374 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:28.384 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:28.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:58:28.404 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:28.408 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:28.409 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:28.458 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:28.457+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:28.550 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:28.549+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:28.599 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:28.599 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:28.600 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:28.600 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:28.600 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:28.615 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:28.656 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:28.655+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:28.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:28.752+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:28.836 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.969180190000003, 2023-10-08T06:58:28.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:28.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:28.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:28.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:28.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:28.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:28.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:28.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.966471970999997, 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.846 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:28.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.847 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:28.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:28.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:28.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:28.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:28.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:28.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:28.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:28.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:28.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:28.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:28.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:28.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:28.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:28.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:28.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:28.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:28.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:28.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:28.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:28.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:28.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:28.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:28.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:28.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:28.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:28.859 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.859 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.859 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.859 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:28.859 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:28.860 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.963479681000003, 2023-10-08T06:58:28.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:28.860 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.860 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.860 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:28.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:28.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:28.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:28.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:28.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:28.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:28.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:28.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:28.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:28.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:28.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:28.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:28.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:28.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:28.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:28.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.868 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.869 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.869 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.869 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:28.869 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9484388189999997, 2023-10-08T06:58:28.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:28.870 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.870 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.870 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.870 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.870 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.870 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:28.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.871 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:28.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:28.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:28.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:28.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:28.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:28.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:28.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:28.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:28.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:28.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:28.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:28.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:28.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:28.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:28.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:28.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:28.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:28.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:28.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:28.881 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.881 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.881 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.882 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.882 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:28.882 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9483359619999998, 2023-10-08T06:58:28.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:28.882 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.882 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.883 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:28.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.883 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:28.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:28.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:28.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:28.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:28.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:28.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:28.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:28.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:28.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:28.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:28.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:28.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9482726689999996, 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.892 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:28.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.897 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9479993909999997, 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.898 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:28.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:28.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.903 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9450093479999992, 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:28.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:28.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.909 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9436584200000002, 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:28.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:28.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.915 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9435196569999995, 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:28.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:28.921 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9431411930000007, 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:28.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9409796589999999, 2023-10-08T06:58:28.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.9326407759999995, 2023-10-08T06:58:28.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:28.934 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.934 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.935 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.935 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.935 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:28.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.935 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:28.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:28.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:28.941 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.941 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.941 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.169211958, 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.942 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:28.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:28.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:28.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:28.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:28.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:28.948 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.1686672969999998, 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.949 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:28.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:28.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:28.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:28.954 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.955 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.955 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:28.955 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:28.955 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.1685790379999998, 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:28.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.1685446119999998, 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:28.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:28.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:28.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:28.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:28.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:28.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:28.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:28.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:28.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:28.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:28.969 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.969 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.970 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.970 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:28.970 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:28.970 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.167450036, 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.971 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:28.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:28.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.976 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.1669262030000001, 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:28.977 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:28.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:28.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:28.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:28.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:28.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:28.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:28.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:28.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:28.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:28.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:28.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:28.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:28.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:28.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:28.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:28.986 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.986 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.986 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.986 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:28.987 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:28.987 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.1659679809999997, 2023-10-08T06:58:28.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:28.987 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:28.987 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:28.987 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:28.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:28.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:28.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:28.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:28.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:28.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:28.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:28.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:28.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:28.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:28.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:28.994 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:28.994 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:28.995 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:28.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:28.994+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:29.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:29.095+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:29.181 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:29.181 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:29.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117078 5.f 5:f05e43f2:::benchmark_data_smithi037_101035_object117077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.176344+0000", 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0040852320000000003, 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041138199999999998, 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.182 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117078 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176344+0000", 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176344+0000", 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176345+0000", 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7300000000000005e-07 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176447+0000", 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101946 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176456+0000", 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7850000000000003e-06 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176464+0000", 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4259999999999997e-06 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176518+0000", 2023-10-08T06:58:29.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4509999999999998e-05 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176654+0000", 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013538600000000001 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176785+0000", 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013118400000000001 2023-10-08T06:58:29.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179264+0000", 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024795239999999999 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117080 5.2 5:47ccc0d2:::benchmark_data_smithi037_101035_object117079:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.187 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.176987+0000", 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003442489, 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003562848, 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117080 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.188 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176987+0000", 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176987+0000", 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.176987+0000", 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7100000000000001e-07 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177046+0000", 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8408e-05 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177055+0000", 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6660000000000003e-06 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177063+0000", 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7400000000000004e-06 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177212+0000", 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000149171 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177346+0000", 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013359799999999999 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.192 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117081 5.d 5:b4a133da:::benchmark_data_smithi037_101035_object117080:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.177081+0000", 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0033480049999999998, 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003538322, 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.193 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117081 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177081+0000", 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177081+0000", 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177082+0000", 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6400000000000002e-07 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177114+0000", 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.239e-05 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177124+0000", 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9739999999999997e-06 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177131+0000", 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4669999999999998e-06 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177408+0000", 2023-10-08T06:58:29.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00027699400000000002 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177526+0000", 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000117069 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177645+0000", 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011934000000000001 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.197 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117082 5.2 5:4e7f7325:::benchmark_data_smithi037_101035_object117081:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.177143+0000", 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0032863860000000001, 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035527419999999998, 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:29.198 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117082 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177143+0000", 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177143+0000", 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177143+0000", 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3399999999999999e-07 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177173+0000", 2023-10-08T06:58:29.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9705000000000001e-05 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177179+0000", 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1539999999999999e-06 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.177185+0000", 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8930000000000002e-06 2023-10-08T06:58:29.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179596+0000", 2023-10-08T06:58:29.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002411065 2023-10-08T06:58:29.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179716+0000", 2023-10-08T06:58:29.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012040300000000001 2023-10-08T06:58:29.203 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.203 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.203 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117084 5.2 5.da87b952 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.178012+0000", 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0024174969999999998, 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027475329999999999, 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.205 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117084 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178012+0000", 2023-10-08T06:58:29.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178012+0000", 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178012+0000", 2023-10-08T06:58:29.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7800000000000001e-07 2023-10-08T06:58:29.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178069+0000", 2023-10-08T06:58:29.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6286000000000003e-05 2023-10-08T06:58:29.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178079+0000", 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0933e-05 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178087+0000", 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6170000000000001e-06 2023-10-08T06:58:29.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.211 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.212 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.214 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117085 5.6 5:63f6a385:::benchmark_data_smithi037_101035_object117084:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.214 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.178102+0000", 2023-10-08T06:58:29.214 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0023273410000000001, 2023-10-08T06:58:29.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027147400000000002, 2023-10-08T06:58:29.216 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.216 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:29.216 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.217 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.217 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.217 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117085 2023-10-08T06:58:29.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178102+0000", 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178102+0000", 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178102+0000", 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1799999999999995e-07 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178127+0000", 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4885e-05 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178134+0000", 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6640000000000001e-06 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178140+0000", 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9599999999999997e-06 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178179+0000", 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9050000000000001e-05 2023-10-08T06:58:29.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178259+0000", 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0669999999999998e-05 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117088 5.5 5:a4ed7883:::benchmark_data_smithi037_101035_object117087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.178956+0000", 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0014732879999999999, 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019281910000000001, 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117088 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178956+0000", 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178956+0000", 2023-10-08T06:58:29.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.178957+0000", 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6199999999999996e-07 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179042+0000", 2023-10-08T06:58:29.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5078000000000001e-05 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179057+0000", 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5034e-05 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179064+0000", 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5310000000000004e-06 2023-10-08T06:58:29.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179278+0000", 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00021352799999999999 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179444+0000", 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016645599999999999 2023-10-08T06:58:29.226 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117091 5.f 5:f041679a:::benchmark_data_smithi037_101035_object117090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.179473+0000", 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00095627899999999998, 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014810380000000001, 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:29.227 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117091 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179473+0000", 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179473+0000", 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179474+0000", 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1800000000000004e-07 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179535+0000", 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1489999999999996e-05 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179545+0000", 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3360000000000001e-06 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179552+0000", 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3839999999999999e-06 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179605+0000", 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2726999999999998e-05 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179735+0000", 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013042899999999999 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179836+0000", 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010045800000000001 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:117093 5.9 5:9c832e1d:::benchmark_data_smithi037_101035_object117092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.179723+0000", 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00070589700000000003, 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001305594, 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 117093 2023-10-08T06:58:29.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179723+0000", 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179723+0000", 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179724+0000", 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0899999999999999e-06 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179784+0000", 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9311999999999997e-05 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179796+0000", 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2162e-05 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179804+0000", 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7350000000000002e-06 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179852+0000", 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7142999999999999e-05 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.179966+0000", 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114491 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.180129+0000", 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016280099999999999 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 9 2023-10-08T06:58:29.238 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:29.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:29.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:29.238+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:29.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:29.339+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:29.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 49 16 117525 117509 149.871 151.875 0.00568372 0.00666985 2023-10-08T06:58:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:58:29.441 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:29.440+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:29.463 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:29.463 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:29.464 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:29.464 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:29.464 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:29.478 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:29.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:29.561+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:29.643 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:29.643+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:29.715 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:29.715 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.839015826000001, 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:29.716 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:29.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:29.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:29.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:29.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.832181437999999, 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.517739858999999, 2023-10-08T06:58:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:29.734 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.734 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.734 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.734 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.734 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.734 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:29.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.735 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:29.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:29.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:29.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:29.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:29.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:29.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:29.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:29.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:29.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:29.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:29.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:29.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:29.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:29.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:29.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:29.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:29.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:29.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:29.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:29.745 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.022036973999999, 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:29.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:29.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:29.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:29.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:29.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:29.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:29.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:29.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:29.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:29.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:29.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:29.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:29.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:29.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:87289 5.9 5:98d1113d:::benchmark_data_smithi037_101035_object87288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T06:58:29.755 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.164427906, 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019973653000000001, 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 87289 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548142+0000", 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548143+0000", 2023-10-08T06:58:29.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.16e-07 2023-10-08T06:58:29.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548198+0000", 2023-10-08T06:58:29.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4746000000000001e-05 2023-10-08T06:58:29.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548209+0000", 2023-10-08T06:58:29.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.101e-05 2023-10-08T06:58:29.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.548217+0000", 2023-10-08T06:58:29.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9780000000000005e-06 2023-10-08T06:58:29.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557493+0000", 2023-10-08T06:58:29.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092760280000000004 2023-10-08T06:58:29.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557596+0000", 2023-10-08T06:58:29.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010299800000000001 2023-10-08T06:58:29.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.557689+0000", 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3498000000000005e-05 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.560241+0000", 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025519380000000001 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568028+0000", 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077864780000000003 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568076+0000", 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8010999999999998e-05 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:16.568116+0000", 2023-10-08T06:58:29.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0151999999999998e-05 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8218035560000008, 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:29.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:29.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:29.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8200872540000006, 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:29.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8182694329999993, 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.778 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:29.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:29.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:29.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8162651370000003, 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.785 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:29.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8161488210000005, 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:29.792 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:29.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:29.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:29.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:29.799 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8082588729999998, 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:29.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:29.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8055126779999995, 2023-10-08T06:58:29.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:29.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:29.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.2489025819999995, 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:29.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:29.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:29.819 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.2481412630000008, 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.820 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:29.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:29.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:29.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:29.826 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.244225557, 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.827 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:29.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.2440626770000005, 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.833 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:29.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.2423996929999994, 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.839 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:29.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.845 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.2421332409999994, 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.2393778740000005, 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.852 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:29.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.2370675519999992, 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:29.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:29.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:29.862 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:29.864 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:29.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:29.862+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:29.965 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:29.964+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:30.036 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:30.036 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:30.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.036 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:119094 5.d e45/32 5:baf8069d:::benchmark_data_smithi037_101035_object119093:head v 45'7322, mlcod=45'7320)", 2023-10-08T06:58:30.037 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:30.032788+0000", 2023-10-08T06:58:30.037 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0026266589999999999, 2023-10-08T06:58:30.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026503360000000001, 2023-10-08T06:58:30.037 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.037 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:30.037 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032788+0000", 2023-10-08T06:58:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032788+0000", 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032789+0000", 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7700000000000004e-07 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032840+0000", 2023-10-08T06:58:30.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0889e-05 2023-10-08T06:58:30.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032849+0000", 2023-10-08T06:58:30.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8540000000000003e-06 2023-10-08T06:58:30.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032854+0000", 2023-10-08T06:58:30.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0590000000000002e-06 2023-10-08T06:58:30.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032895+0000", 2023-10-08T06:58:30.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1325999999999997e-05 2023-10-08T06:58:30.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.032917+0000", 2023-10-08T06:58:30.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1624000000000002e-05 2023-10-08T06:58:30.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.043 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:119104 5.b 5:dbc5a552:::benchmark_data_smithi037_101035_object119103:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:30.033634+0000", 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001781625, 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018759510000000001, 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.044 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:30.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.045 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119104 2023-10-08T06:58:30.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.045 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033634+0000", 2023-10-08T06:58:30.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033634+0000", 2023-10-08T06:58:30.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033635+0000", 2023-10-08T06:58:30.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.111e-06 2023-10-08T06:58:30.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033692+0000", 2023-10-08T06:58:30.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7213000000000003e-05 2023-10-08T06:58:30.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033705+0000", 2023-10-08T06:58:30.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3196e-05 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033713+0000", 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6459999999999993e-06 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033767+0000", 2023-10-08T06:58:30.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3884000000000001e-05 2023-10-08T06:58:30.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.033908+0000", 2023-10-08T06:58:30.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014120699999999999 2023-10-08T06:58:30.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.053 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.054 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:119109 5.d e45/32 5:b0f1436b:::benchmark_data_smithi037_101035_object119108:head v 45'7323, mlcod=45'7320)", 2023-10-08T06:58:30.054 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:30.034787+0000", 2023-10-08T06:58:30.054 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00062858200000000003, 2023-10-08T06:58:30.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079203800000000001, 2023-10-08T06:58:30.054 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.055 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:30.055 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034787+0000", 2023-10-08T06:58:30.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034787+0000", 2023-10-08T06:58:30.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034787+0000", 2023-10-08T06:58:30.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2600000000000002e-07 2023-10-08T06:58:30.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034837+0000", 2023-10-08T06:58:30.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9636999999999999e-05 2023-10-08T06:58:30.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034857+0000", 2023-10-08T06:58:30.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0227000000000001e-05 2023-10-08T06:58:30.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034864+0000", 2023-10-08T06:58:30.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2840000000000001e-06 2023-10-08T06:58:30.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034902+0000", 2023-10-08T06:58:30.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7666999999999997e-05 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.034915+0000", 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3309000000000001e-05 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:119111 5.a 5.b5c16eea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:30.063 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:30.035504+0000", 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9999108, 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013441399999999999, 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119111 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.064 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.035504+0000", 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.035504+0000", 2023-10-08T06:58:30.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.035505+0000", 2023-10-08T06:58:30.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2900000000000002e-07 2023-10-08T06:58:30.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.035555+0000", 2023-10-08T06:58:30.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0096999999999998e-05 2023-10-08T06:58:30.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.035567+0000", 2023-10-08T06:58:30.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2023-10-08T06:58:30.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.035575+0000", 2023-10-08T06:58:30.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0630000000000006e-06 2023-10-08T06:58:30.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:30.035626+0000", 2023-10-08T06:58:30.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1338000000000002e-05 2023-10-08T06:58:30.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.070 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.071 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:30.071 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 4 2023-10-08T06:58:30.071 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:30.074 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:30.074 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:30.072+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:30.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:30.172+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:30.274 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:30.273+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:30.287 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:30.288 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:30.288 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:30.288 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:30.288 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:30.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:30.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 50 16 119940 119924 149.892 150.938 0.00535022 0.00666884 2023-10-08T06:58:30.389 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:30.388+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:30.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:30.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:30.475+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.661244502000002, 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.658536282999997, 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.655543993000002, 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.640503130999999, 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.640400273999999, 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:30.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:30.560 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.640336981000001, 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.561 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:30.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:30.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:30.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:30.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:30.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.570 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.640063702999999, 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:30.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:30.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:30.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.63707366, 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.583 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.635722732, 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.635583969000001, 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.590 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:30.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:30.595 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.635205505, 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.596 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.633043970999999, 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:30.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:30.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:30.606 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.624705088000001, 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:30.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:30.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:30.613 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8612762699999994, 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:30.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:30.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.619 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8607316090000001, 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:30.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:30.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8606433500000001, 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:30.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:30.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.631 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.632 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.632 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:30.632 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8606089239999992, 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:30.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:30.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.637 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8595143479999994, 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:30.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:30.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:30.645 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8589905150000003, 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:30.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:30.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:30.651 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8580322930000008, 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:30.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:30.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:30.657 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:30.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:30.657+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:30.658 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:30.658 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:30.659 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:30.660 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:30.660 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:30.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:30.757+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:30.845 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:30.845 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:30.859 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:30.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:30.859+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:30.961 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:30.960+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:31.048 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:31.048 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:31.062 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:31.063 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:31.060+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:31.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:31.161+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:31.252 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:31.252 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:31.261 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:31.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:31.302+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:31.363 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:31.362+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:31.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 51 16 122310 122294 149.858 148.125 0.00571814 0.00667053 2023-10-08T06:58:31.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:58:31.443 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:31.444 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:31.458 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:31.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:31.464+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:31.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:31.566+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:31.670 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:31.670 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:31.670 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:31.669+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:31.683 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:31.770 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:31.769+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:31.871 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:31.870+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:31.902 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:31.902 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:31.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:31.961 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T06:58:31.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:31.971+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:32.073 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:32.072+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:32.102 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:32.102 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:32.116 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:32.174 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:32.173+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:32.205 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-08T06:58:32.274 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:32.274+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:32.307 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-08T06:58:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:32.352 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:32.365 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 52 16 124680 124664 149.824 148.125 0.00504849 0.00667188 2023-10-08T06:58:32.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:32.397+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:32.402 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:58:32.407 DEBUG:teuthology.orchestra.console.smithi183:Waiting for login prompt 2023-10-08T06:58:32.408 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi183 2023-10-08T06:58:32.476 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:32.475+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:32.545 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:32.545 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:32.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:32.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:32.596+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:32.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:32.679 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:32.678+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:32.725 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:32.725 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:32.739 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:32.781 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:32.780+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:32.836 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:32.839 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:32.839 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:32.880 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:32.879+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:32.953 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:32.953 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:32.953 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:32.953 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:32.953 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:32.965 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:33.006 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:33.005+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:33.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:33.081+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:33.183 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:33.182+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:33.185 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:33.185 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:33.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:33.185 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:33.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.317825247999998, 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.186 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:33.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:33.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:33.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:33.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.315117029, 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.193 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:33.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:33.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:33.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.200 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.312124738999998, 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:33.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.297083877, 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.206 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:33.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:33.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.212 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.29698102, 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:33.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:33.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.218 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.296917727, 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.219 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:33.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.296644449, 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:33.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:33.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:33.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.293654406, 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:33.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:33.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:33.236 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.292303478000001, 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.237 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:33.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:33.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.292164715, 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.243 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:33.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.291786251, 2023-10-08T06:58:33.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:33.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:33.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.289624717000001, 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:33.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.281285834, 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.260 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:33.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:33.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:33.266 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.517857016000001, 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:33.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:33.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.272 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.517312355, 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:33.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:33.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.517224096, 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.279 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.51718967, 2023-10-08T06:58:33.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:33.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:33.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:33.290 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.516095094000001, 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:33.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:33.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.296 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.515571261, 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.514613039, 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:33.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.308 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:33.309 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:33.309 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:33.310 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:33.309+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:33.311 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:33.366 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 53 16 127080 127064 149.827 150 0.00506729 0.0066718 2023-10-08T06:58:33.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:33.410+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:33.503 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:33.503 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:33.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.503 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127394 5.d 5:b64a90e8:::benchmark_data_smithi037_101035_object127393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.503 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.500165+0000", 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0020867379999999999, 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021195340000000002, 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127394 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500165+0000", 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500165+0000", 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500166+0000", 2023-10-08T06:58:33.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2023-10-08T06:58:33.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500196+0000", 2023-10-08T06:58:33.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0324999999999998e-05 2023-10-08T06:58:33.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500209+0000", 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2368000000000001e-05 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500215+0000", 2023-10-08T06:58:33.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.285e-06 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.502127+0000", 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001912644 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.502257+0000", 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012984499999999999 2023-10-08T06:58:33.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127396 5.6 5:6c1c49f3:::benchmark_data_smithi037_101035_object127395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.500231+0000", 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0020206809999999999, 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021564890000000001, 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.512 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127396 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500231+0000", 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500231+0000", 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500232+0000", 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7299999999999996e-07 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500326+0000", 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4349000000000001e-05 2023-10-08T06:58:33.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500341+0000", 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4491999999999999e-05 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500348+0000", 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0090000000000001e-06 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500396+0000", 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8186000000000002e-05 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500520+0000", 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012397800000000001 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.516 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127400 5.f 5:fe23999a:::benchmark_data_smithi037_101035_object127399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.500723+0000", 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0015292509999999999, 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017514640000000001, 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127400 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500723+0000", 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500723+0000", 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500724+0000", 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5099999999999998e-07 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500768+0000", 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4793999999999998e-05 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500779+0000", 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0698e-05 2023-10-08T06:58:33.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500786+0000", 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2599999999999999e-06 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.502144+0000", 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0013579670000000001 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.502262+0000", 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000117441 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.502386+0000", 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000123903 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.521 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127378 5.f 5:f2ee6cb0:::benchmark_data_smithi037_101035_object127377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.491438+0000", 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.010813830999999999, 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01112634, 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127378 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.522 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.491438+0000", 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.491438+0000", 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.491439+0000", 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9199999999999999e-07 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.491498+0000", 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8848000000000003e-05 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.491510+0000", 2023-10-08T06:58:33.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2279000000000001e-05 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.491517+0000", 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2540000000000003e-06 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492291+0000", 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00077342399999999999 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492376+0000", 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4846999999999996e-05 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492461+0000", 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5538000000000007e-05 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:33.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495582+0000", 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003120439 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127383 5.9 5:926eee29:::benchmark_data_smithi037_101035_object127382:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.492688+0000", 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0095643480000000003, 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.009959908, 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:33.527 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127383 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492688+0000", 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492688+0000", 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492688+0000", 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3499999999999996e-07 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492710+0000", 2023-10-08T06:58:33.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2144999999999999e-05 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492715+0000", 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7620000000000003e-06 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492719+0000", 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.403e-06 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492754+0000", 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4479e-05 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492829+0000", 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5135999999999993e-05 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:33.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.492917+0000", 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8401999999999998e-05 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495491+0000", 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002574022 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127385 5.f 5:f3f8e240:::benchmark_data_smithi037_101035_object127384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.495705+0000", 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.006546619, 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070207999999999998, 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127385 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495705+0000", 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495705+0000", 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495706+0000", 2023-10-08T06:58:33.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4199999999999996e-07 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495772+0000", 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6113999999999998e-05 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495781+0000", 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7909999999999993e-06 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495786+0000", 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.361e-06 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495833+0000", 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7086000000000003e-05 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.495965+0000", 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013197099999999999 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.496123+0000", 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000158276 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.498441+0000", 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0023177219999999999 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.537 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127387 5.9 5:9b6600a5:::benchmark_data_smithi037_101035_object127386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.497092+0000", 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0051600190000000001, 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056835549999999999, 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.538 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127387 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497092+0000", 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497092+0000", 2023-10-08T06:58:33.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497092+0000", 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3300000000000002e-07 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497122+0000", 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9757999999999999e-05 2023-10-08T06:58:33.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497130+0000", 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1249999999999993e-06 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497138+0000", 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.255e-06 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497182+0000", 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4267000000000002e-05 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497317+0000", 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013470999999999999 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.497472+0000", 2023-10-08T06:58:33.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015549199999999999 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500456+0000", 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002983519 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127391 5.d 5:bcb95956:::benchmark_data_smithi037_101035_object127390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.543 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.499865+0000", 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0023869170000000001, 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029571649999999999, 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127391 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499865+0000", 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499865+0000", 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499866+0000", 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0979999999999999e-06 2023-10-08T06:58:33.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499923+0000", 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7357e-05 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499933+0000", 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5389999999999996e-06 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499940+0000", 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4889999999999998e-06 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500080+0000", 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000139221 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500218+0000", 2023-10-08T06:58:33.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013827499999999999 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500365+0000", 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014678799999999999 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127392 5.f 5:fdb4cb10:::benchmark_data_smithi037_101035_object127391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.548 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.499999+0000", 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0022526349999999998, 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028656810000000001, 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127392 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499999+0000", 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.499999+0000", 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500000+0000", 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5000000000000002e-07 2023-10-08T06:58:33.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500067+0000", 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6988000000000003e-05 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500076+0000", 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6160000000000002e-06 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500082+0000", 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1449999999999996e-06 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500129+0000", 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7537000000000002e-05 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500256+0000", 2023-10-08T06:58:33.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126322 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500365+0000", 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109416 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:127393 5.5 5:a015dcaa:::benchmark_data_smithi037_101035_object127392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:33.553 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:33.500098+0000", 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0021542050000000002, 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028104290000000001, 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 127393 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500098+0000", 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500098+0000", 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500098+0000", 2023-10-08T06:58:33.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500139+0000", 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0701999999999998e-05 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500147+0000", 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6350000000000006e-06 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500153+0000", 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500206+0000", 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3905e-05 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:33.500360+0000", 2023-10-08T06:58:33.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153299 2023-10-08T06:58:33.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:33.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:33.558 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:33.558 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 10 2023-10-08T06:58:33.558 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:33.560 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:33.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:33.558+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:33.660 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:33.660+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:33.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:33.760+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:33.792 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:33.793 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:33.801 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:33.862 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:33.862+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:33.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:33.962+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:34.027 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.149259790999999, 2023-10-08T06:58:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.142425402999997, 2023-10-08T06:58:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.827983824, 2023-10-08T06:58:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:34.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:34.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:34.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:34.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:34.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:34.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:34.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:34.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:34.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:34.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:34.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:34.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:34.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:34.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:34.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:34.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:34.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:34.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:34.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:34.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:34.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:34.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:34.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.065 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.066 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.066 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:76683 5.2 5:4119dfc3:::benchmark_data_smithi037_101035_object76682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-10-08T06:58:34.066 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:34.066 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.332280939, 2023-10-08T06:58:34.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020024493000000001, 2023-10-08T06:58:34.067 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.067 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.067 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 76683 2023-10-08T06:58:34.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.068 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:34.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690533+0000", 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690534+0000", 2023-10-08T06:58:34.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0440000000000001e-06 2023-10-08T06:58:34.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690592+0000", 2023-10-08T06:58:34.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8118000000000002e-05 2023-10-08T06:58:34.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690604+0000", 2023-10-08T06:58:34.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1661999999999999e-05 2023-10-08T06:58:34.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690611+0000", 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0010000000000004e-06 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690658+0000", 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7278999999999999e-05 2023-10-08T06:58:34.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690752+0000", 2023-10-08T06:58:34.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3437999999999995e-05 2023-10-08T06:58:34.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.690841+0000", 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8677999999999994e-05 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.693854+0000", 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00301359 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710490+0000", 2023-10-08T06:58:34.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01663597 2023-10-08T06:58:34.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710524+0000", 2023-10-08T06:58:34.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3874999999999997e-05 2023-10-08T06:58:34.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:10.710558+0000", 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3837999999999997e-05 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.077 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.132047521000001, 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.078 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:34.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:34.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.084 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.130331219, 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:34.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:34.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.128513398000001, 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:34.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.126509102, 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.099 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:34.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:34.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.105 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.126392786, 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:34.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:34.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.118502837999999, 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.112 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:34.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:34.118 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.115756642999999, 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.119 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.120 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.120 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.120 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:34.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:34.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.127 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.559146546999999, 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.128 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:34.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:34.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:34.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.558385228000001, 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.135 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:34.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:34.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.554469522, 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.142 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:34.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.147 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.554306642, 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:34.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:34.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.552643658000001, 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.154 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:34.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:34.159 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.552377205999999, 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.160 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:34.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.549621839, 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:34.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:34.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:34.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.547311517000001, 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:34.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:34.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:34.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:34.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:118569 5.f 5:f224d98c:::benchmark_data_smithi037_101035_object118568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.2215368939999998, 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020822587, 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:34.177 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 118569 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801278+0000", 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:34.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801306+0000", 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7838e-05 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801312+0000", 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801316+0000", 2023-10-08T06:58:34.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8870000000000002e-06 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.803970+0000", 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026534200000000001 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804095+0000", 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125652 2023-10-08T06:58:34.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804244+0000", 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148481 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.807953+0000", 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037095969999999998 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822051+0000", 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014097800000000001 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822080+0000", 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8782e-05 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:34.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822100+0000", 2023-10-08T06:58:34.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9986000000000001e-05 2023-10-08T06:58:34.184 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.184 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.184 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.184 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:34.184 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:34.184 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:34.186 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:34.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:34.184+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:34.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2023-10-08T06:58:34.287 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:34.287+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:129449 5.0 5:0e8444b7:::benchmark_data_smithi037_101035_object129448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.352853+0000", 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0049782250000000002, 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050109630000000002, 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.359 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 129449 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.352853+0000", 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.352853+0000", 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.352854+0000", 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.352906+0000", 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2080999999999998e-05 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.352919+0000", 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2281e-05 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.352928+0000", 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9260000000000006e-06 2023-10-08T06:58:34.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.352977+0000", 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9628e-05 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.353131+0000", 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000154019 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:129451 5.8 5:1153885c:::benchmark_data_smithi037_101035_object129450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.355341+0000", 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002490426, 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026024389999999998, 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.364 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 129451 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355341+0000", 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355341+0000", 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355342+0000", 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0920000000000001e-06 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355453+0000", 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110569 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355465+0000", 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2446000000000001e-05 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355472+0000", 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8990000000000004e-06 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355530+0000", 2023-10-08T06:58:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8182e-05 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355684+0000", 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015353400000000001 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:129454 5.8 5:1a15ee29:::benchmark_data_smithi037_101035_object129453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:34.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.355505+0000", 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0023269010000000001, 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025108140000000001, 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 129454 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355505+0000", 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355505+0000", 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355506+0000", 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355595+0000", 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.933e-05 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355606+0000", 2023-10-08T06:58:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0981e-05 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.355614+0000", 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.619e-06 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.357551+0000", 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019362559999999999 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.357671+0000", 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120195 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:129455 5.e 5:719c7208:::benchmark_data_smithi037_101035_object129454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.356157+0000", 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0016742599999999999, 2023-10-08T06:58:34.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001925403, 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 129455 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356157+0000", 2023-10-08T06:58:34.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356157+0000", 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356158+0000", 2023-10-08T06:58:34.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3900000000000004e-07 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356267+0000", 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010863 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356290+0000", 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3410000000000001e-05 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356298+0000", 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8259999999999993e-06 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356363+0000", 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5281000000000001e-05 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356499+0000", 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013528499999999999 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:129457 5.0 5:0aec60ea:::benchmark_data_smithi037_101035_object129456:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.356326+0000", 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001505943, 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018309520000000001, 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.378 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 129457 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356326+0000", 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356326+0000", 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356326+0000", 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.99e-07 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356378+0000", 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1381999999999997e-05 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356386+0000", 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5150000000000006e-06 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356408+0000", 2023-10-08T06:58:34.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1851000000000001e-05 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.357557+0000", 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001148385 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.357676+0000", 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119981 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.382 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:129459 5.a 5:5c57582f:::benchmark_data_smithi037_101035_object129458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.356419+0000", 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001412398, 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018043250000000001, 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.383 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 129459 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356419+0000", 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356419+0000", 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356420+0000", 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2399999999999998e-07 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356456+0000", 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5735000000000003e-05 2023-10-08T06:58:34.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356463+0000", 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4529999999999996e-06 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356469+0000", 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9109999999999998e-06 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356508+0000", 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8695000000000001e-05 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356593+0000", 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5533999999999998e-05 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:129456 5.d e46/32 5:bfe1a3f3:::benchmark_data_smithi037_101035_object129455:head v 46'7945, mlcod=46'7943)", 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.356641+0000", 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0011909500000000001, 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00164806, 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356641+0000", 2023-10-08T06:58:34.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356641+0000", 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356641+0000", 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1699999999999997e-07 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356690+0000", 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8195000000000002e-05 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356698+0000", 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7360000000000007e-06 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356705+0000", 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356750+0000", 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5187e-05 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356770+0000", 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9584000000000001e-05 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:129458 5.f e46/20 5:f790e4f8:::benchmark_data_smithi037_101035_object129457:head v 46'8206, mlcod=46'8204)", 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:34.356728+0000", 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001103712, 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016200380000000001, 2023-10-08T06:58:34.392 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356728+0000", 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356728+0000", 2023-10-08T06:58:34.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356728+0000", 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.72e-07 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356785+0000", 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6319000000000001e-05 2023-10-08T06:58:34.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356792+0000", 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3579999999999997e-06 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356798+0000", 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0870000000000003e-06 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356845+0000", 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7268999999999998e-05 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:34.356877+0000", 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1338999999999999e-05 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.397 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:34.397 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2023-10-08T06:58:34.397 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:34.398 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 54 16 129483 129467 149.833 150.188 0.00476303 0.00667151 2023-10-08T06:58:34.398 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:34.399 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:34.398+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:34.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:58:34.499 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:34.500+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:34.599 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:34.599+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:34.611 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:34.611 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:34.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:34.710 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:34.710+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:34.801 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:34.801+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:34.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:34.841 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:34.843 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.973235871, 2023-10-08T06:58:34.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:34.843 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.843 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.845 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:34.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.845 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:34.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:34.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:34.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:34.851 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.970527652000001, 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.852 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:34.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:34.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:34.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:34.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:34.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:34.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:34.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:34.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:34.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:34.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:34.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:34.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:34.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.861 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.861 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:34.862 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:34.862 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.967535362, 2023-10-08T06:58:34.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:34.862 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.862 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.862 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:34.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:34.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:34.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:34.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:34.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:34.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:34.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:34.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:34.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.869 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.869 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.869 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.869 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:34.869 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.9524945, 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.870 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:34.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:34.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:34.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:34.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:34.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:34.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:34.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:34.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:34.877 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.952391643, 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.878 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:34.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:34.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:34.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:34.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:34.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:34.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:34.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:34.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:34.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:34.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:34.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:34.886 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.886 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.886 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.887 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.887 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:34.887 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.95232835, 2023-10-08T06:58:34.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:34.887 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.887 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.888 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.888 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.888 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.888 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:34.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.888 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:34.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:34.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:34.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:34.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:34.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:34.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:34.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:34.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:34.895 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.952055072, 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:34.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:34.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:34.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:34.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:34.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:34.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:34.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:34.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:34.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:34.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:34.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:34.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:34.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:34.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:34.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.904 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.905 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.905 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.905 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:34.905 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.949065029, 2023-10-08T06:58:34.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:34.906 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.906 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.906 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.906 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.906 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.906 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:34.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.907 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:34.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:34.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:34.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:34.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:34.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:34.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:34.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:34.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:34.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:34.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:34.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:34.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:34.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:34.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:34.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:34.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:34.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:34.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:34.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:34.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.916 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.916 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.916 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.916 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:34.917 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.947714101000001, 2023-10-08T06:58:34.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:34.917 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.917 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.917 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.917 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.918 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.918 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:34.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.918 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:34.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:34.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:34.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:34.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:34.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:34.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:34.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.947575338, 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.925 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:34.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:34.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.930 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.947196873999999, 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:34.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:34.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.94503534, 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:34.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:34.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.936696457, 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:34.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:34.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.173267639000001, 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.947 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:34.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:34.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.172722977999999, 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:34.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:34.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.172634718999999, 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.959 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:34.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:34.964 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.172600293, 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.965 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:34.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:34.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.970 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.171505717000001, 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.971 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:34.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:34.977 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.170981884, 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:34.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:34.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:34.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:34.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.170023662, 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:34.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.990 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:34.991 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:34.991 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:34.993 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:34.992+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:34.993 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:35.093 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:35.093+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:35.148 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:35.168 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:35.171 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:35.172 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:35.184 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:35.184 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:35.194 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:35.194+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:35.200 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:35.295 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:35.295+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:35.366 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 55 16 131856 131840 149.806 148.312 0.00631448 0.00667281 2023-10-08T06:58:35.385 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:35.385 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:35.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:35.394+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:35.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:58:35.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:35.495+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:35.596 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:35.597+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:35.619 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:35.619 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:35.637 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:35.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:35.696+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:35.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:35.797+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:35.810 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:35.810 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:35.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:35.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:35.898+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:35.999+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.000 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:36.001 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:36.015 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:36.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.100+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.197 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:36.197 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:36.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.201+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.210 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:36.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.302+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.366 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 56 16 134183 134167 149.727 145.438 0.00516059 0.00667649 2023-10-08T06:58:36.394 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:36.394 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:36.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.403+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.410 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:36.505 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:36.505+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:36.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.604+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.637 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:36.637 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:36.653 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:36.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.736+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.806+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:36.888 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:36.888 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:36.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:36.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:36.941+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:37.010 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:37.010+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:37.083 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:37.083 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:37.098 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:37.139 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:37.139+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:37.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:37.212 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:37.212+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:37.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:37.311+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:37.313 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:37.313 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:37.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:37.328 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:37.350 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:37.353 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:37.353 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:37.366 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 57 16 136587 136571 149.736 150.25 0.00512723 0.00667575 2023-10-08T06:58:37.413 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:37.414+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:37.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:58:37.514 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:37.514+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:37.543 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.675524565000003, 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:37.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:37.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.551 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:37.551 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:37.551 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.672816345999998, 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:37.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.669824056000003, 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.558 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:37.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.654783194, 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.564 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:37.569 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.654680336999999, 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:37.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:37.576 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.654617043999998, 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:37.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:37.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:37.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.654343766, 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:37.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:37.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.651353723, 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.590 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:37.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.650002794999999, 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:37.596 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:37.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:37.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:37.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:37.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:37.603 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.649864032, 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.604 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:37.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.649485567999999, 2023-10-08T06:58:37.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.647324034, 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:37.616 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.621 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.638985151, 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:37.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:37.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:37.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:37.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:37.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:37.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.875556333, 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.875011671999999, 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:37.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:37.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.874923412999999, 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.644 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:37.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.874888987, 2023-10-08T06:58:37.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:37.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:37.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:37.655 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.873794411, 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:37.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:37.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:37.661 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.873270578, 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:37.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:37.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.667 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.872312356, 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:37.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.673 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:37.673 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:37.673 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:37.674 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:37.674+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:37.675 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:37.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:37.774+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:37.862 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:37.862 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137794 5.d 5:b3735ed2:::benchmark_data_smithi037_101035_object137793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.856321+0000", 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0049697739999999997, 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049921289999999997, 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137794 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856321+0000", 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856321+0000", 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856322+0000", 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0400000000000005e-07 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856409+0000", 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7174000000000003e-05 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856420+0000", 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1311000000000001e-05 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856428+0000", 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8420000000000005e-06 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856476+0000", 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7957000000000002e-05 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856596+0000", 2023-10-08T06:58:37.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001193 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856723+0000", 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012748800000000001 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137801 5.f 5.2385187f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.859178+0000", 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002113289, 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021979460000000001, 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137801 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.869 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859178+0000", 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859178+0000", 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859179+0000", 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1850000000000001e-06 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859282+0000", 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103651 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859293+0000", 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0801e-05 2023-10-08T06:58:37.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859300+0000", 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.294e-06 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137802 5.d 5:b18c7888:::benchmark_data_smithi037_101035_object137801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.859342+0000", 2023-10-08T06:58:37.872 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001948972, 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020751749999999998, 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137802 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859342+0000", 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859342+0000", 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859343+0000", 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5799999999999999e-07 2023-10-08T06:58:37.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859394+0000", 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0986000000000003e-05 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859404+0000", 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.095e-05 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859411+0000", 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1800000000000001e-06 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859455+0000", 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4851999999999997e-05 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859590+0000", 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013426599999999999 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859755+0000", 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016475600000000001 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.877 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137803 5.3 5:cc9306f6:::benchmark_data_smithi037_101035_object137802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.859426+0000", 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001864554, 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020362459999999998, 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137803 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.878 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859426+0000", 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859426+0000", 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859427+0000", 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859457+0000", 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0539e-05 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859464+0000", 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0770000000000002e-06 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859470+0000", 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2909999999999998e-06 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859520+0000", 2023-10-08T06:58:37.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0141e-05 2023-10-08T06:58:37.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859647+0000", 2023-10-08T06:58:37.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000127661 2023-10-08T06:58:37.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137804 5.7 5.8f74e637 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.859481+0000", 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0018101580000000001, 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020403560000000001, 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.883 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137804 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859481+0000", 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859481+0000", 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859481+0000", 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859509+0000", 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7538999999999998e-05 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859516+0000", 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6899999999999992e-06 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859522+0000", 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2970000000000003e-06 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:137794 5.d e47/32)", 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.859650+0000", 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0016412340000000001, 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019375519999999999, 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859650+0000", 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859650+0000", 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859650+0000", 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859657+0000", 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6830000000000002e-06 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859671+0000", 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4511e-05 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859679+0000", 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0960000000000001e-06 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:137786 5.f e47/20)", 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.859967+0000", 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0013235359999999999, 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001669483, 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859967+0000", 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859967+0000", 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859968+0000", 2023-10-08T06:58:37.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2399999999999998e-07 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859971+0000", 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.066e-06 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859978+0000", 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.498e-06 2023-10-08T06:58:37.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859983+0000", 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:137790 5.f e47/20)", 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.860353+0000", 2023-10-08T06:58:37.895 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00093813100000000003, 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001334146, 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.860353+0000", 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.860353+0000", 2023-10-08T06:58:37.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.860353+0000", 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7700000000000001e-07 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.860355+0000", 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.278e-06 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.860362+0000", 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0790000000000003e-06 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.860366+0000", 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6559999999999998e-06 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137805 5.9 5:9d10e1cf:::benchmark_data_smithi037_101035_object137804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.861146+0000", 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.000144914, 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00060223899999999996, 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.900 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137805 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861146+0000", 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861146+0000", 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861146+0000", 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.68e-07 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861200+0000", 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3624e-05 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861209+0000", 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.388e-06 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861213+0000", 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4460000000000003e-06 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861254+0000", 2023-10-08T06:58:37.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1424999999999997e-05 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861344+0000", 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9188000000000001e-05 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861434+0000", 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0567000000000002e-05 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137786 5.f 5:fbac2236:::benchmark_data_smithi037_101035_object137785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.854080+0000", 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.007210775, 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077568020000000001, 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.905 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137786 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854080+0000", 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854080+0000", 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854081+0000", 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3399999999999999e-07 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854127+0000", 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6588999999999997e-05 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854135+0000", 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0320000000000003e-06 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854141+0000", 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0340000000000002e-06 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854196+0000", 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4558000000000002e-05 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854322+0000", 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012661399999999999 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.854471+0000", 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014847699999999999 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137790 5.f 5:fd72354b:::benchmark_data_smithi037_101035_object137789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.855112+0000", 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0061787939999999996, 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006817633, 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137790 2023-10-08T06:58:37.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855112+0000", 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855112+0000", 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855113+0000", 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9100000000000003e-07 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855185+0000", 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2426000000000001e-05 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855196+0000", 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0988999999999999e-05 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855203+0000", 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.443e-06 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856235+0000", 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001032097 2023-10-08T06:58:37.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856354+0000", 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119151 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856527+0000", 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017325500000000001 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.914 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137791 5.1 5:85bf525d:::benchmark_data_smithi037_101035_object137790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.855435+0000", 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0058554230000000002, 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065898110000000001, 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.915 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137791 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855435+0000", 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855435+0000", 2023-10-08T06:58:37.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855436+0000", 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-07 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855494+0000", 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8108e-05 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855506+0000", 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2177e-05 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855513+0000", 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3899999999999998e-06 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856238+0000", 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00072574200000000003 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.856403+0000", 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016447900000000001 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.861996+0000", 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055931230000000002 2023-10-08T06:58:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:137793 5.f 5:fed684e2:::benchmark_data_smithi037_101035_object137792:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:37.855571+0000", 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0057195229999999998, 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006550218, 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 137793 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855571+0000", 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855571+0000", 2023-10-08T06:58:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855572+0000", 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7899999999999998e-07 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855714+0000", 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142218 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855735+0000", 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0327e-05 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.855742+0000", 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1130000000000003e-06 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859858+0000", 2023-10-08T06:58:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041168130000000004 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.859989+0000", 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000130161 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:37.860147+0000", 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015792700000000001 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 13 2023-10-08T06:58:37.925 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:37.926 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:37.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:37.925+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:38.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:38.028+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:38.107 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:38.108 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:38.123 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:38.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:38.163+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:38.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:38.226+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:38.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:38.328+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:38.350 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:38.350 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:38.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:38.351 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:38.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.351 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:38.351 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 49.473523938, 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:38.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 49.466689549999998, 2023-10-08T06:58:38.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:38.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:38.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:38.367 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.152247971000001, 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:38.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:38.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:38.374 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.456311668000001, 2023-10-08T06:58:38.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:38.375 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.375 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.375 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.375 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.376 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.376 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:38.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.376 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:38.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:38.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:38.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:38.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:38.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:38.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:38.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.454595366, 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:38.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:38.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:38.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:38.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:38.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:38.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:38.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:38.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:38.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:38.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:38.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:38.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:38.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:38.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:38.396 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.396 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.396 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.396 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:38.397 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:38.397 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.452777545, 2023-10-08T06:58:38.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:38.397 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.397 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:38.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:38.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:38.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:38.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:38.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:38.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:38.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:38.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:38.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:38.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:38.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:38.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:38.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:38.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:38.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:38.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:38.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:38.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:38.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:38.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:38.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:38.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:38.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:38.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.410 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.410 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.410 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:38.411 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:38.411 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.450773249000001, 2023-10-08T06:58:38.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:38.411 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.411 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.412 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.412 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.412 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.412 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:38.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.412 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:38.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:38.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:38.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:38.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:38.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:38.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:38.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:38.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:38.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:38.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:38.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:38.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:38.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:38.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:38.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:38.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:38.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:38.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:38.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:38.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:38.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:38.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:38.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:38.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.426 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.426 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.426 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:38.426 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:38.426 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.450656933000001, 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:38.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.428 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:38.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:38.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:38.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:38.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:38.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:38.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:38.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:38.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:38.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:38.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:38.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:38.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:38.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:38.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:38.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:38.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:38.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.442766984999999, 2023-10-08T06:58:38.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:38.439 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.439 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.439 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.439 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.439 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.439 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:38.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:38.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.440020789999998, 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.446 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:38.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:38.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:38.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.883410693999998, 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:38.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:38.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:38.460 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.882649375, 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:38.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:38.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:38.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:38.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:38.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.878733668999999, 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.470 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.470 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:38.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.470 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:38.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:38.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:38.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:38.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:38.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:38.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:38.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.477 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.478 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:38.478 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:38.478 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.878570789000001, 2023-10-08T06:58:38.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:38.479 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.479 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.479 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.479 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.479 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.479 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:38.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.480 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:38.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:38.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:38.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:38.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:38.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:38.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:38.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:38.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:38.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:38.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:38.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.488 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.876907804999998, 2023-10-08T06:58:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.490 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:38.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:38.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:38.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:38.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:38.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:38.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:38.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:38.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:38.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:38.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:38.497 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.876641353, 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.498 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:38.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:38.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:38.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:38.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:38.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:38.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:38.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:38.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:38.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:38.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:38.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:38.508 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.873885986000001, 2023-10-08T06:58:38.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:38.508 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.508 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.508 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.508 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.508 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.509 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:38.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.509 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:38.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:38.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:38.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:38.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:38.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:38.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:38.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:38.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:38.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:38.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:38.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:38.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:38.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.871575664000002, 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:38.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:118569 5.f 5:f224d98c:::benchmark_data_smithi037_101035_object118568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5458010410000007, 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020822587, 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.523 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 118569 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801278+0000", 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801306+0000", 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7838e-05 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801312+0000", 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801316+0000", 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8870000000000002e-06 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.803970+0000", 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026534200000000001 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804095+0000", 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125652 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804244+0000", 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148481 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.807953+0000", 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037095969999999998 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822051+0000", 2023-10-08T06:58:38.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014097800000000001 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822080+0000", 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8782e-05 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822100+0000", 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9986000000000001e-05 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:130528 5.9 5:9bdab2cc:::benchmark_data_smithi037_101035_object130527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:38.530 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.5555542679999999, 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022304398999999999, 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 130528 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791525+0000", 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791565+0000", 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0428e-05 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:38.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791572+0000", 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2250000000000003e-06 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791578+0000", 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796454+0000", 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048757790000000002 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796561+0000", 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107063 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796675+0000", 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114188 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.801567+0000", 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048923070000000003 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:38.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813729+0000", 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012161896 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813787+0000", 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7896999999999998e-05 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:38.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813829+0000", 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1544000000000001e-05 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:38.538 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:38.539 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 58 15 139023 139008 149.781 152.312 0.0079757 0.00667382 2023-10-08T06:58:38.541 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:38.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:38.538+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:58:38.640 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:38.640+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:38.727 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:38.727 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:38.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.727 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139893 5.8 5:10129664:::benchmark_data_smithi037_101035_object139892:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.727 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.716997+0000", 2023-10-08T06:58:38.727 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0091190019999999993, 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091565550000000002, 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139893 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.716997+0000", 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.716997+0000", 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.716998+0000", 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1500000000000004e-07 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.717056+0000", 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7544000000000003e-05 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.717066+0000", 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0234000000000001e-05 2023-10-08T06:58:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.717073+0000", 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9840000000000004e-06 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.717134+0000", 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0900000000000003e-05 2023-10-08T06:58:38.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.717262+0000", 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128147 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139896 5.8 5:152ee5ae:::benchmark_data_smithi037_101035_object139895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.732 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.719491+0000", 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0066258610000000003, 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006755952, 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139896 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719491+0000", 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719491+0000", 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719492+0000", 2023-10-08T06:58:38.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1930000000000001e-06 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719572+0000", 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0409999999999998e-05 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719587+0000", 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.47e-05 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719596+0000", 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6680000000000007e-06 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719688+0000", 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2027999999999994e-05 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719859+0000", 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017132700000000001 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139898 5.8 5:10381487:::benchmark_data_smithi037_101035_object139897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.719615+0000", 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.006501878, 2023-10-08T06:58:38.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066976170000000003, 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139898 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719615+0000", 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719615+0000", 2023-10-08T06:58:38.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719615+0000", 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9599999999999999e-07 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719651+0000", 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5525999999999998e-05 2023-10-08T06:58:38.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719660+0000", 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8720000000000008e-06 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719666+0000", 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4189999999999999e-06 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722221+0000", 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025554200000000001 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722464+0000", 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024254499999999999 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.743 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139900 5.b 5:de048272:::benchmark_data_smithi037_101035_object139899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.743 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.719749+0000", 2023-10-08T06:58:38.743 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0063677439999999998, 2023-10-08T06:58:38.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066126090000000002, 2023-10-08T06:58:38.743 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.744 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139900 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719749+0000", 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719749+0000", 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719749+0000", 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:38.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719818+0000", 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8570000000000002e-05 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719828+0000", 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0125999999999999e-05 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.719835+0000", 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.720351+0000", 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00051542099999999996 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.720488+0000", 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000137696 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139909 5.0 5:055b688b:::benchmark_data_smithi037_101035_object139908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.721964+0000", 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0041528800000000003, 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044393870000000004, 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139909 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.721964+0000", 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.721964+0000", 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.721964+0000", 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7100000000000001e-07 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722083+0000", 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118367 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722094+0000", 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1209999999999999e-05 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722102+0000", 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7130000000000005e-06 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722249+0000", 2023-10-08T06:58:38.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147288 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722424+0000", 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017510599999999999 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.754 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:139906 5.9 e48/20 5:9142b422:::benchmark_data_smithi037_101035_object139905:head v 48'8725, mlcod=48'8723)", 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.722045+0000", 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0040711300000000001, 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044171610000000002, 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722045+0000", 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722045+0000", 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722046+0000", 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8899999999999998e-07 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722096+0000", 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9907999999999997e-05 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722105+0000", 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7590000000000003e-06 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722112+0000", 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8850000000000001e-06 2023-10-08T06:58:38.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722169+0000", 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7710000000000001e-05 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722184+0000", 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.43e-05 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139910 5.e 5:7d080df5:::benchmark_data_smithi037_101035_object139909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.722282+0000", 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0038340729999999999, 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004216366, 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.759 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139910 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722282+0000", 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722282+0000", 2023-10-08T06:58:38.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722283+0000", 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500000000000002e-07 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722383+0000", 2023-10-08T06:58:38.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100315 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722395+0000", 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1440000000000001e-05 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722402+0000", 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3549999999999999e-06 2023-10-08T06:58:38.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722457+0000", 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4531999999999999e-05 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.722586+0000", 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012932300000000001 2023-10-08T06:58:38.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139913 5.8 5:1ed1924f:::benchmark_data_smithi037_101035_object139912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.724219+0000", 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001897541, 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023213729999999998, 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139913 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.724219+0000", 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.724219+0000", 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.724220+0000", 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9600000000000008e-07 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.724268+0000", 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7889999999999997e-05 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.724281+0000", 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2843999999999999e-05 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.724288+0000", 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5660000000000001e-06 2023-10-08T06:58:38.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.724985+0000", 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00069714099999999997 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725187+0000", 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000201802 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.768 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:139915 5.d e48/32 5:bbe31a08:::benchmark_data_smithi037_101035_object139914:head v 48'8526, mlcod=48'8524)", 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.725033+0000", 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001083142, 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001543401, 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.769 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725033+0000", 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725033+0000", 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725034+0000", 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2500000000000005e-07 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725098+0000", 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4267e-05 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725108+0000", 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3840000000000003e-06 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725114+0000", 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9260000000000003e-06 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725172+0000", 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7111999999999998e-05 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725194+0000", 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.264e-05 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:139914 5.9 e48/20 5:935ba1fe:::benchmark_data_smithi037_101035_object139913:head v 48'8726, mlcod=48'8723)", 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.725139+0000", 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0009778530000000001, 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001470844, 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725139+0000", 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725139+0000", 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725139+0000", 2023-10-08T06:58:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8099999999999998e-07 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725173+0000", 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3797999999999997e-05 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725180+0000", 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2450000000000001e-06 2023-10-08T06:58:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725185+0000", 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4700000000000001e-06 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725230+0000", 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4817999999999997e-05 2023-10-08T06:58:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725249+0000", 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9191999999999999e-05 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:139916 5.e 5:79a0ef4b:::benchmark_data_smithi037_101035_object139915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:38.725266+0000", 2023-10-08T06:58:38.778 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00085008499999999999, 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001377426, 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 139916 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:38.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725266+0000", 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725266+0000", 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725267+0000", 2023-10-08T06:58:38.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9300000000000006e-07 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725323+0000", 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5661000000000001e-05 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725335+0000", 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2129e-05 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725344+0000", 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4849999999999992e-06 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725402+0000", 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8272e-05 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:38.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:38.725534+0000", 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013250800000000001 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 11 2023-10-08T06:58:38.783 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:38.784 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:38.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:38.783+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:38.891 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:38.891+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:38.988 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:38.988+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.001 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:39.002 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:39.002 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:39.002 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:39.002 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:39.015 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:39.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:39.086+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:39.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:39.187+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.365749844, 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.363041625000001, 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.360049334999999, 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.345008473, 2023-10-08T06:58:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.344905615999998, 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:39.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.344842323000002, 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.276 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:39.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:39.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:39.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:39.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:39.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:39.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.344569045, 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:39.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:39.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:39.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.341579002, 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:39.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:39.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.340228073999999, 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:39.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:39.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.340089311, 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:39.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:39.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:39.308 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.339710846999999, 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:39.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:39.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.337549313, 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:39.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:39.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:39.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.32921043, 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:39.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.565781611999999, 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.326 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.565236950999999, 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.333 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:39.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:39.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:39.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:39.339 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.565148692000001, 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:39.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.565114265999998, 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:39.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:39.351 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.564019689999999, 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:39.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:39.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:39.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.357 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.563495856999999, 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:39.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:39.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:39.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:39.364 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.562537634999998, 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:39.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:39.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:39.370 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:39.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:39.372 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 59 16 141458 141442 149.82 152.125 0.00631718 0.006672 2023-10-08T06:58:39.373 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:39.371+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.373 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:39.472 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:39.471+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.528 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:39.549 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:39.550 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:39.550 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:39.550 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:39.552 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:39.553 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:39.567 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:39.568 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:39.573 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:39.572+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.583 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:39.674 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:39.673+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.770 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:39.770 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:39.774 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:39.773+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.786 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:39.875 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:39.874+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.977 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:39.975+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:39.986 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:39.986 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:40.002 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:40.078 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:40.076+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:40.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2023-10-08T06:58:40.178 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:40.177+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:40.183 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:40.183 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:40.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:40.283 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:40.282+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:40.366 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total time run: 60.0043 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total writes made: 143858 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Write size: 65536 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object size: 65536 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Bandwidth (MB/sec): 149.841 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Bandwidth: 39.136 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max bandwidth (MB/sec): 277.312 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min bandwidth (MB/sec): 0.5 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average IOPS: 2397 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev IOPS: 626.176 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max IOPS: 4437 2023-10-08T06:58:40.367 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min IOPS: 8 2023-10-08T06:58:40.368 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average Latency(s): 0.00667153 2023-10-08T06:58:40.368 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Latency(s): 0.0152892 2023-10-08T06:58:40.368 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max latency(s): 1.03311 2023-10-08T06:58:40.368 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min latency(s): 0.0012103 2023-10-08T06:58:40.371 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Cleaning up (deleting benchmark objects) 2023-10-08T06:58:40.379 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:40.378+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:40.413 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:40.413 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:40.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:40.515 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:40.514+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:40.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:58:40.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:40.580+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:40.641 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:40.641 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:40.657 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:40.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:40.700+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:40.783 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:40.782+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:40.846 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:40.846 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:40.863 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:40.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:40.903+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:40.985 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:40.984+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:41.085 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:41.086 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:41.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:41.085+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:41.102 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:41.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:41.187+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:41.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:41.287+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:41.330 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:41.330 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:41.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:41.390 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:41.389+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:58:41.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:41.489+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:41.518 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:41.519 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:41.532 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:41.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:41.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:41.589+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:41.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:41.691+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:41.703 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:41.725 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:41.726 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:41.726 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:41.726 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:41.728 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:41.729 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:41.753 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:41.753 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:41.753 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:41.753 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:41.754 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:41.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:41.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:41.792+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:41.894 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:41.893+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.077767381999998, 2023-10-08T06:58:41.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:41.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:41.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.952 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.075059162999999, 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.953 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:41.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:41.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:41.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:41.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.961 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.072066872999997, 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:41.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:41.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:41.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.057026011000001, 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:41.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:41.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.056923154, 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.974 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:41.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.056859861, 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:41.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:41.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:41.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:41.985 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.056586583000001, 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.986 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:41.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:41.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:41.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.053596540000001, 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:41.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:41.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.052245612, 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:41.998 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:41.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:42.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.052106849000001, 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.004 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.051728385000001, 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.049566851000002, 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.041227968000001, 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.27779915, 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.277254489000001, 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.277166229999999, 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.277131804, 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.276037228, 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.275513395000001, 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.056 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:42.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:42.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.274555173, 2023-10-08T06:58:42.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:42.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:42.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:42.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:42.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:42.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.066 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:42.066 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:42.066 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:42.067 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:42.066+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:42.068 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:42.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:42.167+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149234 5.d 5:b0ad0ac6:::benchmark_data_smithi037_101035_object5373:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.251657+0000", 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0047676840000000003, 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047939849999999997, 2023-10-08T06:58:42.258 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149234 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251657+0000", 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251657+0000", 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251658+0000", 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251662+0000", 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7190000000000001e-06 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251673+0000", 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0755e-05 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251681+0000", 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9820000000000008e-06 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251728+0000", 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6718999999999998e-05 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251849+0000", 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121085 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251962+0000", 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113621 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149235 5.2 5:49cc39f3:::benchmark_data_smithi037_101035_object5374:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.251699+0000", 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0047252819999999999, 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048388249999999997, 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.264 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149235 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251699+0000", 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251699+0000", 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251700+0000", 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2023-10-08T06:58:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251703+0000", 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7870000000000002e-06 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251708+0000", 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6019999999999999e-06 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251714+0000", 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0279999999999997e-06 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251752+0000", 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8271e-05 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251870+0000", 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011733199999999999 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149238 5.5 5:adc110d3:::benchmark_data_smithi037_101035_object5377:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.269 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.251836+0000", 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0045888789999999997, 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047850289999999997, 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149238 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.270 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251836+0000", 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251836+0000", 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251836+0000", 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5000000000000002e-07 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251840+0000", 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.512e-06 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251850+0000", 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0577999999999999e-05 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251857+0000", 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7900000000000002e-06 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.251907+0000", 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9880999999999999e-05 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252036+0000", 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012943500000000001 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.274 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149239 5.9 5:98db67a4:::benchmark_data_smithi037_101035_object5378:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.252972+0000", 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0034523209999999999, 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037242569999999999, 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:42.275 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149239 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252972+0000", 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252972+0000", 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252973+0000", 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.78e-07 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252977+0000", 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9700000000000001e-06 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252989+0000", 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1613999999999999e-05 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252997+0000", 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1869999999999997e-06 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.254774+0000", 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001777544 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.254920+0000", 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000145184 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255057+0000", 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137198 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.280 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149240 5.c 5:30c01212:::benchmark_data_smithi037_101035_object5379:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.253991+0000", 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0024331639999999998, 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027675590000000002, 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:42.281 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149240 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.253991+0000", 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.253991+0000", 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.253992+0000", 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.253995+0000", 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1820000000000002e-06 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.254004+0000", 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4080000000000004e-06 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.254012+0000", 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3799999999999996e-06 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.254059+0000", 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6990000000000002e-05 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.254147+0000", 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8319999999999995e-05 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149243 5.d 5:b8590620:::benchmark_data_smithi037_101035_object5382:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.255061+0000", 2023-10-08T06:58:42.286 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00136385, 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017470649999999999, 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149243 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255061+0000", 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255061+0000", 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255061+0000", 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5600000000000005e-07 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255065+0000", 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5250000000000001e-06 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255074+0000", 2023-10-08T06:58:42.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.499e-06 2023-10-08T06:58:42.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255082+0000", 2023-10-08T06:58:42.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.746e-06 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255131+0000", 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8684999999999999e-05 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255209+0000", 2023-10-08T06:58:42.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7919999999999999e-05 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.255278+0000", 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8899999999999994e-05 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149244 5.d 5.62d600fd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.256789+0000", 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9996357, 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010919199999999999, 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "reached pg", 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149244 2023-10-08T06:58:42.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256789+0000", 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256789+0000", 2023-10-08T06:58:42.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256790+0000", 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6700000000000003e-07 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256808+0000", 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8499999999999999e-05 2023-10-08T06:58:42.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256824+0000", 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5832999999999999e-05 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256832+0000", 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.585e-06 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256881+0000", 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8421000000000003e-05 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149245 5.2 5:4de7d9f3:::benchmark_data_smithi037_101035_object5384:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.256849+0000", 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9995756, 2023-10-08T06:58:42.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012551899999999999, 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "reached pg", 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149245 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256849+0000", 2023-10-08T06:58:42.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256849+0000", 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256850+0000", 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7599999999999997e-07 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256852+0000", 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8959999999999999e-06 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256861+0000", 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4179999999999997e-06 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256867+0000", 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2990000000000002e-06 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256900+0000", 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3047999999999999e-05 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.301 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149246 5.5 5:ac872d71:::benchmark_data_smithi037_101035_object5385:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.256889+0000", 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.999536, 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000163208, 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "reached pg", 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149246 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.302 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256889+0000", 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256889+0000", 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256889+0000", 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3600000000000003e-07 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256892+0000", 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8310000000000001e-06 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256900+0000", 2023-10-08T06:58:42.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5399999999999998e-06 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256906+0000", 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3500000000000002e-06 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256952+0000", 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6173e-05 2023-10-08T06:58:42.305 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149247 5.1 5:8ca7d018:::benchmark_data_smithi037_101035_object5386:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.256917+0000", 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9995079, 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00022008100000000001, 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:42.306 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149247 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256917+0000", 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256917+0000", 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256917+0000", 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0100000000000005e-07 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256920+0000", 2023-10-08T06:58:42.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3479999999999998e-06 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256926+0000", 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6479999999999997e-06 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256931+0000", 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1309999999999997e-06 2023-10-08T06:58:42.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.256972+0000", 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0602999999999997e-05 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.257094+0000", 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121562 2023-10-08T06:58:42.310 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149230 5.1 5:88f38620:::benchmark_data_smithi037_101035_object5369:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.249289+0000", 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0071351540000000003, 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079253689999999998, 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:42.311 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149230 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249289+0000", 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249289+0000", 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249290+0000", 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1300000000000001e-07 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249292+0000", 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3800000000000001e-06 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249299+0000", 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9020000000000002e-06 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249304+0000", 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3959999999999997e-06 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.250773+0000", 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001468348 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.250909+0000", 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000136425 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:149232 5.9 5:92e7f1bd:::benchmark_data_smithi037_101035_object5371:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:42.249312+0000", 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0071129289999999996, 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079779320000000001, 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.316 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 149232 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249312+0000", 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249312+0000", 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249312+0000", 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3300000000000003e-07 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249314+0000", 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9549999999999999e-06 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249320+0000", 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8359999999999997e-06 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.249326+0000", 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2929999999999997e-06 2023-10-08T06:58:42.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252781+0000", 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034551019999999998 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.252921+0000", 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014021899999999999 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:42.253059+0000", 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013763600000000001 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 12 2023-10-08T06:58:42.321 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:42.323 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:42.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:42.321+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:42.424 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:42.423+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:42.525 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:42.524+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:42.549 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:42.549 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:42.549 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:42.549 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:42.549 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:42.564 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:42.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:42.626+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:42.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:42.726+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:42.748 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.871770435000002, 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.864936047, 2023-10-08T06:58:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.550494467999997, 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.854558165, 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.852841862999998, 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:42.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:42.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.851024041999999, 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.791 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:42.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:42.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.849019746, 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:42.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:42.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:42.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.804 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.84890343, 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.805 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:42.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:42.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.841013482000001, 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.812 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:42.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:42.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:42.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.838267287000001, 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.819 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:42.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.281657191000001, 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.826 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:42.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:42.832 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.280895871999999, 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:42.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:42.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.276980166000001, 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.839 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:42.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:42.844 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.276817286, 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.845 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:42.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:42.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.275154302000001, 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.851 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:42.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.856 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.274887849999999, 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.857 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:42.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:42.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.272132483, 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.863 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:42.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.868 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.269822161, 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:42.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.874 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:118569 5.f 5:f224d98c:::benchmark_data_smithi037_101035_object118568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.944047538, 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020822587, 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.875 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 118569 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801278+0000", 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801306+0000", 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7838e-05 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801312+0000", 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801316+0000", 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8870000000000002e-06 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.803970+0000", 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026534200000000001 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804095+0000", 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125652 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804244+0000", 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148481 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.807953+0000", 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037095969999999998 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822051+0000", 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014097800000000001 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822080+0000", 2023-10-08T06:58:42.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8782e-05 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822100+0000", 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9986000000000001e-05 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:130528 5.9 5:9bdab2cc:::benchmark_data_smithi037_101035_object130527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:42.882 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 7.9538007650000004, 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022304398999999999, 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 130528 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:42.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791525+0000", 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791565+0000", 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0428e-05 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791572+0000", 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2250000000000003e-06 2023-10-08T06:58:42.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791578+0000", 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796454+0000", 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048757790000000002 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796561+0000", 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107063 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796675+0000", 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114188 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.801567+0000", 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048923070000000003 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813729+0000", 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012161896 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813787+0000", 2023-10-08T06:58:42.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7896999999999998e-05 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813829+0000", 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1544000000000001e-05 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:42.889 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:42.891 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:42.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:42.889+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:42.991 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:42.991+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:43.064 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:43.064 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:43.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.064 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:151561 5.e 5:7b65af1a:::benchmark_data_smithi037_101035_object7700:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:43.062905+0000", 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001100988, 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001118626, 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 151561 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062905+0000", 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062905+0000", 2023-10-08T06:58:43.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062906+0000", 2023-10-08T06:58:43.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9900000000000001e-07 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062908+0000", 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3319999999999999e-06 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062913+0000", 2023-10-08T06:58:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.13e-06 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062916+0000", 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3689999999999998e-06 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062958+0000", 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1964e-05 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.063084+0000", 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.070 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:151564 5.8 5.2d7a2058 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:43.063852+0000", 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00015433600000000001, 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021621100000000001, 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 151564 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.071 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.063852+0000", 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.063852+0000", 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.063852+0000", 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0800000000000005e-07 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.063855+0000", 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5220000000000002e-06 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.063862+0000", 2023-10-08T06:58:43.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2060000000000001e-06 2023-10-08T06:58:43.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.063866+0000", 2023-10-08T06:58:43.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3889999999999998e-06 2023-10-08T06:58:43.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.074 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:151557 5.e 5:7476ce65:::benchmark_data_smithi037_101035_object7696:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:43.060827+0000", 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0031791480000000001, 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032748349999999998, 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:43.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 151557 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060827+0000", 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060827+0000", 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060828+0000", 2023-10-08T06:58:43.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2500000000000005e-07 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060831+0000", 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3670000000000001e-06 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060839+0000", 2023-10-08T06:58:43.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3040000000000005e-06 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060845+0000", 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.276e-06 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060879+0000", 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4026000000000003e-05 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060956+0000", 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7719999999999994e-05 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:151558 5.0 5:0587c608:::benchmark_data_smithi037_101035_object7697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.081 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:43.060898+0000", 2023-10-08T06:58:43.081 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.003108342, 2023-10-08T06:58:43.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003265586, 2023-10-08T06:58:43.081 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.081 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:43.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 151558 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060898+0000", 2023-10-08T06:58:43.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060898+0000", 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060898+0000", 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:43.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060900+0000", 2023-10-08T06:58:43.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0269999999999998e-06 2023-10-08T06:58:43.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060906+0000", 2023-10-08T06:58:43.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3299999999999998e-06 2023-10-08T06:58:43.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060909+0000", 2023-10-08T06:58:43.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8380000000000004e-06 2023-10-08T06:58:43.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.060962+0000", 2023-10-08T06:58:43.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2555000000000001e-05 2023-10-08T06:58:43.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.061109+0000", 2023-10-08T06:58:43.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014662400000000001 2023-10-08T06:58:43.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.089 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:151559 5.8 5:12bf4f4a:::benchmark_data_smithi037_101035_object7698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.089 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:43.062551+0000", 2023-10-08T06:58:43.089 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0014548, 2023-10-08T06:58:43.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016651039999999999, 2023-10-08T06:58:43.090 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.090 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:43.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.091 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 151559 2023-10-08T06:58:43.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.091 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062551+0000", 2023-10-08T06:58:43.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062551+0000", 2023-10-08T06:58:43.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062552+0000", 2023-10-08T06:58:43.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.44e-07 2023-10-08T06:58:43.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062556+0000", 2023-10-08T06:58:43.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7009999999999998e-06 2023-10-08T06:58:43.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062566+0000", 2023-10-08T06:58:43.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0261999999999999e-05 2023-10-08T06:58:43.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062573+0000", 2023-10-08T06:58:43.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1879999999999996e-06 2023-10-08T06:58:43.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062622+0000", 2023-10-08T06:58:43.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8463e-05 2023-10-08T06:58:43.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062756+0000", 2023-10-08T06:58:43.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013419800000000001 2023-10-08T06:58:43.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.100 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.101 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:151560 5.a 5:513f0986:::benchmark_data_smithi037_101035_object7699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.101 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:43.062609+0000", 2023-10-08T06:58:43.101 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001396967, 2023-10-08T06:58:43.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001655849, 2023-10-08T06:58:43.101 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.102 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:43.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.102 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 151560 2023-10-08T06:58:43.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.103 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062609+0000", 2023-10-08T06:58:43.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062609+0000", 2023-10-08T06:58:43.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062610+0000", 2023-10-08T06:58:43.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2399999999999999e-07 2023-10-08T06:58:43.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062612+0000", 2023-10-08T06:58:43.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1749999999999999e-06 2023-10-08T06:58:43.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062622+0000", 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.057e-05 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062626+0000", 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0629999999999999e-06 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062676+0000", 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9805999999999997e-05 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:43.062829+0000", 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015290900000000001 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.110 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.110 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:43.110 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 6 2023-10-08T06:58:43.110 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:43.111 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:43.112 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:43.110+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:43.212 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:43.211+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:43.313 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:43.313+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:43.325 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:43.326 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:43.340 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:43.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:43.413+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:43.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:58:43.515 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:43.514+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.687213796999998, 2023-10-08T06:58:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.684505578, 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.681513287999998, 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.666472425999999, 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.666369569, 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:43.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.590 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.666306276, 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.591 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.666032997999999, 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.597 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:43.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.663042955000002, 2023-10-08T06:58:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.661692027000001, 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.661553263999998, 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.661174800000001, 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.659013265999999, 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.650674382999998, 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.887245565000001, 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.886700904000001, 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:43.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:43.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.886612645, 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:43.653 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:43.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:43.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.886578219, 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:43.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.885483643000001, 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:43.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:43.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.884959810000002, 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.671 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:43.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:43.677 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.884001588, 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:43.678 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:43.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:43.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:43.683 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:43.685 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:43.683+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:43.685 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:43.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:43.785 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:43.784+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153885 5.2 5:473e987e:::benchmark_data_smithi037_101035_object10024:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.865302+0000", 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0075707329999999996, 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0075918940000000001, 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.874 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153885 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865302+0000", 2023-10-08T06:58:43.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865302+0000", 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865303+0000", 2023-10-08T06:58:43.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1900000000000001e-07 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865307+0000", 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1500000000000001e-06 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865318+0000", 2023-10-08T06:58:43.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1055e-05 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865326+0000", 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5909999999999998e-06 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865383+0000", 2023-10-08T06:58:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7521e-05 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865509+0000", 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125716 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153886 5.c 5:35250b99:::benchmark_data_smithi037_101035_object10025:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.865359+0000", 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0075141560000000001, 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0075822160000000001, 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.880 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153886 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865359+0000", 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865359+0000", 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865359+0000", 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4799999999999998e-07 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865362+0000", 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0620000000000001e-06 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865377+0000", 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4226999999999999e-05 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865383+0000", 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.725e-06 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865435+0000", 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1397000000000003e-05 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865554+0000", 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119763 2023-10-08T06:58:43.884 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153887 5.9 5:9973504d:::benchmark_data_smithi037_101035_object10026:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.865400+0000", 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.007472841, 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0075816, 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:43.885 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153887 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865400+0000", 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865400+0000", 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865401+0000", 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865403+0000", 2023-10-08T06:58:43.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7240000000000001e-06 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865411+0000", 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7179999999999996e-06 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865417+0000", 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.251e-06 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865473+0000", 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5356999999999999e-05 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865602+0000", 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012897599999999999 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:43.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.865720+0000", 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118746 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870790+0000", 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050695979999999998 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153889 5.d 5:b2fdd841:::benchmark_data_smithi037_101035_object10028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.866814+0000", 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0060592279999999998, 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062139129999999997, 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153889 2023-10-08T06:58:43.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866814+0000", 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866814+0000", 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866814+0000", 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0100000000000003e-07 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866819+0000", 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4710000000000001e-06 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866829+0000", 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866837+0000", 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3019999999999997e-06 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866874+0000", 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7867000000000002e-05 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.866999+0000", 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012436200000000001 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867104+0000", 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105436 2023-10-08T06:58:43.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.872666+0000", 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055622800000000002 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153890 5.5 5:a00ef178:::benchmark_data_smithi037_101035_object10029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.867056+0000", 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0058166249999999997, 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060176789999999997, 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.897 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153890 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867056+0000", 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867056+0000", 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867057+0000", 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8800000000000002e-07 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867061+0000", 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3939999999999998e-06 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867071+0000", 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8900000000000002e-06 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867079+0000", 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1580000000000005e-06 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867379+0000", 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00029944599999999998 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.867520+0000", 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000141397 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153891 5.7 5:e05d6878:::benchmark_data_smithi037_101035_object10030:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.868033+0000", 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.004839945, 2023-10-08T06:58:43.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050791370000000001, 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153891 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868033+0000", 2023-10-08T06:58:43.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868033+0000", 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868034+0000", 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9900000000000009e-07 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868039+0000", 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8099999999999997e-06 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868051+0000", 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.237e-05 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868059+0000", 2023-10-08T06:58:43.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2749999999999995e-06 2023-10-08T06:58:43.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868102+0000", 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3102999999999997e-05 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868210+0000", 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107797 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.907 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153892 5.2 5:4d2fb46e:::benchmark_data_smithi037_101035_object10031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.868076+0000", 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0047971180000000004, 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005074416, 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.908 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153892 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868076+0000", 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868076+0000", 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868076+0000", 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9500000000000002e-07 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868080+0000", 2023-10-08T06:58:43.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2739999999999999e-06 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868087+0000", 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8420000000000005e-06 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868094+0000", 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4280000000000001e-06 2023-10-08T06:58:43.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868140+0000", 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6292999999999999e-05 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868267+0000", 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126484 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153893 5.2 5:4174ef74:::benchmark_data_smithi037_101035_object10032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.868205+0000", 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.004668078, 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004987109, 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.913 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153893 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868205+0000", 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868205+0000", 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868205+0000", 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6899999999999996e-07 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868209+0000", 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8279999999999996e-06 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868219+0000", 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5310000000000007e-06 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868226+0000", 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6329999999999996e-06 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.869756+0000", 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001529608 2023-10-08T06:58:43.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.869915+0000", 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015868699999999999 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.917 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153894 5.9 5:9a2cab5d:::benchmark_data_smithi037_101035_object10033:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.918 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.868479+0000", 2023-10-08T06:58:43.918 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0043938270000000003, 2023-10-08T06:58:43.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004751473, 2023-10-08T06:58:43.918 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153894 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868479+0000", 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868479+0000", 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868480+0000", 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2500000000000004e-07 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868483+0000", 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6990000000000001e-06 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868496+0000", 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.279e-05 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868505+0000", 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6810000000000004e-06 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868556+0000", 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1115000000000001e-05 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868677+0000", 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012094 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.868787+0000", 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010986500000000001 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870831+0000", 2023-10-08T06:58:43.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020440469999999998 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153896 5.7 5:e2511b98:::benchmark_data_smithi037_101035_object10035:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.870602+0000", 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002271136, 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002674535, 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.924 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153896 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870602+0000", 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870602+0000", 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870603+0000", 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1900000000000001e-07 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870606+0000", 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999998e-06 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870615+0000", 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6090000000000001e-06 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870621+0000", 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5799999999999999e-06 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870665+0000", 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4566e-05 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870784+0000", 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011832600000000001 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153897 5.d 5:bec7c663:::benchmark_data_smithi037_101035_object10036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.870635+0000", 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002238023, 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026817569999999999, 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153897 2023-10-08T06:58:43.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870635+0000", 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870635+0000", 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870635+0000", 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9500000000000003e-07 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870639+0000", 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870647+0000", 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8129999999999996e-06 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870653+0000", 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8090000000000004e-06 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870690+0000", 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6519000000000001e-05 2023-10-08T06:58:43.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870813+0000", 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012342599999999999 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870923+0000", 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010967 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.933 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153898 5.2 5:4d22c9e6:::benchmark_data_smithi037_101035_object10037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.870697+0000", 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0021757439999999999, 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026707160000000001, 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153898 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870697+0000", 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870697+0000", 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870698+0000", 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7100000000000002e-07 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870701+0000", 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870708+0000", 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3409999999999997e-06 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870714+0000", 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9359999999999996e-06 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.871732+0000", 2023-10-08T06:58:43.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001017776 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.871865+0000", 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013330300000000001 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.938 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:153899 5.1 5:89710052:::benchmark_data_smithi037_101035_object10038:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:43.870728+0000", 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0021444419999999999, 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00267797, 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 153899 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870728+0000", 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870728+0000", 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870729+0000", 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870732+0000", 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7870000000000002e-06 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870739+0000", 2023-10-08T06:58:43.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4340000000000003e-06 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870745+0000", 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7080000000000002e-06 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870841+0000", 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5989999999999994e-05 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:43.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:43.870952+0000", 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011120699999999999 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 13 2023-10-08T06:58:43.943 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:43.944 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:43.945 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:43.946 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:43.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:43.943+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:43.946 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:43.947 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:43.947 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:43.947 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:43.947 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:44.045 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:44.045+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:44.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:44.145+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:44.167 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:44.168 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:44.181 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:44.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:44.264+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:44.348 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:44.347+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:44.407 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:44.407 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:44.423 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:44.441 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:58:44.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:44.464+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:44.551 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:44.549+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:44.599 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:44.600 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:44.612 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:44.654 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:44.653+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:44.751 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:44.750+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:44.830 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:44.830 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:44.844 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:44.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:44.852+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:44.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:44.953+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.054+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.060 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:45.060 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:45.074 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:45.155 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:45.154+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:45.256 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:45.256 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:45.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.256+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.272 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:45.357 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:45.356+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:45.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.465+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.492 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:45.493 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:45.506 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:45.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.590+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.660+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.732 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:45.732 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:45.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:45.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.788+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.862+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.921 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:45.922 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:45.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:45.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:45.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:45.963+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:45.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2023-10-08T06:58:46.064 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:46.064+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:46.102 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:46.114 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:46.115 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:46.124 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:46.127 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:46.128 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:46.129 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:46.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:46.165+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:46.267 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:46.266+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:46.342 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.474461028999997, 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.471752809999998, 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.468760520000004, 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.453719658000001, 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.453616800999999, 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.453553507999999, 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.453280230000001, 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.450290187, 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.448939258999999, 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.448800496, 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.448422032, 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.446260498000001, 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.437921615, 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:46.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:46.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.674492796999999, 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.424 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:46.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.673948136, 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.431 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:46.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.437 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.673859877000002, 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.438 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:46.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:46.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:46.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.673825450999999, 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:46.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.672730874999999, 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.450 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:46.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.672207042, 2023-10-08T06:58:46.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:46.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:46.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.671248819999999, 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:46.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:46.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.470 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:46.471 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:46.471 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:46.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:58:46.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:46.472+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:46.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:46.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:46.574+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:46.659 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161902 5.6 5:631ab658:::benchmark_data_smithi037_101035_object18041:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.653884+0000", 2023-10-08T06:58:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0036411899999999999, 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003666926, 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161902 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.653884+0000", 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.653884+0000", 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.653885+0000", 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0809999999999999e-06 2023-10-08T06:58:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.653891+0000", 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4970000000000001e-06 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.653903+0000", 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2221e-05 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.653912+0000", 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9400000000000008e-06 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654222+0000", 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031045200000000002 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654330+0000", 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010804 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161903 5.f 5:fa5ba77e:::benchmark_data_smithi037_101035_object18042:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.654070+0000", 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003455549, 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00356048, 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161903 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654070+0000", 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654070+0000", 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654071+0000", 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3399999999999998e-07 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654074+0000", 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6859999999999999e-06 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654085+0000", 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0423e-05 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654092+0000", 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2023-10-08T06:58:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656236+0000", 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021438759999999999 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656365+0000", 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012881200000000001 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656485+0000", 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012003800000000001 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161904 5.d 5:b629f75a:::benchmark_data_smithi037_101035_object18043:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.654986+0000", 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002538954, 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002722202, 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161904 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654986+0000", 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654986+0000", 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654987+0000", 2023-10-08T06:58:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8000000000000004e-07 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654991+0000", 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.655002+0000", 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1037e-05 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.655010+0000", 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5989999999999996e-06 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.655061+0000", 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1038999999999997e-05 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.655167+0000", 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000106205 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.655265+0000", 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7390000000000001e-05 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161906 5.2 5:4b891f2d:::benchmark_data_smithi037_101035_object18045:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.656170+0000", 2023-10-08T06:58:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001355719, 2023-10-08T06:58:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016130059999999999, 2023-10-08T06:58:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161906 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656170+0000", 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656170+0000", 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656170+0000", 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9100000000000003e-07 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656174+0000", 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0990000000000001e-06 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656182+0000", 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0409999999999998e-06 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656189+0000", 2023-10-08T06:58:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9090000000000003e-06 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656238+0000", 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8906999999999998e-05 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656365+0000", 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126606 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161908 5.6 5:66eb9945:::benchmark_data_smithi037_101035_object18047:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.656361+0000", 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0011641119999999999, 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014889530000000001, 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161908 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656361+0000", 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656361+0000", 2023-10-08T06:58:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656362+0000", 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6400000000000001e-07 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656366+0000", 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8820000000000003e-06 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656375+0000", 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3840000000000003e-06 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656382+0000", 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1369999999999996e-06 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656431+0000", 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8572000000000002e-05 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656542+0000", 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011120699999999999 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161909 5.7 5:ed5e6505:::benchmark_data_smithi037_101035_object18048:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.656402+0000", 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0011237739999999999, 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015140850000000001, 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161909 2023-10-08T06:58:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656402+0000", 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656402+0000", 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656402+0000", 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1799999999999995e-07 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656405+0000", 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9239999999999999e-06 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656414+0000", 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9069999999999996e-06 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656419+0000", 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4469999999999997e-06 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656477+0000", 2023-10-08T06:58:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7670999999999997e-05 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656572+0000", 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5358000000000004e-05 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161910 5.c 5:3f0e580b:::benchmark_data_smithi037_101035_object18049:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.656435+0000", 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001090206, 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015457940000000001, 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161910 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656435+0000", 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656435+0000", 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656436+0000", 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8699999999999995e-07 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656438+0000", 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4729999999999999e-06 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656445+0000", 2023-10-08T06:58:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0079999999999996e-06 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656450+0000", 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3709999999999999e-06 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.657376+0000", 2023-10-08T06:58:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092592900000000003 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.657503+0000", 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012618199999999999 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161911 5.f 5.9e3b52cf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.656466+0000", 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0010597180000000001, 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015877, 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161911 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656466+0000", 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656466+0000", 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656466+0000", 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656469+0000", 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5639999999999999e-06 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656475+0000", 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.387e-06 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656480+0000", 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1100000000000002e-06 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:161893 5.f e50/20)", 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.656796+0000", 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00072896099999999998, 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001308598, 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656796+0000", 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656796+0000", 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656797+0000", 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3799999999999997e-07 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656801+0000", 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.788e-06 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656809+0000", 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5399999999999996e-06 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.656815+0000", 2023-10-08T06:58:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1079999999999998e-06 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:161897 5.f e50/20)", 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.658007+0000", 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9995179, 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014301, 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658007+0000", 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658007+0000", 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658008+0000", 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0800000000000004e-07 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658012+0000", 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7809999999999999e-06 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658023+0000", 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1333e-05 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658031+0000", 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6559999999999992e-06 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161891 5.7 5:e3231a0e:::benchmark_data_smithi037_101035_object18030:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.650551+0000", 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0069741289999999999, 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076337710000000001, 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161891 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650551+0000", 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650551+0000", 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650551+0000", 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8900000000000001e-07 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650553+0000", 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5689999999999999e-06 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650557+0000", 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0500000000000002e-06 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650560+0000", 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2289999999999999e-06 2023-10-08T06:58:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650596+0000", 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5994999999999997e-05 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650672+0000", 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6122000000000001e-05 2023-10-08T06:58:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161892 5.7 5:e46ed808:::benchmark_data_smithi037_101035_object18031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.650721+0000", 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0068042500000000004, 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0075536300000000004, 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161892 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650721+0000", 2023-10-08T06:58:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650721+0000", 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650722+0000", 2023-10-08T06:58:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9999999999999997e-07 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650726+0000", 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7890000000000001e-06 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650734+0000", 2023-10-08T06:58:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1589999999999993e-06 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.650741+0000", 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9e-06 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652193+0000", 2023-10-08T06:58:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014526439999999999 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652306+0000", 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113167 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161893 5.f 5:fc6ca17e:::benchmark_data_smithi037_101035_object18032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.651618+0000", 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.005907369, 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067425769999999996, 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161893 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651618+0000", 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651618+0000", 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651619+0000", 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651622+0000", 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.856e-06 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651634+0000", 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.186e-05 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651642+0000", 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3379999999999999e-06 2023-10-08T06:58:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652180+0000", 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053835000000000005 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652295+0000", 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011547199999999999 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652413+0000", 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000117197 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658261+0000", 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058479680000000003 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161895 5.7 5:eb5a6a16:::benchmark_data_smithi037_101035_object18034:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.651944+0000", 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.005581127, 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006484854, 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161895 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651944+0000", 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651944+0000", 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651945+0000", 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651948+0000", 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3469999999999999e-06 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651959+0000", 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0801999999999999e-05 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.651967+0000", 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.174e-06 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654188+0000", 2023-10-08T06:58:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002220667 2023-10-08T06:58:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654307+0000", 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119166 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:161897 5.f 5:f02fe15f:::benchmark_data_smithi037_101035_object18036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:46.652011+0000", 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0055141620000000004, 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064677049999999998, 2023-10-08T06:58:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 161897 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652011+0000", 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652011+0000", 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652011+0000", 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1399999999999998e-07 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652013+0000", 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.95e-06 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652024+0000", 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0295000000000001e-05 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.652029+0000", 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3399999999999997e-06 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654283+0000", 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0022536819999999999 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654399+0000", 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116681 2023-10-08T06:58:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.654515+0000", 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115165 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:46.658304+0000", 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037892450000000001 2023-10-08T06:58:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 15 2023-10-08T06:58:46.736 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:46.737 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:46.738 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:46.736+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:46.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:46.838+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:46.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:46.942+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:46.960 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:46.961 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:46.961 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:46.961 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:46.961 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:46.977 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:47.043 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:47.042+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:47.143 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:47.143+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:47.213 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.337725186999997, 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:47.214 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:47.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.221 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.330890799000002, 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:47.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.223 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:47.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:47.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:47.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:47.229 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.016449219999998, 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.230 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:47.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:47.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:47.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.238 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.238 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:47.238 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.320512916999999, 2023-10-08T06:58:47.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:47.241 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.241 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.241 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.241 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:47.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.318796615, 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:47.248 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:47.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:47.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.316978794000001, 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.256 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:47.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:47.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:47.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.314974498000002, 2023-10-08T06:58:47.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:47.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:47.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:47.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:47.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:47.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.314858181999998, 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.272 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:47.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:47.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.306968233999999, 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.280 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:47.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.286 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.304222038999999, 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.287 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:47.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:47.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.747611942999999, 2023-10-08T06:58:47.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:47.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:47.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:47.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.301 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.746850624, 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:47.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:47.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:47.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:47.309 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.742934918, 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:47.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:47.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.742772037999998, 2023-10-08T06:58:47.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:47.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:47.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:47.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:47.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.322 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:47.323 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:47.323 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.741109053999999, 2023-10-08T06:58:47.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:47.323 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.323 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.323 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:47.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:47.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:47.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:47.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.740842602000001, 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.330 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:47.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:47.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:47.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.738087234999998, 2023-10-08T06:58:47.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:47.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.342 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.735776912999999, 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:47.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:118569 5.f 5:f224d98c:::benchmark_data_smithi037_101035_object118568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.410002290000001, 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020822587, 2023-10-08T06:58:47.348 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 118569 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:47.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801278+0000", 2023-10-08T06:58:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801306+0000", 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7838e-05 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801312+0000", 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:58:47.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801316+0000", 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8870000000000002e-06 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.803970+0000", 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026534200000000001 2023-10-08T06:58:47.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804095+0000", 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125652 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804244+0000", 2023-10-08T06:58:47.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148481 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.807953+0000", 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037095969999999998 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822051+0000", 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014097800000000001 2023-10-08T06:58:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822080+0000", 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8782e-05 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822100+0000", 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9986000000000001e-05 2023-10-08T06:58:47.355 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:130528 5.9 5:9bdab2cc:::benchmark_data_smithi037_101035_object130527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.419755517, 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022304398999999999, 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:47.356 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 130528 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791525+0000", 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:47.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791565+0000", 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0428e-05 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791572+0000", 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2250000000000003e-06 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791578+0000", 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796454+0000", 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048757790000000002 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:47.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796561+0000", 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107063 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796675+0000", 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114188 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.801567+0000", 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048923070000000003 2023-10-08T06:58:47.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813729+0000", 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012161896 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813787+0000", 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7896999999999998e-05 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:47.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813829+0000", 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1544000000000001e-05 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:47.363 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:47.365 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:47.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:47.364+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:47.447 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:58:47.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:47.465+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:47.540 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:164364 5.8 5:164f0c09:::benchmark_data_smithi037_101035_object20503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.532537+0000", 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0072917349999999997, 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073117299999999998, 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 164364 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532537+0000", 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532537+0000", 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532538+0000", 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0800000000000003e-07 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532543+0000", 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2649999999999998e-06 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532553+0000", 2023-10-08T06:58:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0485e-05 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532562+0000", 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5359999999999992e-06 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532669+0000", 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107741 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532799+0000", 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000130128 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:164366 5.8 5:1b0778c9:::benchmark_data_smithi037_101035_object20505:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.532753+0000", 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0070759009999999999, 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071428680000000001, 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 164366 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532753+0000", 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532753+0000", 2023-10-08T06:58:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532754+0000", 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.78e-07 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532758+0000", 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3139999999999997e-06 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532769+0000", 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0324e-05 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532776+0000", 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5349999999999999e-06 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535098+0000", 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002322214 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535262+0000", 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016305599999999999 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:164370 5.8 5:192dbf05:::benchmark_data_smithi037_101035_object20509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.532818+0000", 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0070112619999999999, 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071178220000000002, 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 164370 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532818+0000", 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532818+0000", 2023-10-08T06:58:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532818+0000", 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7e-07 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532820+0000", 2023-10-08T06:58:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1689999999999999e-06 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532827+0000", 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7170000000000002e-06 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.532832+0000", 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1220000000000003e-06 2023-10-08T06:58:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.537065+0000", 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042329840000000004 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.537221+0000", 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015570800000000001 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:164372 5.8 5:1aa1d5b5:::benchmark_data_smithi037_101035_object20511:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.535138+0000", 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0046912220000000001, 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048371949999999999, 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 164372 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535138+0000", 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535138+0000", 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535139+0000", 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3300000000000001e-07 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535142+0000", 2023-10-08T06:58:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.461e-06 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535150+0000", 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2220000000000002e-06 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535156+0000", 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.173e-06 2023-10-08T06:58:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538815+0000", 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036584230000000001 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538929+0000", 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011404300000000001 2023-10-08T06:58:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:164374 5.0 5:0a04e226:::benchmark_data_smithi037_101035_object20513:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.535480+0000", 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0043493969999999996, 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004533591, 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 164374 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535480+0000", 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535480+0000", 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535480+0000", 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6300000000000004e-07 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535484+0000", 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0160000000000002e-06 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535493+0000", 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9549999999999998e-06 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.535500+0000", 2023-10-08T06:58:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.849e-06 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538809+0000", 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033084299999999998 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538929+0000", 2023-10-08T06:58:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119914 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:164382 5.0 5.43b3e910 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.538432+0000", 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0013969270000000001, 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016166049999999999, 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 164382 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538432+0000", 2023-10-08T06:58:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538432+0000", 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538433+0000", 2023-10-08T06:58:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1999999999999999e-07 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538437+0000", 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8e-06 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538446+0000", 2023-10-08T06:58:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7419999999999992e-06 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538452+0000", 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5079999999999996e-06 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:164383 5.e 5:74a3c9c1:::benchmark_data_smithi037_101035_object20522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.538611+0000", 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001218495, 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00146893, 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 164383 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538611+0000", 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538611+0000", 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538611+0000", 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2699999999999998e-07 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538615+0000", 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0400000000000003e-06 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538627+0000", 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1568e-05 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538634+0000", 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4050000000000003e-06 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538673+0000", 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8605000000000001e-05 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.538750+0000", 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6632999999999996e-05 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:164385 5.9 e51/20 5:90cbb899:::benchmark_data_smithi037_101035_object20524:head v 51'10277, mlcod=51'10275)", 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:47.539191+0000", 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00063816700000000003, 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00092509799999999996, 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539191+0000", 2023-10-08T06:58:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539191+0000", 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539192+0000", 2023-10-08T06:58:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9100000000000003e-07 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539198+0000", 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9359999999999996e-06 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539209+0000", 2023-10-08T06:58:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1243000000000001e-05 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539215+0000", 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5640000000000002e-06 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539260+0000", 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4351000000000003e-05 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:47.539281+0000", 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1373e-05 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2023-10-08T06:58:47.581 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:47.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:47.582+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:47.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:47.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:47.683+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:47.757 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:47.758 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:47.758 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:47.758 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:47.758 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:47.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:47.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:47.784+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:47.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:47.885+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:47.949 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:47.950 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:47.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:47.950 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:47.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.951 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:47.951 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:47.951 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 59.081842510999998, 2023-10-08T06:58:47.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:47.951 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.951 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.952 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.952 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.952 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.952 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:47.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.953 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:47.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:47.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:47.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:47.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:47.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:47.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:47.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:47.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:47.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:47.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:47.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:47.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:47.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:47.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:47.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:47.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:47.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:47.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:47.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:47.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:47.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:47.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:47.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:47.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:47.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:47.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:47.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:47.965 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.965 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.965 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.965 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:47.966 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:47.966 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 59.079134291999999, 2023-10-08T06:58:47.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:47.966 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.966 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.967 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:47.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:47.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:47.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:47.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:47.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:47.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:47.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:47.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:47.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:47.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:47.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:47.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:47.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:47.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:47.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:47.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:47.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:47.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:47.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:47.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:47.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:47.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:47.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:47.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:47.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:47.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:47.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:47.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:47.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:47.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.979 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.980 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.980 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:47.980 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:47.981 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 59.076142001999997, 2023-10-08T06:58:47.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:47.981 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.981 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.981 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:47.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:47.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:47.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:47.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:47.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:47.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:47.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:47.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:47.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:47.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:47.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:47.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:47.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:47.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:47.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:47.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:47.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:47.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:47.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:47.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:47.990 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.990 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.061101140000002, 2023-10-08T06:58:47.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:47.992 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:47.992 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:47.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:47.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:47.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:47.993 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:47.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.993 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:47.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:47.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:47.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:47.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:47.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:47.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:47.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:47.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:47.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:47.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:47.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:47.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:47.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:47.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:47.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:47.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:47.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:47.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:47.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:48.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:48.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:48.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:48.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:48.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:48.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:48.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:48.003 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.003 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.003 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:48.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:48.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.060998283, 2023-10-08T06:58:48.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:48.004 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:48.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:48.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.06093499, 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.011 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:48.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:48.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.016 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.060661712000002, 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.017 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:48.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.022 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.057671669000001, 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.023 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:48.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.056320741, 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.029 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:48.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:48.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:48.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.056181978000001, 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.035 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:48.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:48.040 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.055803514000001, 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.053641979999998, 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:48.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:48.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:48.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.045303097000001, 2023-10-08T06:58:48.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:48.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:48.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:48.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.281874279, 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:48.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.281329618000001, 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.065 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:48.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:48.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:48.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.281241358999999, 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.071 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:48.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:48.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.281206933, 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:48.077 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:48.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:48.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.280112357, 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:48.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.279588524000001, 2023-10-08T06:58:48.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:48.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:48.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:48.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:48.095 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.278630302, 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:48.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:48.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:48.101 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:48.101 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:48.102 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:48.101+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:48.102 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:48.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:48.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:48.202+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:48.280 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:48.290 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:48.290 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:48.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:48.301 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:48.301 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:48.301 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:48.302 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:48.302+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:48.304 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:48.304 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:48.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:48.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:48.403+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:48.504 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:48.503+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:48.532 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:48.532 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:48.547 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:48.605 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:48.604+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:48.706 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:48.705+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:48.774 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:48.774 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:48.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:48.836 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:48.835+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:48.909 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:48.908+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:48.968 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:48.968 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:48.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:49.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:49.009+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:49.110 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:49.110+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:49.193 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:49.193 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:49.208 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:49.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:49.211+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:49.313 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:49.312+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:49.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:49.413+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:49.436 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:49.436 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:49.448 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:49.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:58:49.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:49.515+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:49.615 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:49.615+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:49.631 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:49.631 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:49.647 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:49.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:49.732+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:49.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:49.817+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:49.868 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:49.869 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:49.884 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:49.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:49.925+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:50.020 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.019+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:50.115 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:50.115 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:50.120 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.119+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:50.131 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:50.222 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.221+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:50.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:50.309 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:50.309 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:50.325 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:50.326 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.324+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:50.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:50.423+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:58:50.460 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:50.482 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:50.483 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:50.483 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:50.483 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:50.485 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:50.486 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:50.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:50.524+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:50.541 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:50.542 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:50.557 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:50.625 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.624+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:50.726 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.725+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:50.738 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 61.871483365000003, 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 61.868775145999997, 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 61.865782856000003, 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.850741994, 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.850639137000002, 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.850575844000002, 2023-10-08T06:58:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.850302566, 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.847312522999999, 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.845961594999999, 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.845822832, 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.815 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.845444367999999, 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.816 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:50.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:50.822 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.843282834, 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:50.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:50.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:50.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:50.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.834943951, 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.829 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:50.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:50.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:50.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:50.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:50.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.071515132999998, 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.837 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:50.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:50.844 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.070970471999999, 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.845 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:50.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:50.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.852 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.070882213000001, 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.853 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:50.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:50.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.070847787000002, 2023-10-08T06:58:50.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:50.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.866 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.069753210999998, 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.867 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:50.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:50.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:50.874 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.069229377999999, 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:50.875 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:50.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:50.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.882 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.068271156000002, 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:50.883 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:50.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:50.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:50.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:50.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:50.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:50.889 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:50.891 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.890+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:50.891 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:50.992 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:50.991+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:51.078 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:51.079 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:51.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.079 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174553 5.3 5:cf79df6a:::benchmark_data_smithi037_101035_object30692:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.079 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.074282+0000", 2023-10-08T06:58:51.080 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0032662390000000002, 2023-10-08T06:58:51.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003291221, 2023-10-08T06:58:51.080 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.080 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.080 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.080 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.081 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.081 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174553 2023-10-08T06:58:51.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.081 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074282+0000", 2023-10-08T06:58:51.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074282+0000", 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074283+0000", 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074286+0000", 2023-10-08T06:58:51.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7209999999999999e-06 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074292+0000", 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.477e-06 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074297+0000", 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7899999999999999e-06 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074346+0000", 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8764999999999998e-05 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074463+0000", 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000117514 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.086 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174555 5.2 5:48aecd54:::benchmark_data_smithi037_101035_object30694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.086 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.074653+0000", 2023-10-08T06:58:51.086 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002895253, 2023-10-08T06:58:51.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029985620000000002, 2023-10-08T06:58:51.087 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.087 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.087 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.087 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.087 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.088 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174555 2023-10-08T06:58:51.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.088 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074653+0000", 2023-10-08T06:58:51.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074653+0000", 2023-10-08T06:58:51.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074654+0000", 2023-10-08T06:58:51.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2023-10-08T06:58:51.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074656+0000", 2023-10-08T06:58:51.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4619999999999999e-06 2023-10-08T06:58:51.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074666+0000", 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3400000000000004e-06 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074670+0000", 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0269999999999997e-06 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075123+0000", 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00045332599999999999 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075214+0000", 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1247000000000002e-05 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.095 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174556 5.9 5:995de316:::benchmark_data_smithi037_101035_object30695:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.075897+0000", 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001651163, 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018241310000000001, 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174556 2023-10-08T06:58:51.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.097 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075897+0000", 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075897+0000", 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075898+0000", 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.44e-07 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075902+0000", 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6179999999999999e-06 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075911+0000", 2023-10-08T06:58:51.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4779999999999997e-06 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075919+0000", 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0290000000000005e-06 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.075975+0000", 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5374000000000002e-05 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076142+0000", 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016735799999999999 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076267+0000", 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000124843 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174558 5.3 5:cce50352:::benchmark_data_smithi037_101035_object30697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.076377+0000", 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001171493, 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001418402, 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.102 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174558 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076377+0000", 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076377+0000", 2023-10-08T06:58:51.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076378+0000", 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0400000000000005e-07 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076382+0000", 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2910000000000001e-06 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076396+0000", 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3495999999999999e-05 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076403+0000", 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3839999999999999e-06 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076452+0000", 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8435e-05 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076580+0000", 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012819900000000001 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174559 5.d 5:b32958c9:::benchmark_data_smithi037_101035_object30698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.076425+0000", 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0011235419999999999, 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014398690000000001, 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174559 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076425+0000", 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076425+0000", 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076426+0000", 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8100000000000003e-07 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076428+0000", 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7779999999999999e-06 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076435+0000", 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9970000000000001e-06 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076441+0000", 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3510000000000001e-06 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076483+0000", 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2611000000000002e-05 2023-10-08T06:58:51.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076556+0000", 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2649000000000002e-05 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076638+0000", 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1661000000000003e-05 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.111 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174560 5.5 5:a5ebc380:::benchmark_data_smithi037_101035_object30699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.076559+0000", 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00099015699999999997, 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001381169, 2023-10-08T06:58:51.112 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174560 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076559+0000", 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076559+0000", 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076559+0000", 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3099999999999998e-07 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076562+0000", 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.185e-06 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076570+0000", 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1790000000000008e-06 2023-10-08T06:58:51.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076576+0000", 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7060000000000001e-06 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076616+0000", 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9929999999999999e-05 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.076735+0000", 2023-10-08T06:58:51.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119196 2023-10-08T06:58:51.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.118 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174562 5.1 5:8dfcb59e:::benchmark_data_smithi037_101035_object30701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.118 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.077140+0000", 2023-10-08T06:58:51.118 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00040851, 2023-10-08T06:58:51.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00087298400000000004, 2023-10-08T06:58:51.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174562 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077140+0000", 2023-10-08T06:58:51.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077140+0000", 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077141+0000", 2023-10-08T06:58:51.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1900000000000002e-07 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077145+0000", 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8039999999999999e-06 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077156+0000", 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1582e-05 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077163+0000", 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8870000000000003e-06 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077211+0000", 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7670000000000003e-05 2023-10-08T06:58:51.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.077333+0000", 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012213600000000001 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.123 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174550 5.1 5:82323bd8:::benchmark_data_smithi037_101035_object30689:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.072953+0000", 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.004595549, 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005131699, 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174550 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.072953+0000", 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.072953+0000", 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.072954+0000", 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3599999999999999e-07 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.072956+0000", 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.824e-06 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.072963+0000", 2023-10-08T06:58:51.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0049999999999998e-06 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.072969+0000", 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3489999999999999e-06 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073014+0000", 2023-10-08T06:58:51.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5019999999999999e-05 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073145+0000", 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131605 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:174551 5.5 5:a8f05c6c:::benchmark_data_smithi037_101035_object30690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:51.073902+0000", 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0036468659999999999, 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042538360000000004, 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.129 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 174551 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073902+0000", 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073902+0000", 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073902+0000", 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8999999999999996e-07 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073906+0000", 2023-10-08T06:58:51.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9809999999999997e-06 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073917+0000", 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0885e-05 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.073925+0000", 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0099999999999995e-06 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074104+0000", 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000179142 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:51.074229+0000", 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000124036 2023-10-08T06:58:51.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.134 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.134 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.134 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.134 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:51.134 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 9 2023-10-08T06:58:51.134 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:51.135 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:51.134+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:51.137 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:51.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:51.238+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:51.327 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:51.328 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:51.328 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:51.328 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:51.328 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:51.337 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:51.336+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:51.342 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:51.438 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:51.437+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:51.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:51.538+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:51.567 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:51.567 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.690554567, 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:51.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:51.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:51.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.683720178999998, 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.578 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:51.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.584 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.369278600000001, 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:51.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:51.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:51.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:51.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:51.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.673342297000001, 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:51.593 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:51.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:51.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.671625994999999, 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.601 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.607 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.669808174, 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.667803878000001, 2023-10-08T06:58:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.667687562000001, 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:51.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.659797613999999, 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.628 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:51.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:51.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.657051418999998, 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:51.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.641 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.100441322999998, 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:51.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.099680004, 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.095764297999999, 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.095601418000001, 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.093938433999998, 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.093671982, 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.090916615000001, 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.088606293000002, 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:118569 5.f 5:f224d98c:::benchmark_data_smithi037_101035_object118568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.762831670000001, 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020822587, 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 118569 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801278+0000", 2023-10-08T06:58:51.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801306+0000", 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7838e-05 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801312+0000", 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801316+0000", 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8870000000000002e-06 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.803970+0000", 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026534200000000001 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804095+0000", 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125652 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804244+0000", 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148481 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.807953+0000", 2023-10-08T06:58:51.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037095969999999998 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822051+0000", 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014097800000000001 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822080+0000", 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8782e-05 2023-10-08T06:58:51.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822100+0000", 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9986000000000001e-05 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:130528 5.9 5:9bdab2cc:::benchmark_data_smithi037_101035_object130527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:51.781 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.772584897000002, 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022304398999999999, 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 130528 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791525+0000", 2023-10-08T06:58:51.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791565+0000", 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0428e-05 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791572+0000", 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2250000000000003e-06 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791578+0000", 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796454+0000", 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048757790000000002 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:51.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796561+0000", 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107063 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796675+0000", 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114188 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.801567+0000", 2023-10-08T06:58:51.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048923070000000003 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813729+0000", 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012161896 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813787+0000", 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7896999999999998e-05 2023-10-08T06:58:51.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813829+0000", 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1544000000000001e-05 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:51.788 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:51.789 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:51.789+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:51.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:51.890 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:51.889+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:51.967 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177157 5.4 5:214fbf78:::benchmark_data_smithi037_101035_object33296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.960832+0000", 2023-10-08T06:58:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0051443110000000004, 2023-10-08T06:58:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0051734099999999998, 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177157 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.960832+0000", 2023-10-08T06:58:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.960832+0000", 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.960833+0000", 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7000000000000004e-07 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.960840+0000", 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0310000000000001e-06 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.960852+0000", 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2472e-05 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.960859+0000", 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4910000000000002e-06 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961839+0000", 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098047299999999993 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961962+0000", 2023-10-08T06:58:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122717 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177158 5.b 5:d8cf112e:::benchmark_data_smithi037_101035_object33297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.961698+0000", 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0042786550000000001, 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043879369999999997, 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177158 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961698+0000", 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961698+0000", 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961699+0000", 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9999999999999995e-07 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961703+0000", 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1080000000000003e-06 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961712+0000", 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1230000000000006e-06 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961720+0000", 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6399999999999997e-06 2023-10-08T06:58:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961763+0000", 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2854e-05 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961882+0000", 2023-10-08T06:58:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119715 2023-10-08T06:58:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177162 5.8 5:1d758c3c:::benchmark_data_smithi037_101035_object33301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.961765+0000", 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0042113560000000003, 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043995359999999999, 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177162 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961765+0000", 2023-10-08T06:58:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961765+0000", 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961766+0000", 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5999999999999999e-07 2023-10-08T06:58:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961768+0000", 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3929999999999998e-06 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961773+0000", 2023-10-08T06:58:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0429999999999998e-06 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961776+0000", 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4170000000000001e-06 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963648+0000", 2023-10-08T06:58:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001871199 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963761+0000", 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011327099999999999 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177163 5.8 5:16f2357e:::benchmark_data_smithi037_101035_object33302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.961781+0000", 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0041951080000000003, 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044523849999999997, 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177163 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961781+0000", 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961781+0000", 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961782+0000", 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1e-07 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961783+0000", 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3689999999999999e-06 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961786+0000", 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4089999999999999e-06 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961789+0000", 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965683+0000", 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038938060000000001 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965814+0000", 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013071599999999999 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177164 5.4 5:2b9581e8:::benchmark_data_smithi037_101035_object33303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.961793+0000", 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0041836199999999999, 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045095029999999998, 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177164 2023-10-08T06:58:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961793+0000", 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961793+0000", 2023-10-08T06:58:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961793+0000", 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0599999999999999e-07 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961794+0000", 2023-10-08T06:58:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.429e-06 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961798+0000", 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3400000000000002e-06 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961801+0000", 2023-10-08T06:58:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965493+0000", 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036920690000000001 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965612+0000", 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119673 2023-10-08T06:58:51.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177165 5.e 5:76078991:::benchmark_data_smithi037_101035_object33304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.961809+0000", 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0041672289999999997, 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045624150000000002, 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:51.994 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177165 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961809+0000", 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961809+0000", 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961810+0000", 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9999999999999998e-07 2023-10-08T06:58:51.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961812+0000", 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1629999999999999e-06 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961818+0000", 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6390000000000003e-06 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961824+0000", 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1789999999999999e-06 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961867+0000", 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2929999999999997e-05 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.961973+0000", 2023-10-08T06:58:51.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010664 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177166 5.e 5:7dd03bd2:::benchmark_data_smithi037_101035_object33305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.963129+0000", 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0028478499999999999, 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033097980000000001, 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:51.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177166 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963129+0000", 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963129+0000", 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963129+0000", 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7800000000000001e-07 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963133+0000", 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.366e-06 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963144+0000", 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1204e-05 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963149+0000", 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3569999999999997e-06 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965165+0000", 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020157909999999999 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965331+0000", 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165997 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177168 5.b 5:dc12c215:::benchmark_data_smithi037_101035_object33307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.963248+0000", 2023-10-08T06:58:52.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0027282159999999999, 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032596779999999998, 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177168 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963248+0000", 2023-10-08T06:58:52.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963248+0000", 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963249+0000", 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5799999999999999e-07 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963251+0000", 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5720000000000001e-06 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963258+0000", 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9789999999999996e-06 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963262+0000", 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.963991+0000", 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072859300000000004 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.964105+0000", 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011381400000000001 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177171 5.b 5:d0a73a4e:::benchmark_data_smithi037_101035_object33310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:52.010 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.964056+0000", 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0019201699999999999, 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002519608, 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177171 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.964056+0000", 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.964056+0000", 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.964057+0000", 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6099999999999999e-07 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.964061+0000", 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1570000000000002e-06 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.964070+0000", 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1439999999999992e-06 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.964077+0000", 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7959999999999998e-06 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965948+0000", 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001870505 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966062+0000", 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011414299999999999 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177173 5.e 5.b9c78a7e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.965662+0000", 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00031413600000000002, 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098965699999999991, 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177173 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965662+0000", 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965662+0000", 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965663+0000", 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6099999999999999e-07 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965668+0000", 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8400000000000002e-06 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965677+0000", 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4420000000000004e-06 2023-10-08T06:58:52.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.965685+0000", 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9470000000000003e-06 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:177175 5.a 5:524a2cc1:::benchmark_data_smithi037_101035_object33314:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:51.966240+0000", 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9997368, 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000469209, 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 177175 2023-10-08T06:58:52.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966240+0000", 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966240+0000", 2023-10-08T06:58:52.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966241+0000", 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5099999999999999e-07 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966248+0000", 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7170000000000008e-06 2023-10-08T06:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966259+0000", 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0505e-05 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966267+0000", 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0250000000000002e-06 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966323+0000", 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6030999999999999e-05 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:51.966464+0000", 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014076400000000001 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.025 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:52.026 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 11 2023-10-08T06:58:52.026 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:52.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2023-10-08T06:58:52.027 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:52.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:52.027+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:52.127 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:52.127+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:52.229 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:52.228+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:52.245 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:52.245 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:52.246 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:52.246 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:52.246 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:52.262 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:52.346 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:52.345+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:52.430 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:52.429+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:52.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:58:52.482 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:52.482 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:52.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:52.482 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:52.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.482 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.614440793999997, 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:52.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:52.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:52.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:52.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:52.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.611732574999998, 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.498 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.608740285000003, 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:52.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.503 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.593699422999997, 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:52.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.593596566000002, 2023-10-08T06:58:52.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:52.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.593533272999998, 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:52.516 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:52.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:52.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.593259994999997, 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:52.522 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:52.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.590269952, 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:52.528 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:52.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:52.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.588919023999999, 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.534 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:52.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.539 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.588780260999997, 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.540 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:52.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.546 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.588401797000003, 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:52.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.586240263000001, 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:52.552 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:52.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.57790138, 2023-10-08T06:58:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:52.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:52.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.814472561999999, 2023-10-08T06:58:52.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:52.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:52.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.813927901, 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.571 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:52.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.813839642000001, 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.577 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:52.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.582 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.813805215999999, 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:52.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.812710639999999, 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:52.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:52.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.812186807, 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:52.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:52.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.811228584999999, 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:52.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:52.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:52.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:52.605 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:52.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:52.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:52.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:52.606+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:52.707 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:52.707+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:52.764 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:52.785 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:52.788 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:52.789 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:52.794 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:52.795 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:52.809 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:52.808+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:52.813 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:52.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:52.910+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:52.988 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:52.989 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:52.999 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:53.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:53.040+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:53.112 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:53.111+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:53.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:53.213+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:53.225 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:53.225 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:53.242 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:53.315 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:53.314+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:53.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:53.415+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:53.423 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:53.423 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:53.439 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:58:53.523 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:53.522+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:53.617 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:53.616+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:53.654 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:53.654 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:53.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:53.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:53.718+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:53.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:53.819+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:53.880 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:53.880 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:53.894 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:53.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:53.938+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:54.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:54.022+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:54.083 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:54.083 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:54.098 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:54.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:54.139+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:54.224 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:54.223+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:54.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:54.324+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:54.336 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:54.336 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:54.351 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:54.425 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:54.425+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:54.526 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:54.525+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:54.577 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:54.577 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:54.591 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:54.635 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:54.634+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:54.730 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:54.728+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:54.767 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:54.767 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:54.783 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:54.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:54.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:54.830+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:54.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:54.932+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:54.941 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:54.962 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:54.965 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:54.966 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:54.999 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:55.000 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:55.013 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:55.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:55.031+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:55.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:55.132+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:55.197 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:55.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.330132090000006, 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:55.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:55.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:55.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.204 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.327423870999993, 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:55.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:55.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:55.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.211 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.324431580999999, 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:55.216 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.309390719, 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:55.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:55.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.309287861999998, 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.229 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.309224569000001, 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.230 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:55.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:55.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:55.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.236 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.236 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:55.236 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.308951291, 2023-10-08T06:58:55.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:55.236 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.238 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.238 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:55.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.238 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:55.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:55.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.305961248000003, 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.244 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:55.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.249 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.304610320000002, 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:55.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:55.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.304471556999999, 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:55.255 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:55.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:55.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.304093092999999, 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:55.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:55.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.301931559000003, 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.266 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:55.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:55.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.293592676000003, 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.271 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:55.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:55.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.530163858000002, 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:55.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:55.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.529619197000002, 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.283 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:55.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.529530938000001, 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:55.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:55.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:55.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.529496512000001, 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:55.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:55.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.528401936000002, 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:55.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:55.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.527878102999999, 2023-10-08T06:58:55.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:55.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:55.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.526919880999998, 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:55.311 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:55.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:55.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:55.316 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.316 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.316 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.316 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:55.316 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:55.317 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:55.316+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:55.318 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:55.418 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:55.417+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:55.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:58:55.508 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187335 5.f 5:f635cd30:::benchmark_data_smithi037_101035_object43474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.500362+0000", 2023-10-08T06:58:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0059955939999999999, 2023-10-08T06:58:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060186429999999997, 2023-10-08T06:58:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187335 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500362+0000", 2023-10-08T06:58:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500362+0000", 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500363+0000", 2023-10-08T06:58:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1629999999999999e-06 2023-10-08T06:58:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500368+0000", 2023-10-08T06:58:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.386e-06 2023-10-08T06:58:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500375+0000", 2023-10-08T06:58:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-06 2023-10-08T06:58:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500380+0000", 2023-10-08T06:58:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4519999999999996e-06 2023-10-08T06:58:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500428+0000", 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7611000000000002e-05 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500529+0000", 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101376 2023-10-08T06:58:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.500619+0000", 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0087000000000007e-05 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502368+0000", 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001748323 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187339 5.d 5:bb7d3ca4:::benchmark_data_smithi037_101035_object43478:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.501151+0000", 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0052063659999999996, 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052933349999999997, 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187339 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501151+0000", 2023-10-08T06:58:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501151+0000", 2023-10-08T06:58:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501152+0000", 2023-10-08T06:58:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:58:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501156+0000", 2023-10-08T06:58:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8550000000000004e-06 2023-10-08T06:58:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501168+0000", 2023-10-08T06:58:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1753000000000001e-05 2023-10-08T06:58:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501177+0000", 2023-10-08T06:58:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8750000000000006e-06 2023-10-08T06:58:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501230+0000", 2023-10-08T06:58:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3387000000000002e-05 2023-10-08T06:58:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501372+0000", 2023-10-08T06:58:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014173699999999999 2023-10-08T06:58:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.501490+0000", 2023-10-08T06:58:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118594 2023-10-08T06:58:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.503398+0000", 2023-10-08T06:58:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019073880000000001 2023-10-08T06:58:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187341 5.6 5:61a52309:::benchmark_data_smithi037_101035_object43480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.502346+0000", 2023-10-08T06:58:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0040117460000000001, 2023-10-08T06:58:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041835580000000004, 2023-10-08T06:58:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187341 2023-10-08T06:58:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502346+0000", 2023-10-08T06:58:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502346+0000", 2023-10-08T06:58:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502346+0000", 2023-10-08T06:58:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9100000000000004e-07 2023-10-08T06:58:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502349+0000", 2023-10-08T06:58:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9170000000000002e-06 2023-10-08T06:58:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502360+0000", 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0694e-05 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502366+0000", 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7069999999999997e-06 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502411+0000", 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5089000000000001e-05 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502499+0000", 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7952000000000001e-05 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187342 5.f 5:fa7492ac:::benchmark_data_smithi037_101035_object43481:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.502379+0000", 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0039789669999999999, 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042267600000000004, 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187342 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502379+0000", 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502379+0000", 2023-10-08T06:58:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502379+0000", 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502382+0000", 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.384e-06 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502388+0000", 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.579e-06 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502395+0000", 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9299999999999997e-06 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502439+0000", 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3949999999999998e-05 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502561+0000", 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012214699999999999 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502676+0000", 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011510600000000001 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.505449+0000", 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00277305 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187343 5.6 5:690fd7ff:::benchmark_data_smithi037_101035_object43482:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.502405+0000", 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0039530850000000003, 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042957940000000003, 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187343 2023-10-08T06:58:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502405+0000", 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502405+0000", 2023-10-08T06:58:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502405+0000", 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8800000000000003e-07 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502407+0000", 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.119e-06 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502413+0000", 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9529999999999996e-06 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502419+0000", 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9510000000000003e-06 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504037+0000", 2023-10-08T06:58:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001617634 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504166+0000", 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012884499999999999 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187345 5.6 5:67ae687f:::benchmark_data_smithi037_101035_object43484:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.502998+0000", 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003359435, 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003777243, 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "reached pg", 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187345 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502998+0000", 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502998+0000", 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.502999+0000", 2023-10-08T06:58:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.503004+0000", 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6290000000000001e-06 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.503015+0000", 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0817e-05 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.503022+0000", 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5530000000000004e-06 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506691+0000", 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036688889999999998 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187347 5.d 5:bc78ea4b:::benchmark_data_smithi037_101035_object43486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.504066+0000", 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0022914150000000002, 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027766930000000002, 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187347 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504066+0000", 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504066+0000", 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504067+0000", 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.02e-07 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504071+0000", 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2690000000000001e-06 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504086+0000", 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4319e-05 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504101+0000", 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5003e-05 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504152+0000", 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1450999999999999e-05 2023-10-08T06:58:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504259+0000", 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107056 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.504342+0000", 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2825999999999996e-05 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187350 5.3 5:cff3405e:::benchmark_data_smithi037_101035_object43489:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.505949+0000", 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00040906299999999998, 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00098419799999999993, 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187350 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.505949+0000", 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.505949+0000", 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.505950+0000", 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1200000000000001e-07 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.505954+0000", 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2169999999999996e-06 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.505966+0000", 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.223e-05 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.505974+0000", 2023-10-08T06:58:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9480000000000008e-06 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506017+0000", 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3423000000000001e-05 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506107+0000", 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9555000000000006e-05 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187352 5.6 5.8c0330e6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.506790+0000", 2023-10-08T06:58:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.999567, 2023-10-08T06:58:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00022661299999999999, 2023-10-08T06:58:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187352 2023-10-08T06:58:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506790+0000", 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506790+0000", 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506791+0000", 2023-10-08T06:58:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2099999999999995e-07 2023-10-08T06:58:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506795+0000", 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9480000000000001e-06 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506807+0000", 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2104e-05 2023-10-08T06:58:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506815+0000", 2023-10-08T06:58:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0390000000000005e-06 2023-10-08T06:58:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:187339 5.d e53/32 ondisk, result = 0)", 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.506942+0000", 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9994159, 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013890699999999999, 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506942+0000", 2023-10-08T06:58:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506942+0000", 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506942+0000", 2023-10-08T06:58:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.41e-07 2023-10-08T06:58:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506945+0000", 2023-10-08T06:58:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5380000000000001e-06 2023-10-08T06:58:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506951+0000", 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4189999999999999e-06 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506956+0000", 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:58:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.506994+0000", 2023-10-08T06:58:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8065999999999998e-05 2023-10-08T06:58:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507002+0000", 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2349999999999999e-06 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187353 5.c 5.577b300c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.507121+0000", 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9992371, 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9983000000000001e-05, 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187353 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507121+0000", 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507121+0000", 2023-10-08T06:58:55.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507122+0000", 2023-10-08T06:58:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507125+0000", 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0900000000000001e-06 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507134+0000", 2023-10-08T06:58:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0999999999999993e-06 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507141+0000", 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.109e-06 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:187357 5.7 5.abbfc27 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:55.507183+0000", 2023-10-08T06:58:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9991751, 2023-10-08T06:58:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2067000000000003e-05, 2023-10-08T06:58:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187357 2023-10-08T06:58:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507183+0000", 2023-10-08T06:58:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507183+0000", 2023-10-08T06:58:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507183+0000", 2023-10-08T06:58:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1500000000000004e-07 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507186+0000", 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6749999999999998e-06 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507193+0000", 2023-10-08T06:58:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0539999999999997e-06 2023-10-08T06:58:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:55.507198+0000", 2023-10-08T06:58:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4609999999999999e-06 2023-10-08T06:58:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 12 2023-10-08T06:58:55.587 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:55.590 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:55.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:55.588+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:55.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:55.690+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:55.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:55.791+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:55.808 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:55.809 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:58:55.809 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:58:55.809 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:58:55.809 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:55.825 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:55.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:55.911+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:55.992 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:55.991+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.178103311000001, 2023-10-08T06:58:56.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:56.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:58:56.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:58:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:58:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.171268923, 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:58:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:58:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 49.856827344000003, 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:58:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.160891040999999, 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:58:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:58:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:58:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.159174739000001, 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:58:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:58:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.157356917999998, 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:58:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:58:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:58:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.155352622000002, 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:58:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:58:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.155236305999999, 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:58:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:58:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.147346358, 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:58:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:58:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.144600163, 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:58:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.587990067, 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:58:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:58:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.587228748000001, 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:58:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:58:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.583313042, 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:58:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.583150162000003, 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:58:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:58:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.581487178000003, 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:58:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.581220725999998, 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:58:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:58:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.578465358999999, 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:58:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:58:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.576155036999999, 2023-10-08T06:58:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:118569 5.f 5:f224d98c:::benchmark_data_smithi037_101035_object118568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.250380413999999, 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020822587, 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 118569 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:58:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801278+0000", 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801306+0000", 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7838e-05 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801312+0000", 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801316+0000", 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8870000000000002e-06 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.803970+0000", 2023-10-08T06:58:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026534200000000001 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804095+0000", 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125652 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804244+0000", 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148481 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.807953+0000", 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037095969999999998 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822051+0000", 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014097800000000001 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822080+0000", 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8782e-05 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822100+0000", 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9986000000000001e-05 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:130528 5.9 5:9bdab2cc:::benchmark_data_smithi037_101035_object130527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.260133640999999, 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022304398999999999, 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 130528 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791525+0000", 2023-10-08T06:58:56.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791565+0000", 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0428e-05 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791572+0000", 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2250000000000003e-06 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791578+0000", 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796454+0000", 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048757790000000002 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:56.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796561+0000", 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107063 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796675+0000", 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114188 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.801567+0000", 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048923070000000003 2023-10-08T06:58:56.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813729+0000", 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012161896 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813787+0000", 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7896999999999998e-05 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:58:56.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813829+0000", 2023-10-08T06:58:56.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1544000000000001e-05 2023-10-08T06:58:56.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.186 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:56.186 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:56.186 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:56.188 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:56.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:56.187+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:56.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:56.288+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:56.370 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189913 5.a 5:51c9424e:::benchmark_data_smithi037_101035_object46052:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367025+0000", 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0027515949999999999, 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002779859, 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189913 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367025+0000", 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367025+0000", 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367026+0000", 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000005e-07 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367030+0000", 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4740000000000001e-06 2023-10-08T06:58:56.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367039+0000", 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5109999999999992e-06 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367046+0000", 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8329999999999996e-06 2023-10-08T06:58:56.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367089+0000", 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2509999999999998e-05 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367184+0000", 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5416999999999998e-05 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189917 5.a 5:5354eeff:::benchmark_data_smithi037_101035_object46056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367621+0000", 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021562170000000002, 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022604349999999999, 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.377 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189917 2023-10-08T06:58:56.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.377 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367621+0000", 2023-10-08T06:58:56.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367621+0000", 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367622+0000", 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6400000000000001e-07 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367626+0000", 2023-10-08T06:58:56.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9190000000000001e-06 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367637+0000", 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1296e-05 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367645+0000", 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4060000000000005e-06 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.368852+0000", 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012070799999999999 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.368949+0000", 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6180000000000004e-05 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189918 5.a 5.2c7c9d2a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367660+0000", 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021167249999999999, 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022913959999999998, 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189918 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367660+0000", 2023-10-08T06:58:56.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367660+0000", 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367661+0000", 2023-10-08T06:58:56.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2e-07 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367663+0000", 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2369999999999999e-06 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367669+0000", 2023-10-08T06:58:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0519999999999998e-06 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367675+0000", 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3169999999999998e-06 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189919 5.e 5:793ea6fb:::benchmark_data_smithi037_101035_object46058:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367684+0000", 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0020930150000000002, 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324830000000002, 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189919 2023-10-08T06:58:56.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.388 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367684+0000", 2023-10-08T06:58:56.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367684+0000", 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367684+0000", 2023-10-08T06:58:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9700000000000002e-07 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367686+0000", 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0030000000000001e-06 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367694+0000", 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1219999999999997e-06 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367699+0000", 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.677e-06 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367738+0000", 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8481e-05 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367882+0000", 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014401400000000001 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189920 5.4 5:21d3f5cc:::benchmark_data_smithi037_101035_object46059:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367711+0000", 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0020658159999999998, 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023789620000000001, 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189920 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367711+0000", 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367711+0000", 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367711+0000", 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1100000000000002e-07 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367713+0000", 2023-10-08T06:58:56.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.906e-06 2023-10-08T06:58:56.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367720+0000", 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1619999999999996e-06 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367724+0000", 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7299999999999996e-06 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367762+0000", 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7351999999999997e-05 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367898+0000", 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013647799999999999 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189921 5.e 5:7a80327d:::benchmark_data_smithi037_101035_object46060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367735+0000", 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0020421459999999999, 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024378529999999998, 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.399 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189921 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367735+0000", 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367735+0000", 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367735+0000", 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.27e-07 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367737+0000", 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9410000000000001e-06 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367743+0000", 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.463e-06 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367747+0000", 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4109999999999998e-06 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.369983+0000", 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022361630000000002 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.370129+0000", 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014623899999999999 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189923 5.0 5:0ac10b61:::benchmark_data_smithi037_101035_object46062:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367907+0000", 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0018702600000000001, 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023464839999999998, 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189923 2023-10-08T06:58:56.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367907+0000", 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367907+0000", 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367907+0000", 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.51e-07 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367910+0000", 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7070000000000001e-06 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367917+0000", 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1019999999999999e-06 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367922+0000", 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0889999999999999e-06 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367977+0000", 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4839000000000001e-05 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.368111+0000", 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013366699999999999 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189924 5.b 5:d8b53143:::benchmark_data_smithi037_101035_object46063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.367938+0000", 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0018386710000000001, 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023875839999999999, 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189924 2023-10-08T06:58:56.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367938+0000", 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367938+0000", 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367939+0000", 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8400000000000005e-07 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367941+0000", 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4839999999999998e-06 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367948+0000", 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6250000000000001e-06 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367953+0000", 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6360000000000002e-06 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.367999+0000", 2023-10-08T06:58:56.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6152999999999997e-05 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.368131+0000", 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013183699999999999 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:189926 5.e 5.5998eb3e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:56.369338+0000", 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00043888899999999998, 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001054789, 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 189926 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.369338+0000", 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.369338+0000", 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.369339+0000", 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1510000000000001e-06 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.369344+0000", 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9300000000000002e-06 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.369357+0000", 2023-10-08T06:58:56.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2867999999999999e-05 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:56.369364+0000", 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3599999999999998e-06 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 9 2023-10-08T06:58:56.417 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:56.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:56.418+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:56.419 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:56.483 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:58:56.519 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:56.519+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:56.597 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:56.597 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:56.597 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:56.597 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:56.597 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:56.609 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:56.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:56.620+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:56.723 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:56.722+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:56.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:56.824+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:56.834 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.967629332000001, 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.835 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:56.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:56.841 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.964921113000003, 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.842 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:56.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.961928822999994, 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:56.849 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:56.854 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.946887961000002, 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:56.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:56.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:56.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:56.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:56.860 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.946785104, 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:56.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:56.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.866 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.946721811000003, 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:56.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.872 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.946448533000002, 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:56.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.943458489999998, 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.879 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:56.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:56.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.942107561999997, 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:56.885 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:56.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.941968799000001, 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:56.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:56.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:56.896 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.941590335000001, 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:56.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.939428800999998, 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.902 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:56.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.931089917999998, 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:56.907 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:56.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:56.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.167661099999997, 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.913 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:56.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:56.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.167116438999997, 2023-10-08T06:58:56.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:56.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:56.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.167028180000003, 2023-10-08T06:58:56.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:56.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:56.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:56.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.166993754000003, 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:56.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.936 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.165899177999997, 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.937 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:56.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.942 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.165375345000001, 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.943 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:56.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:56.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.948 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.164417123, 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:56.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:56.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:56.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:56.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:56.954 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:56.956 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:56.954+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:56.956 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:56.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:58:57.056 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:57.055+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:57.121 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:57.141 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:58:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:58:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:57.144 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:57.145 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:57.149 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:57.149 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:57.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:57.157+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:57.165 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:57.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:57.257+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:57.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:57.358+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:57.388 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:57.388 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:57.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:57.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:57.489+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:57.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:57.560+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:57.637 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:57.637 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:57.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:57.697 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:57.696+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:57.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:57.762+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:57.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2023-10-08T06:58:57.833 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:57.834 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:57.847 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:57.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:57.863+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:57.966 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:57.965+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:58.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:58.064+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:58.070 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:58.070 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:58.084 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:58.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:58.165+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:58.266 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:58.265+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:58.303 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:58.303 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:58.318 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:58.369 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:58.368+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:58.468 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:58.467+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:58.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:58:58.510 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:58.510 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:58.524 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:58.568 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:58.568+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:58.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:58.669+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:58.708 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:58.708 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:58.726 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:58:58.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:58.811+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:58.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:58.870+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:58.959 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:58.959 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:58.969 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:58:59.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:59.010+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:59.071 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:59.070+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:59.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:58:59.152 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:58:59.152 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:58:59.167 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:58:59.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:59.170+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:59.273 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:59.272+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:59.298 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:58:59.319 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:58:59.322 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:58:59.323 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:58:59.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:59.373+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:59.388 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:59.388 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:58:59.389 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:58:59.389 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:58:59.389 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:59.404 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:58:59.492 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:58:59.489+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:58:59.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:59.575+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.761136116000003, 2023-10-08T06:58:59.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:58:59.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:58:59.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.758427897000004, 2023-10-08T06:58:59.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:59.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:58:59.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:58:59.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.755435606999995, 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:58:59.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.740394745000003, 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.648 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:58:59.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:58:59.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:58:59.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:58:59.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:58:59.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:59.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:59.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:58:59.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:58:59.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:58:59.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:58:59.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:58:59.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:58:59.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.740291888000002, 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.657 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:58:59.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:58:59.662 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.740228594999998, 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.663 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:58:59.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:58:59.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.668 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.739955317000003, 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:58:59.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:58:59.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.674 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.736965273999999, 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.675 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:58:59.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:58:59.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.735614345999998, 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.681 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:58:59.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:58:59.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.735475583000003, 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:58:59.687 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:58:59.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:58:59.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:59.693 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.735097119000002, 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:58:59.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:58:59.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.698 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.732935585, 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:59.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.703 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.724596701999999, 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.704 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:58:59.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.709 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.961167883999998, 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:58:59.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:59.716 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.960623222999999, 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:58:59.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.722 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.960534963999997, 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.723 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:58:59.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.960500537999998, 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.729 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:58:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:59.734 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.959405961999998, 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:58:59.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:58:59.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:58:59.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.958882129000003, 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.741 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:58:59.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.957923907000001, 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:58:59.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:58:59.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:58:59.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:58:59.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:58:59.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.752 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:58:59.752 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:58:59.752 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:58:59.754 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:58:59.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:59.752+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:59.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:59.854+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200341 5.7 5:e11d95a1:::benchmark_data_smithi037_101035_object56480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.930433+0000", 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003303772, 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033298709999999999, 2023-10-08T06:58:59.935 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.936 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:59.936 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.936 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.936 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.936 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200341 2023-10-08T06:58:59.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.936 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930433+0000", 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930433+0000", 2023-10-08T06:58:59.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930434+0000", 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.564e-06 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930445+0000", 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0774000000000001e-05 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930458+0000", 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.34e-05 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930467+0000", 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1810000000000007e-06 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930521+0000", 2023-10-08T06:58:59.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3177999999999998e-05 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930638+0000", 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011704100000000001 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200342 5.7 5:ec5fdb10:::benchmark_data_smithi037_101035_object56481:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.930488+0000", 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0032481939999999998, 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033503410000000002, 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.943 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200342 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930488+0000", 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930488+0000", 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930489+0000", 2023-10-08T06:58:59.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930492+0000", 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9100000000000001e-06 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930499+0000", 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8630000000000008e-06 2023-10-08T06:58:59.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930506+0000", 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.336e-06 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932662+0000", 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021566319999999999 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932790+0000", 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000128014 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200344 5.d 5:b99fd4b6:::benchmark_data_smithi037_101035_object56483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.930524+0000", 2023-10-08T06:58:59.948 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003211963, 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033831070000000002, 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200344 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930524+0000", 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930524+0000", 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930525+0000", 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2300000000000001e-07 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930528+0000", 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6589999999999999e-06 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930535+0000", 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8480000000000001e-06 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930541+0000", 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9830000000000001e-06 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930589+0000", 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7463000000000003e-05 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930704+0000", 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115031 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930814+0000", 2023-10-08T06:58:59.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010987100000000001 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200345 5.5 5:afb8e0ff:::benchmark_data_smithi037_101035_object56484:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.930557+0000", 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0031795500000000002, 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034238049999999998, 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.954 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200345 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930557+0000", 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930557+0000", 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930557+0000", 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6499999999999999e-07 2023-10-08T06:58:59.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930560+0000", 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5600000000000001e-06 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930568+0000", 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.712e-06 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930576+0000", 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3310000000000004e-06 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930614+0000", 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7564999999999997e-05 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.930723+0000", 2023-10-08T06:58:59.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109503 2023-10-08T06:58:59.961 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.961 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200348 5.1 5:87fd5515:::benchmark_data_smithi037_101035_object56487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.932541+0000", 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001195413, 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015077160000000001, 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:59.962 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200348 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932541+0000", 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932541+0000", 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932542+0000", 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1399999999999995e-07 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932546+0000", 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2649999999999998e-06 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932556+0000", 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7010000000000008e-06 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932563+0000", 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4189999999999996e-06 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932611+0000", 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8026999999999999e-05 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932732+0000", 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012072 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200349 5.7 5.307a57 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.932581+0000", 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001155444, 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015315350000000001, 2023-10-08T06:58:59.967 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200349 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932581+0000", 2023-10-08T06:58:59.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932581+0000", 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932581+0000", 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.89e-07 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932584+0000", 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5280000000000002e-06 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932591+0000", 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.691e-06 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.932596+0000", 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7479999999999999e-06 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200351 5.9 5:9f7e02eb:::benchmark_data_smithi037_101035_object56490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.933017+0000", 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00071898199999999995, 2023-10-08T06:58:59.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011500939999999999, 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200351 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933017+0000", 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933017+0000", 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933018+0000", 2023-10-08T06:58:59.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5700000000000002e-07 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933022+0000", 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1819999999999999e-06 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933034+0000", 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1358999999999999e-05 2023-10-08T06:58:59.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933040+0000", 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5579999999999997e-06 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933092+0000", 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1845000000000003e-05 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933214+0000", 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012241300000000001 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933323+0000", 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010883300000000001 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200352 5.2 5:4f9d7ff9:::benchmark_data_smithi037_101035_object56491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.933054+0000", 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00068232999999999998, 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011881280000000001, 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.977 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200352 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933054+0000", 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933054+0000", 2023-10-08T06:58:59.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933054+0000", 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0699999999999998e-07 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933057+0000", 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1660000000000001e-06 2023-10-08T06:58:59.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933068+0000", 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1143e-05 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933073+0000", 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1229999999999999e-06 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933112+0000", 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9381000000000001e-05 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.933194+0000", 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1310000000000006e-05 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:200331 5.7 5:e9457dbe:::benchmark_data_smithi037_101035_object56470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:59.925598+0000", 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0081382239999999995, 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087160599999999994, 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:58:59.982 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 200331 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.925598+0000", 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.925598+0000", 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:58:59.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.925599+0000", 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9800000000000003e-07 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.925603+0000", 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9979999999999997e-06 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.925614+0000", 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1353e-05 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.925621+0000", 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960000000000002e-06 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.927427+0000", 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018059370000000001 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:59.927539+0000", 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111705 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.986 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:58:59.987 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:58:59.987 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 9 2023-10-08T06:58:59.987 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:58:59.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:58:59.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:58:59.987+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:00.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:00.088+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:00.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:00.189+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:00.215 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:00.215 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:00.216 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:00.216 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:00.216 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:00.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:00.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:00.313+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:00.393 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:00.392+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:00.458 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:00.459 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:00.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:00.459 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:00.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.459 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28701 5.9 5:979b6114:::benchmark_data_smithi037_101035_object28700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:00.459 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:59:00.459 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.582256000000001, 2023-10-08T06:59:00.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027720871000000001, 2023-10-08T06:59:00.460 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.460 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.460 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.460 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.460 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.460 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28701 2023-10-08T06:59:00.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:59:00.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873554+0000", 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873555+0000", 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2023-10-08T06:59:00.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873647+0000", 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1829999999999993e-05 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873657+0000", 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.006e-05 2023-10-08T06:59:00.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873663+0000", 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873708+0000", 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4957999999999999e-05 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873802+0000", 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4396999999999998e-05 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.873887+0000", 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5353999999999996e-05 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.879313+0000", 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054255470000000002 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901220+0000", 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021906931000000001 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901254+0000", 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.383e-05 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901275+0000", 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1529e-05 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:28707 5.9 5:966f4ce2:::benchmark_data_smithi037_101035_object28706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.575421612, 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.021030079, 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.468 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 28707 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880389+0000", 2023-10-08T06:59:00.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880390+0000", 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3099999999999996e-07 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880418+0000", 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8534000000000002e-05 2023-10-08T06:59:00.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880433+0000", 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4270000000000001e-05 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880439+0000", 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3300000000000004e-06 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880484+0000", 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5237000000000001e-05 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880613+0000", 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129183 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.880728+0000", 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114821 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.882284+0000", 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015556229999999999 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901324+0000", 2023-10-08T06:59:00.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019039921000000001 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901386+0000", 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2001999999999994e-05 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:57:48.901419+0000", 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3226999999999999e-05 2023-10-08T06:59:00.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:67178 5.2 5:47e79d77:::benchmark_data_smithi037_101035_object67177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.260980033000003, 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020746388000000001, 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.475 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 67178 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194830+0000", 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194831+0000", 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9599999999999999e-07 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194867+0000", 2023-10-08T06:59:00.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5892999999999997e-05 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194872+0000", 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194875+0000", 2023-10-08T06:59:00.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4680000000000001e-06 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.194912+0000", 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6563000000000002e-05 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195011+0000", 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9557999999999998e-05 2023-10-08T06:59:00.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.195100+0000", 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8671000000000005e-05 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.197205+0000", 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021046720000000001 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215477+0000", 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.018272604000000001 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215526+0000", 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8640000000000002e-05 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:06.215577+0000", 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0748000000000003e-05 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.565043729999999, 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:00.482 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:00.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:00.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.563327428000001, 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:00.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.561509606999998, 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.497 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:00.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.559505311000002, 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:00.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:00.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.559388994999999, 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.511 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:00.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:00.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.551499047, 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95207 5.9 5:9cdd5620:::benchmark_data_smithi037_101035_object95206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.548752852, 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062938121999999999, 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95207 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907058+0000", 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907108+0000", 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9363999999999997e-05 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907120+0000", 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1921e-05 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907127+0000", 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3030000000000002e-06 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907170+0000", 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3352000000000001e-05 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907265+0000", 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4888000000000004e-05 2023-10-08T06:59:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.907367+0000", 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102335 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.912272+0000", 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049050329999999996 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969943+0000", 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057670335000000003 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969974+0000", 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1328999999999998e-05 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969996+0000", 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1565000000000001e-05 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.992142756, 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.991381437000001, 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.987465731, 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.987302851000003, 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.985639867000003, 2023-10-08T06:59:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.985373414999998, 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.982618047999999, 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:98829 5.f e42/20 ondisk, result = 0)", 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.980307725999999, 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058552082999999998, 2023-10-08T06:59:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475503+0000", 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.475506+0000", 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9620000000000002e-06 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533884+0000", 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058377865000000001 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533895+0000", 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0543000000000001e-05 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1206999999999999e-05 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533963+0000", 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3309999999999998e-06 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534055+0000", 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1503999999999997e-05 2023-10-08T06:59:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:118569 5.f 5:f224d98c:::benchmark_data_smithi037_101035_object118568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.654533102999999, 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020822587, 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 118569 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801277+0000", 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801278+0000", 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801306+0000", 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7838e-05 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801312+0000", 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6959999999999999e-06 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.801316+0000", 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8870000000000002e-06 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.803970+0000", 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026534200000000001 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804095+0000", 2023-10-08T06:59:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125652 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.804244+0000", 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000148481 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.807953+0000", 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037095969999999998 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822051+0000", 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014097800000000001 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822080+0000", 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8782e-05 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:29.822100+0000", 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9986000000000001e-05 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:130528 5.9 5:9bdab2cc:::benchmark_data_smithi037_101035_object130527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.664286329999999, 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022304398999999999, 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 130528 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791524+0000", 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791525+0000", 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9800000000000003e-07 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791565+0000", 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0428e-05 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791572+0000", 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2250000000000003e-06 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.791578+0000", 2023-10-08T06:59:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796454+0000", 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048757790000000002 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796561+0000", 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107063 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.796675+0000", 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114188 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.801567+0000", 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048923070000000003 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813729+0000", 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012161896 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813787+0000", 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7896999999999998e-05 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:34.813829+0000", 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1544000000000001e-05 2023-10-08T06:59:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:00.600 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:00.601 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:00.600+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:00.602 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:00.702 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:00.701+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:00.772 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:00.772 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:00.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.773 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:202688 5.e 5:76674c7c:::benchmark_data_smithi037_101035_object58827:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T06:59:00.773 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:00.770083+0000", 2023-10-08T06:59:00.773 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002019828, 2023-10-08T06:59:00.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020435739999999998, 2023-10-08T06:59:00.774 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:00.774 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:00.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:00.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:00.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:00.777 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 202688 2023-10-08T06:59:00.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.778 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:00.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:00.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770083+0000", 2023-10-08T06:59:00.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:00.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770083+0000", 2023-10-08T06:59:00.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:00.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770084+0000", 2023-10-08T06:59:00.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0999999999999997e-07 2023-10-08T06:59:00.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:00.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770088+0000", 2023-10-08T06:59:00.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6210000000000003e-06 2023-10-08T06:59:00.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:00.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770103+0000", 2023-10-08T06:59:00.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4756999999999999e-05 2023-10-08T06:59:00.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770113+0000", 2023-10-08T06:59:00.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0268999999999999e-05 2023-10-08T06:59:00.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:00.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770169+0000", 2023-10-08T06:59:00.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.613e-05 2023-10-08T06:59:00.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:00.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770306+0000", 2023-10-08T06:59:00.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136358 2023-10-08T06:59:00.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.785 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:00.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.786 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:202684 5.9 e55/20 5:90c246d8:::benchmark_data_smithi037_101035_object58823:head v 55'12613, mlcod=55'12609)", 2023-10-08T06:59:00.786 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:00.770856+0000", 2023-10-08T06:59:00.786 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001246785, 2023-10-08T06:59:00.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013164959999999999, 2023-10-08T06:59:00.787 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:00.787 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:00.787 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:00.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:00.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770856+0000", 2023-10-08T06:59:00.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:00.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770856+0000", 2023-10-08T06:59:00.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:00.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770856+0000", 2023-10-08T06:59:00.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5199999999999996e-07 2023-10-08T06:59:00.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:00.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770861+0000", 2023-10-08T06:59:00.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9509999999999997e-06 2023-10-08T06:59:00.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:00.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770878+0000", 2023-10-08T06:59:00.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6728e-05 2023-10-08T06:59:00.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770885+0000", 2023-10-08T06:59:00.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.311e-06 2023-10-08T06:59:00.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:00.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770933+0000", 2023-10-08T06:59:00.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7666000000000001e-05 2023-10-08T06:59:00.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:00.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.770952+0000", 2023-10-08T06:59:00.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.857e-05 2023-10-08T06:59:00.794 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.795 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:00.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.795 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:202681 5.9 e55/20 5:92251740:::benchmark_data_smithi037_101035_object58820:head v 55'12612, mlcod=55'12609)", 2023-10-08T06:59:00.796 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:00.769358+0000", 2023-10-08T06:59:00.796 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0027445740000000001, 2023-10-08T06:59:00.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002849931, 2023-10-08T06:59:00.796 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:00.796 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:00.796 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769358+0000", 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769358+0000", 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769358+0000", 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8599999999999998e-07 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769366+0000", 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.294e-06 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769378+0000", 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1943999999999999e-05 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769386+0000", 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3659999999999992e-06 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:00.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769464+0000", 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8145999999999993e-05 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769484+0000", 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9817999999999999e-05 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.800 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:202682 5.f e55/20 5:f7377bbe:::benchmark_data_smithi037_101035_object58821:head v 55'12884, mlcod=55'12882)", 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:00.769433+0000", 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002669514, 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028102320000000002, 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769433+0000", 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769433+0000", 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769433+0000", 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3599999999999999e-07 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769437+0000", 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8630000000000001e-06 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769447+0000", 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.431e-06 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769452+0000", 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4060000000000004e-06 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769494+0000", 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2342000000000002e-05 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:00.769511+0000", 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6685999999999999e-05 2023-10-08T06:59:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 4 2023-10-08T06:59:00.805 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:00.806 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:00.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:00.805+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:00.907 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:00.906+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:01.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:01.008+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:01.017 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:01.017 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:01.018 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:01.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:01.018 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:01.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:01.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:01.109+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:01.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:01.209+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:01.251 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:01.251 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.384684551999996, 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:01.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:01.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:01.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.381976332999997, 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.259 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:01.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:01.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:01.265 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.378984043000003, 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:01.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:01.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.270 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.363943181000003, 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:01.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.276 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.363840324000002, 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:01.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:01.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.282 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.363777030999998, 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.283 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:01.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.363503753000003, 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.289 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:01.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.360513709999999, 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.295 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:01.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.300 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.359162781999999, 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:01.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:01.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:01.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.359024019000003, 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:01.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.358645555000003, 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:01.312 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:01.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:01.317 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.356484021, 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:01.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:01.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:01.322 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.348145138, 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:01.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:01.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:01.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.584716319999998, 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:01.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.584171658999999, 2023-10-08T06:59:01.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:01.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:01.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.584083399999997, 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.340 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:01.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:01.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.584048973999998, 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:01.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:01.350 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.582954397999998, 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:01.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:01.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.582430565000003, 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:01.357 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:01.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.581472343000002, 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:01.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:01.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:01.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:01.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:01.368 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:01.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:01.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:01.368+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:01.370 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:01.471 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:01.470+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:01.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:59:01.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:01.545 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:01.546 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:01.546 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:01.546 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:01.549 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:01.549 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:01.561 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:01.561 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:01.570 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:01.569+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:01.575 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:01.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:01.670+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:01.764 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:01.764 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:01.772 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:01.771+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:01.779 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:01.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:01.872+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:01.974 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:01.972+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:02.002 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:02.002 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:02.015 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:02.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:02.073+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:02.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:02.174+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:02.192 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:02.192 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:02.206 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:02.276 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:02.276+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:02.377 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:02.376+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:02.378 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:02.378 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:02.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:02.479 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:02.478+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:02.490 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:59:02.579 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:02.578+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:02.609 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:02.609 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:02.623 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:02.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:02.679+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:02.781 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:02.780+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:02.805 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:02.805 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:02.818 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:02.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:02.901+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:02.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:02.982+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.039 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:03.039 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:03.053 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:03.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.094+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.185 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:03.184+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:03.280 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:03.280 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:03.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.286+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.296 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:03.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.386+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.472 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:03.472 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:03.486 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:03.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.487+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:03.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.588+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2023-10-08T06:59:03.658 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:03.658 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:03.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:03.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.690+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.702 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:03.723 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:03.724 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:03.724 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:03.724 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:03.727 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:03.727 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:03.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.790+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:03.845 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:03.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.978554701999997, 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.846 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:03.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:03.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.852 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.975846482999998, 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:03.853 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:03.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.972854193000003, 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.861 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:03.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.957813330999997, 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:03.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:03.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:03.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:03.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.957710474000002, 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:03.873 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:03.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:03.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.957647180999999, 2023-10-08T06:59:03.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:03.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:03.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.957373902999997, 2023-10-08T06:59:03.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:03.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:03.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.891 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.95438386, 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.953032931999999, 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:03.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:03.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:03.903 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.952894168999997, 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:03.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.952515705000003, 2023-10-08T06:59:03.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:03.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:03.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.950354171000001, 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:03.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:03.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:03.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.942015288, 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:03.921 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:03.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:03.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.927 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.178586469999999, 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:03.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.933 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.178041809, 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:03.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:03.940 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.177953549999998, 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.941 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:03.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.177919123999999, 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:03.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.952 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.176824547999999, 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.953 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.176300714999996, 2023-10-08T06:59:03.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:03.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:03.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.965 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.175342493000002, 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:03.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:03.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:03.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:03.971 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:03.973 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:04.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:03.971+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:04.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:04.072+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:04.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:04.173+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:04.194 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:04.194 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:04.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.194 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211869 5.5 5:a3384600:::benchmark_data_smithi037_101035_object68008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.194 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:04.188444+0000", 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0049343859999999998, 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049625579999999997, 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211869 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188444+0000", 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188444+0000", 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188445+0000", 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.47e-07 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188449+0000", 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0929999999999996e-06 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188458+0000", 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7399999999999999e-06 2023-10-08T06:59:04.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188465+0000", 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0950000000000001e-06 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188509+0000", 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4746999999999997e-05 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188673+0000", 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000163769 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211870 5.7 5:ee5a9b24:::benchmark_data_smithi037_101035_object68009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:04.188478+0000", 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0048998169999999999, 2023-10-08T06:59:04.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050092239999999996, 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211870 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188478+0000", 2023-10-08T06:59:04.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188478+0000", 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188479+0000", 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4700000000000002e-07 2023-10-08T06:59:04.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188481+0000", 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.543e-06 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188487+0000", 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5759999999999996e-06 2023-10-08T06:59:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188490+0000", 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.534e-06 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188532+0000", 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1513e-05 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.188671+0000", 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013927699999999999 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.193498+0000", 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004826431 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211874 5.1 5:8d6d5d26:::benchmark_data_smithi037_101035_object68013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:04.190908+0000", 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0024696639999999999, 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002665368, 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.205 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211874 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190908+0000", 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190908+0000", 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190909+0000", 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1900000000000002e-07 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190913+0000", 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.625e-06 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190921+0000", 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2640000000000008e-06 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190926+0000", 2023-10-08T06:59:04.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4269999999999999e-06 2023-10-08T06:59:04.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190976+0000", 2023-10-08T06:59:04.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9672999999999997e-05 2023-10-08T06:59:04.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191089+0000", 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113367 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211875 5.1 5:8e231c2a:::benchmark_data_smithi037_101035_object68014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.210 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:04.190960+0000", 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0024183299999999998, 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0026896960000000001, 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211875 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190960+0000", 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190960+0000", 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190961+0000", 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190964+0000", 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190977+0000", 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3040999999999999e-05 2023-10-08T06:59:04.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.190985+0000", 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3259999999999996e-06 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192616+0000", 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016313 2023-10-08T06:59:04.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192701+0000", 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4222999999999996e-05 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211877 5.3 5:cc8fcc69:::benchmark_data_smithi037_101035_object68016:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:04.191507+0000", 2023-10-08T06:59:04.215 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0018712830000000001, 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0022193270000000001, 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211877 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.216 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191507+0000", 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191507+0000", 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191508+0000", 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2099999999999995e-07 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191512+0000", 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0849999999999999e-06 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191525+0000", 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3216e-05 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191532+0000", 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4610000000000002e-06 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191568+0000", 2023-10-08T06:59:04.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5960000000000001e-05 2023-10-08T06:59:04.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.191661+0000", 2023-10-08T06:59:04.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2464000000000001e-05 2023-10-08T06:59:04.220 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.221 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.221 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211880 5.5 5:abadce5d:::benchmark_data_smithi037_101035_object68019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.221 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:04.192887+0000", 2023-10-08T06:59:04.221 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00049110199999999999, 2023-10-08T06:59:04.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00089625700000000002, 2023-10-08T06:59:04.222 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.222 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:04.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.222 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.223 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211880 2023-10-08T06:59:04.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.223 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192887+0000", 2023-10-08T06:59:04.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192887+0000", 2023-10-08T06:59:04.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192888+0000", 2023-10-08T06:59:04.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:04.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192892+0000", 2023-10-08T06:59:04.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0080000000000004e-06 2023-10-08T06:59:04.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192907+0000", 2023-10-08T06:59:04.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5345e-05 2023-10-08T06:59:04.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192914+0000", 2023-10-08T06:59:04.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3980000000000002e-06 2023-10-08T06:59:04.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192965+0000", 2023-10-08T06:59:04.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0411000000000002e-05 2023-10-08T06:59:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.193115+0000", 2023-10-08T06:59:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015009800000000001 2023-10-08T06:59:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211881 5.d 5:b48e54ae:::benchmark_data_smithi037_101035_object68020:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:04.192936+0000", 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00044201700000000001, 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090129800000000003, 2023-10-08T06:59:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211881 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192936+0000", 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192936+0000", 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192937+0000", 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.27e-07 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192939+0000", 2023-10-08T06:59:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6479999999999999e-06 2023-10-08T06:59:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192947+0000", 2023-10-08T06:59:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8320000000000006e-06 2023-10-08T06:59:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192953+0000", 2023-10-08T06:59:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8479999999999997e-06 2023-10-08T06:59:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.192999+0000", 2023-10-08T06:59:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6329000000000003e-05 2023-10-08T06:59:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.193165+0000", 2023-10-08T06:59:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000165525 2023-10-08T06:59:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.193274+0000", 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010901299999999999 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 7 2023-10-08T06:59:04.237 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:04.239 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:04.275 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:04.274+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:04.376 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:04.375+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:04.463 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:04.463 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:04.463 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:04.463 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:04.463 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:04.476 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:04.475+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:04.479 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:04.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:59:04.578 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:04.577+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:04.666 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:04.666 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:04.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:04.666 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 44.772038537, 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:04.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:04.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 44.770322235000002, 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:04.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:04.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:04.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:04.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:04.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:04.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:04.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:04.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:04.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:04.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:04.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.685 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:04.685 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:04.685 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 44.768504413999999, 2023-10-08T06:59:04.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:04.686 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.686 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.686 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:04.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.687 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:04.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:04.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:04.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:04.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:04.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:04.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:04.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:04.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:04.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:04.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:04.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:04.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:04.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:04.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:04.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:04.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:04.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:04.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:04.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:04.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:04.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:04.697 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.697 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.698 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:04.698 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:04.698 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 44.766500118000003, 2023-10-08T06:59:04.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:04.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:04.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:04.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:04.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 44.766383802, 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.705 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:04.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:04.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 44.758493854000001, 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:04.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:04.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:04.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.199137563000001, 2023-10-08T06:59:04.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:04.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:04.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:04.724 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.198376244000002, 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.725 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:04.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:04.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:04.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.194460538000001, 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:04.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:04.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.194297658000004, 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:04.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:04.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.192634673999997, 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:04.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:04.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.192368221999999, 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.750 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:04.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:04.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:04.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:04.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:04.756 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.189612855, 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:04.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:04.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.761083128, 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.763 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:04.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:04.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75872609400000002, 2023-10-08T06:59:04.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:04.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:04.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75721967400000001, 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:04.777 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:04.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75701164300000001, 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:04.783 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:04.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:04.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.789 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.756440424, 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.790 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:04.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:04.796 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75418140300000003, 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:04.797 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:04.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:04.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.75361027999999997, 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:04.804 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:04.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:04.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:04.808 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.809 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.809 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.809 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:04.809 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:04.809 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:04.810 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:04.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:04.809+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:04.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:04.910+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:04.984 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:214135 5.8 5:196412c0:::benchmark_data_smithi037_101035_object70274:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.977810+0000", 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0060819990000000003, 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061100870000000002, 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 214135 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977810+0000", 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977810+0000", 2023-10-08T06:59:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977810+0000", 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0400000000000002e-07 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977813+0000", 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3350000000000001e-06 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977820+0000", 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1879999999999996e-06 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977825+0000", 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6570000000000002e-06 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977883+0000", 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7552000000000001e-05 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977956+0000", 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2675999999999993e-05 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:214136 5.e 5:75480946:::benchmark_data_smithi037_101035_object70275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.977891+0000", 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0060006540000000002, 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060823120000000003, 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 214136 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977891+0000", 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977891+0000", 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977892+0000", 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8999999999999995e-07 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977895+0000", 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.129e-06 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977903+0000", 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8329999999999994e-06 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977909+0000", 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9989999999999997e-06 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980958+0000", 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030495079999999998 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.981039+0000", 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0529000000000001e-05 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:214132 5.f e56/20 5:fd3348e7:::benchmark_data_smithi037_101035_object70271:head v 56'13619, mlcod=56'13617)", 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.978012+0000", 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0058797379999999998, 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060004849999999998, 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978012+0000", 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978012+0000", 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978013+0000", 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8899999999999999e-07 2023-10-08T06:59:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978018+0000", 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0690000000000001e-06 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978025+0000", 2023-10-08T06:59:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9419999999999998e-06 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978031+0000", 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.835e-06 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978076+0000", 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5355000000000002e-05 2023-10-08T06:59:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.978089+0000", 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3178e-05 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:214140 5.a 5:5ceafa87:::benchmark_data_smithi037_101035_object70279:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.980430+0000", 2023-10-08T06:59:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0034614419999999999, 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003617459, 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 214140 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980430+0000", 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980430+0000", 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980431+0000", 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2200000000000003e-07 2023-10-08T06:59:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980435+0000", 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8449999999999996e-06 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980447+0000", 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1805e-05 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980452+0000", 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4829999999999999e-06 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980491+0000", 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8321000000000001e-05 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.980566+0000", 2023-10-08T06:59:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5621e-05 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:214142 5.d e56/32 5:b88723e1:::benchmark_data_smithi037_101035_object70281:head v 56'13055, mlcod=56'13053)", 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.982496+0000", 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001396361, 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001590115, 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982496+0000", 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982496+0000", 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982496+0000", 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1399999999999996e-07 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982501+0000", 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4440000000000001e-06 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982510+0000", 2023-10-08T06:59:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1060000000000006e-06 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982515+0000", 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9930000000000003e-06 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982556+0000", 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1168999999999998e-05 2023-10-08T06:59:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982573+0000", 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6991999999999999e-05 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:214143 5.f e56/20 5:f8022bc4:::benchmark_data_smithi037_101035_object70282:head v 56'13620, mlcod=56'13617)", 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.982527+0000", 2023-10-08T06:59:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001364692, 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015959780000000001, 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982527+0000", 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982527+0000", 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982528+0000", 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0699999999999998e-07 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982531+0000", 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.687e-06 2023-10-08T06:59:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982537+0000", 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.852e-06 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982542+0000", 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6419999999999998e-06 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982577+0000", 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5414999999999999e-05 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982589+0000", 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.189e-05 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:214144 5.8 5:18f8c5cd:::benchmark_data_smithi037_101035_object70283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.982940+0000", 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.000951859, 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00121799, 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 214144 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982940+0000", 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982940+0000", 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982941+0000", 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4600000000000004e-07 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982945+0000", 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0430000000000001e-06 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982957+0000", 2023-10-08T06:59:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2257e-05 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.982963+0000", 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2280000000000003e-06 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.983006+0000", 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2811000000000001e-05 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.983091+0000", 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4637999999999998e-05 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:214131 5.e 5:7152ad39:::benchmark_data_smithi037_101035_object70270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.977720+0000", 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.006172238, 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064767820000000004, 2023-10-08T06:59:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 214131 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977720+0000", 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977720+0000", 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977720+0000", 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3799999999999996e-07 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977724+0000", 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.349e-06 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977733+0000", 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9150000000000002e-06 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977738+0000", 2023-10-08T06:59:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6960000000000002e-06 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977811+0000", 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2336000000000007e-05 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977917+0000", 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106261 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:214134 5.e 5:79a944eb:::benchmark_data_smithi037_101035_object70273:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:04.977775+0000", 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0061168409999999996, 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064667259999999999, 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 214134 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977775+0000", 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977775+0000", 2023-10-08T06:59:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977776+0000", 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2900000000000004e-07 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977778+0000", 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5739999999999998e-06 2023-10-08T06:59:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977785+0000", 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9070000000000001e-06 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.977792+0000", 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2620000000000001e-06 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.979587+0000", 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017950150000000001 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:04.979672+0000", 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4624999999999997e-05 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 9 2023-10-08T06:59:05.027 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:05.028 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:05.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:05.027+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:05.129 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:05.128+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:05.199 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:05.199 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:05.199 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:05.200 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:05.200 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:05.216 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:05.258 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:05.257+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:05.331 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:05.329+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:05.431 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:05.430+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:05.435 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.568662613000001, 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:05.436 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:05.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:05.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:05.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:05.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.565954394000002, 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:05.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:05.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:05.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.562962103999993, 2023-10-08T06:59:05.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:05.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:05.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:05.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.547921242000001, 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:05.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.547818384999999, 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:05.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:05.469 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.547755092000003, 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.470 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:05.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:05.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:05.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:05.476 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.547481814000001, 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:05.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:05.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.483 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.544491770999997, 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.484 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.543140843000003, 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.543002080000001, 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.542623616, 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.540462081999998, 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.532123198999997, 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.768694381000003, 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.768149719999997, 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.768061461000002, 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.768027035000003, 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.766932459000003, 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.766408626, 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.765450403999999, 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:05.566 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:05.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:05.566+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:59:05.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:05.667 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:05.666+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:05.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:05.748 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:05.748 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:05.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216248 5.f 5:f85074a3:::benchmark_data_smithi037_101035_object72387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.741771+0000", 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0055817100000000001, 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056069220000000003, 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216248 2023-10-08T06:59:05.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741771+0000", 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741771+0000", 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741771+0000", 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5099999999999999e-07 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741775+0000", 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-06 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741783+0000", 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0539999999999995e-06 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741788+0000", 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1189999999999996e-06 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741832+0000", 2023-10-08T06:59:05.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3511999999999999e-05 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741915+0000", 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3286000000000002e-05 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.741985+0000", 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0209999999999994e-05 2023-10-08T06:59:05.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743568+0000", 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015829049999999999 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216250 5.d 5:b66b1c1a:::benchmark_data_smithi037_101035_object72389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.754 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.742283+0000", 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0050692799999999998, 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051853100000000003, 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216250 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742283+0000", 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742283+0000", 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742283+0000", 2023-10-08T06:59:05.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2399999999999999e-07 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742286+0000", 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1179999999999999e-06 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742293+0000", 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.661e-06 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742297+0000", 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1699999999999999e-06 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742341+0000", 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3937999999999998e-05 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742430+0000", 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8541999999999994e-05 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.742500+0000", 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9954000000000001e-05 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:05.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743891+0000", 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001390971 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216252 5.f 5:f7af0c23:::benchmark_data_smithi037_101035_object72391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.743852+0000", 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0035006, 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037052169999999998, 2023-10-08T06:59:05.760 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216252 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743852+0000", 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743852+0000", 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743853+0000", 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6899999999999996e-07 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743857+0000", 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5499999999999996e-06 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743871+0000", 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3568e-05 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743880+0000", 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0589999999999992e-06 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.743927+0000", 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7298e-05 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.744017+0000", 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9763000000000001e-05 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.744087+0000", 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0166999999999994e-05 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746809+0000", 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027220080000000002 2023-10-08T06:59:05.765 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216253 5.7 5:e9041348:::benchmark_data_smithi037_101035_object72392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.745065+0000", 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0022868839999999999, 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025868499999999999, 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:05.766 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216253 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745065+0000", 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745065+0000", 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745066+0000", 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.85e-07 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745070+0000", 2023-10-08T06:59:05.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5829999999999998e-06 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745084+0000", 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3719e-05 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745093+0000", 2023-10-08T06:59:05.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7920000000000004e-06 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745134+0000", 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0436999999999999e-05 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745237+0000", 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103507 2023-10-08T06:59:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216255 5.9 5:9ba69a84:::benchmark_data_smithi037_101035_object72394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.745109+0000", 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002243732, 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025929909999999998, 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:05.771 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216255 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745109+0000", 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745109+0000", 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745109+0000", 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0100000000000005e-07 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745112+0000", 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6690000000000002e-06 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745120+0000", 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6299999999999998e-06 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745127+0000", 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0049999999999998e-06 2023-10-08T06:59:05.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745179+0000", 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2018999999999998e-05 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745305+0000", 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012644199999999999 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745425+0000", 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120384 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216256 5.f 5:fb49f5a7:::benchmark_data_smithi037_101035_object72395:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.745148+0000", 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0022045509999999999, 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025959749999999999, 2023-10-08T06:59:05.776 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216256 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745148+0000", 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745148+0000", 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745149+0000", 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745152+0000", 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0359999999999998e-06 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745160+0000", 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2090000000000005e-06 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745166+0000", 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6050000000000003e-06 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745208+0000", 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1158999999999997e-05 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745279+0000", 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1567000000000001e-05 2023-10-08T06:59:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745368+0000", 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8904000000000001e-05 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216258 5.6 5:6bd53b22:::benchmark_data_smithi037_101035_object72397:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.745708+0000", 2023-10-08T06:59:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001644171, 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002112226, 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216258 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745708+0000", 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745708+0000", 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745709+0000", 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.066e-06 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745714+0000", 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.651e-06 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745726+0000", 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.261e-05 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745736+0000", 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3249999999999997e-06 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745798+0000", 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2668000000000004e-05 2023-10-08T06:59:05.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.745950+0000", 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015121700000000001 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:216259 5.d 5:bc4685b4:::benchmark_data_smithi037_101035_object72398:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:05.746647+0000", 2023-10-08T06:59:05.786 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00070531399999999996, 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012533150000000001, 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 216259 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:05.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746647+0000", 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746647+0000", 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746648+0000", 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0100000000000005e-07 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746651+0000", 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4939999999999999e-06 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:05.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746660+0000", 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6489999999999997e-06 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746665+0000", 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999996e-06 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:05.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746703+0000", 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7904000000000002e-05 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746781+0000", 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8335000000000001e-05 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:05.746848+0000", 2023-10-08T06:59:05.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6957000000000003e-05 2023-10-08T06:59:05.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.792 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:05.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:05.792 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:05.792 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 8 2023-10-08T06:59:05.792 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:05.794 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:05.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:05.792+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:05.879 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:05.894 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:05.894+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:05.900 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:05.903 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:05.904 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:05.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:05.994+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:06.012 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:06.026 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:06.096 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:06.095+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:06.197 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:06.196+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:06.244 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:06.244 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:06.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:06.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:06.297+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:06.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:06.398+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:06.434 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:06.434 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:06.448 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:06.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:06.499+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:06.601 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:06.600+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:06.614 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:06.614 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:06.630 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:06.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:06.700+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:06.802 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:06.801+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:06.842 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:06.843 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:06.857 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:06.903 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:06.902+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.004 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.003+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.039 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:07.039 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:07.052 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:07.105 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.104+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.206 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.205+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.235 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:07.235 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:07.250 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:07.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:07.306+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:07.407 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.407+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.440 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:07.440 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:07.455 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:07.508 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.507+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:59:07.609 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.608+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.620 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:07.620 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:07.635 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:07.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:07.709+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:07.812 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.811+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:07.847 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:07.847 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:07.861 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:07.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:07.945 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:07.944+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:08.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:08.012+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:08.059 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:08.078 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:08.078 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:08.081 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:08.085 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:08.085 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:08.095 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:08.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:08.138+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:08.215 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:08.214+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:08.276 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:08.276 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223196 5.f 5:f962abcb:::benchmark_data_smithi037_101035_object79335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.267668+0000", 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0074333000000000003, 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0074618439999999996, 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223196 2023-10-08T06:59:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267668+0000", 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267668+0000", 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267669+0000", 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.327e-06 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267680+0000", 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0703999999999999e-05 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267691+0000", 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1484000000000001e-05 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267698+0000", 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4200000000000004e-06 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267820+0000", 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012225199999999999 2023-10-08T06:59:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.267971+0000", 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000151583 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.268103+0000", 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131722 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270883+0000", 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002779419 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275095+0000", 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004212609 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223201 5.7 5:e77aca34:::benchmark_data_smithi037_101035_object79340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.270189+0000", 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0049120259999999999, 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005046521, 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223201 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270189+0000", 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270189+0000", 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270190+0000", 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270192+0000", 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7819999999999998e-06 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270200+0000", 2023-10-08T06:59:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5789999999999998e-06 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270206+0000", 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0360000000000003e-06 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270277+0000", 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1118999999999995e-05 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.270396+0000", 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118606 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223202 5.2 5:4d6817a7:::benchmark_data_smithi037_101035_object79341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272254+0000", 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00284732, 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030569619999999999, 2023-10-08T06:59:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223202 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272254+0000", 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272254+0000", 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272255+0000", 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4e-07 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272259+0000", 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5229999999999997e-06 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272269+0000", 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9159999999999996e-06 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272277+0000", 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7419999999999997e-06 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272321+0000", 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4323999999999998e-05 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272452+0000", 2023-10-08T06:59:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013144900000000001 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223204 5.c 5:3220ed2f:::benchmark_data_smithi037_101035_object79343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272691+0000", 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002410428, 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027064480000000002, 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223204 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272691+0000", 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272691+0000", 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272692+0000", 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4099999999999997e-07 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272696+0000", 2023-10-08T06:59:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.369e-06 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272708+0000", 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2459e-05 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272717+0000", 2023-10-08T06:59:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4910000000000005e-06 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272772+0000", 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5483999999999999e-05 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272896+0000", 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012413600000000001 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223205 5.c 5:33b4040d:::benchmark_data_smithi037_101035_object79344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272737+0000", 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0023643430000000001, 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002732885, 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223205 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272737+0000", 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272737+0000", 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272737+0000", 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272740+0000", 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.072e-06 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272749+0000", 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8699999999999998e-06 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272763+0000", 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3485999999999999e-05 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.274716+0000", 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019530890000000001 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.274976+0000", 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000260466 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223206 5.2 5:4f0330fe:::benchmark_data_smithi037_101035_object79345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272774+0000", 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0023268189999999999, 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027619770000000001, 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223206 2023-10-08T06:59:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272774+0000", 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272774+0000", 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272775+0000", 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9399999999999995e-07 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272777+0000", 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4609999999999998e-06 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272784+0000", 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1829999999999997e-06 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272791+0000", 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2023-10-08T06:59:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.274478+0000", 2023-10-08T06:59:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016868600000000001 2023-10-08T06:59:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.274603+0000", 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000124905 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223207 5.f 5:f37e37be:::benchmark_data_smithi037_101035_object79346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272802+0000", 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00229948, 2023-10-08T06:59:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028062180000000001, 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223207 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272802+0000", 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272802+0000", 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272802+0000", 2023-10-08T06:59:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3099999999999998e-07 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272805+0000", 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.486e-06 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272811+0000", 2023-10-08T06:59:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.601e-06 2023-10-08T06:59:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272816+0000", 2023-10-08T06:59:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2830000000000001e-06 2023-10-08T06:59:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272856+0000", 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9266e-05 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272965+0000", 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109615 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.273074+0000", 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109023 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275294+0000", 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0022196490000000002 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223208 5.2 5.ae82cfc2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272826+0000", 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002274777, 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028597340000000001, 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223208 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272826+0000", 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272826+0000", 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272827+0000", 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5200000000000002e-07 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272833+0000", 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5819999999999998e-06 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272840+0000", 2023-10-08T06:59:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.17e-06 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272846+0000", 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6729999999999997e-06 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223209 5.3 5:c74507fd:::benchmark_data_smithi037_101035_object79348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272854+0000", 2023-10-08T06:59:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0022467699999999999, 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028878520000000002, 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223209 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272854+0000", 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272854+0000", 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272855+0000", 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6899999999999998e-07 2023-10-08T06:59:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272857+0000", 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.317e-06 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272865+0000", 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6599999999999995e-06 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272871+0000", 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0680000000000002e-06 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272998+0000", 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012752999999999999 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.273131+0000", 2023-10-08T06:59:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132507 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223210 5.7 5:ecc6f1e2:::benchmark_data_smithi037_101035_object79349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272883+0000", 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0022179560000000001, 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029247689999999998, 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223210 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272883+0000", 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272883+0000", 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272884+0000", 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272886+0000", 2023-10-08T06:59:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.419e-06 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272893+0000", 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3499999999999999e-06 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272899+0000", 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4890000000000003e-06 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275025+0000", 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002126317 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275156+0000", 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131259 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223211 5.1 5:844605af:::benchmark_data_smithi037_101035_object79350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272907+0000", 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002194367, 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002966645, 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223211 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272907+0000", 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272907+0000", 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272907+0000", 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1100000000000001e-07 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272909+0000", 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1919999999999999e-06 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272916+0000", 2023-10-08T06:59:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5169999999999996e-06 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272921+0000", 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9119999999999997e-06 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272960+0000", 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9122000000000003e-05 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.273079+0000", 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119578 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:223213 5.3 5:cb86d6b7:::benchmark_data_smithi037_101035_object79352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.272935+0000", 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002165817, 2023-10-08T06:59:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030041569999999999, 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 223213 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272935+0000", 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272935+0000", 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272936+0000", 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272938+0000", 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3329999999999999e-06 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272945+0000", 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0260000000000002e-06 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.272953+0000", 2023-10-08T06:59:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275145+0000", 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021915609999999999 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275240+0000", 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5115e-05 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:223207 5.f e57/20 ondisk, result = 0)", 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:08.275134+0000", 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9999666, 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00086951699999999999, 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275134+0000", 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275134+0000", 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275135+0000", 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2399999999999996e-07 2023-10-08T06:59:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275140+0000", 2023-10-08T06:59:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9660000000000004e-06 2023-10-08T06:59:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275150+0000", 2023-10-08T06:59:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0091e-05 2023-10-08T06:59:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275157+0000", 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9630000000000001e-06 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275282+0000", 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000124337 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:08.275289+0000", 2023-10-08T06:59:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2080000000000003e-06 2023-10-08T06:59:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 13 2023-10-08T06:59:08.343 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:08.344 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:08.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:08.343+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:08.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:08.444+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:59:08.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:08.545+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:08.574 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:08.574 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:08.587 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:08.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:08.671+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:08.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:08.747+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:08.815 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.920947556000002, 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.919231254000003, 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.917413433, 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.915409136999997, 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.915292821000001, 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.907402873000002, 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.348046582000002, 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.347285263000003, 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.343369557000003, 2023-10-08T06:59:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.343206676999998, 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:08.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:08.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:08.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.886 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.341543692999998, 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.341277241, 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.893 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:08.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:08.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:08.898 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.338521874000001, 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.899 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:08.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:08.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:08.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9099921469999996, 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:08.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9076351129999995, 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:08.913 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:08.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.920 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9061286930000003, 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.921 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:08.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:08.926 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9059206619999998, 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.927 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:08.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:08.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:08.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:08.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.933 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9053494430000004, 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.934 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:08.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:08.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.940 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.903090422, 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:08.941 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:08.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:08.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9025192989999997, 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:08.948 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:08.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:08.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.952 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.953 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.953 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:08.953 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:08.953 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:08.954 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:08.953+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:08.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:09.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:09.054+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:09.127 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:225570 5.e 5:765b629b:::benchmark_data_smithi037_101035_object81709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:09.121567+0000", 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0052766080000000003, 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052951769999999999, 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 225570 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121567+0000", 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121567+0000", 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121567+0000", 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0400000000000005e-07 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121571+0000", 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121585+0000", 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3457e-05 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121595+0000", 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9809999999999998e-06 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121651+0000", 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6669000000000002e-05 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.121784+0000", 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000132676 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:225572 5.a 5:5af118fa:::benchmark_data_smithi037_101035_object81711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:09.123675+0000", 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.003167792, 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229881, 2023-10-08T06:59:09.133 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 225572 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123675+0000", 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123675+0000", 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123676+0000", 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999998e-07 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123683+0000", 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.029e-06 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123699+0000", 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5718000000000001e-05 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123708+0000", 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4739999999999994e-06 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123771+0000", 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2508000000000005e-05 2023-10-08T06:59:09.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123905+0000", 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013423800000000001 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.138 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:225573 5.8 5:185e36de:::benchmark_data_smithi037_101035_object81712:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:09.123730+0000", 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.003112732, 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003211598, 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 225573 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123730+0000", 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123730+0000", 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123731+0000", 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7000000000000005e-07 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123734+0000", 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8729999999999999e-06 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123742+0000", 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9270000000000005e-06 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123748+0000", 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2339999999999999e-06 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123793+0000", 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4879000000000002e-05 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.123887+0000", 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3802999999999996e-05 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:225571 5.f e58/20 5:f8fc26b2:::benchmark_data_smithi037_101035_object81710:head v 58'14311, mlcod=58'14307)", 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:09.124074+0000", 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0027688600000000002, 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002903447, 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124074+0000", 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124074+0000", 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124075+0000", 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2023-10-08T06:59:09.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124083+0000", 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.537e-06 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124093+0000", 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0222e-05 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124100+0000", 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.08e-06 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124143+0000", 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3012000000000001e-05 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:09.124156+0000", 2023-10-08T06:59:09.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3236e-05 2023-10-08T06:59:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 4 2023-10-08T06:59:09.148 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:09.149 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:09.193 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:09.192+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:09.256 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:09.255+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:09.321 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:09.321 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:09.334 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:09.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:09.356+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:09.458 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:09.458+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:09.555 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:09.555 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:09.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:09.555 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.688048452999993, 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.556 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:09.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:09.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:09.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:09.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:09.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:09.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:09.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:09.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:09.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:09.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:09.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:09.565 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.685340233999995, 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:09.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:09.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:09.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:09.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.574 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.682347944, 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:09.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:09.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.580 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.667307082000001, 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.581 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:09.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.586 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.667204224999999, 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:09.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:09.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.592 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.667140932000002, 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:09.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.598 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.666867654000001, 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:09.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:09.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.604 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.663877610999997, 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:09.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:09.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.610 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.662526683000003, 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:09.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:09.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.66238792, 2023-10-08T06:59:09.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:09.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.662009456, 2023-10-08T06:59:09.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:09.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:09.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:09.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.659847921999997, 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:09.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:09.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:09.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.651509038999997, 2023-10-08T06:59:09.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:09.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:09.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:09.639 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.888080221000003, 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:09.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.645 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.887535560000003, 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.646 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:09.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.887447301000002, 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:09.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:09.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:09.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:09.657 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.887412875000003, 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:09.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:09.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.886318299000003, 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.663 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:09.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:09.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.668 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.885794466, 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:09.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:09.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:09.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:09.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.884836243999999, 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:09.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:09.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:09.679 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.680 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:09.680 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:09.680 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:09.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2023-10-08T06:59:09.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:09.680+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:09.682 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:09.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:09.782+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:09.870 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:09.870 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:09.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.870 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227582 5.9 5:9d136c08:::benchmark_data_smithi037_101035_object83721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.870 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.863020+0000", 2023-10-08T06:59:09.870 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0057913310000000003, 2023-10-08T06:59:09.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005810946, 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227582 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863020+0000", 2023-10-08T06:59:09.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863020+0000", 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863021+0000", 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9999999999999997e-07 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863024+0000", 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.191e-06 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863032+0000", 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9379999999999992e-06 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863038+0000", 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0580000000000003e-06 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863094+0000", 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5850000000000002e-05 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863222+0000", 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012863999999999999 2023-10-08T06:59:09.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:09.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863330+0000", 2023-10-08T06:59:09.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107497 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.864993+0000", 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016634460000000001 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227584 5.5 5:a9df217e:::benchmark_data_smithi037_101035_object83723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.876 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.863232+0000", 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0055790750000000002, 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056540870000000003, 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227584 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863232+0000", 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863232+0000", 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863233+0000", 2023-10-08T06:59:09.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863237+0000", 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.968e-06 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863248+0000", 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0679999999999999e-05 2023-10-08T06:59:09.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863254+0000", 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.754e-06 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863319+0000", 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4122999999999996e-05 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863463+0000", 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000144432 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227586 5.c 5:355de885:::benchmark_data_smithi037_101035_object83725:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.863844+0000", 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0049668999999999998, 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050829919999999997, 2023-10-08T06:59:09.881 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227586 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863844+0000", 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863844+0000", 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863845+0000", 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1900000000000001e-07 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863849+0000", 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.822e-06 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863860+0000", 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0727000000000001e-05 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863866+0000", 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.516e-06 2023-10-08T06:59:09.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.863918+0000", 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1496000000000003e-05 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.864050+0000", 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013238599999999999 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227587 5.c 5:3daf1568:::benchmark_data_smithi037_101035_object83726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.865050+0000", 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0037609449999999999, 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039196539999999998, 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227587 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865050+0000", 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865050+0000", 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865051+0000", 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7800000000000001e-07 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865054+0000", 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1939999999999998e-06 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865063+0000", 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9190000000000005e-06 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865068+0000", 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.259e-06 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865683+0000", 2023-10-08T06:59:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061505299999999995 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865833+0000", 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014972799999999999 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.890 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227588 5.3 5:c2c2e15c:::benchmark_data_smithi037_101035_object83727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.865167+0000", 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0036445079999999999, 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038514349999999998, 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227588 2023-10-08T06:59:09.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865167+0000", 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865167+0000", 2023-10-08T06:59:09.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865167+0000", 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2199999999999999e-07 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865169+0000", 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1569999999999998e-06 2023-10-08T06:59:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865176+0000", 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9689999999999997e-06 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865180+0000", 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7610000000000001e-06 2023-10-08T06:59:09.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865212+0000", 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1599e-05 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865294+0000", 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2723000000000001e-05 2023-10-08T06:59:09.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227590 5.c 5:38fd8701:::benchmark_data_smithi037_101035_object83729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.865378+0000", 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0034330350000000001, 2023-10-08T06:59:09.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036810609999999998, 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227590 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865378+0000", 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865378+0000", 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865379+0000", 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4999999999999998e-07 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865381+0000", 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0099999999999998e-06 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865386+0000", 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3149999999999999e-06 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.865389+0000", 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2880000000000001e-06 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867354+0000", 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019647779999999999 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867489+0000", 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013478700000000001 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227592 5.9 5:97365b62:::benchmark_data_smithi037_101035_object83731:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.866184+0000", 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0026269010000000001, 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002916096, 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227592 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866184+0000", 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866184+0000", 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866185+0000", 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1500000000000004e-07 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866189+0000", 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4630000000000001e-06 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866196+0000", 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5870000000000004e-06 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866201+0000", 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0259999999999998e-06 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866243+0000", 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.172e-05 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866340+0000", 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7233999999999998e-05 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866411+0000", 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0434999999999999e-05 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.868157+0000", 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017467819999999999 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227593 5.6 5:6d12b78d:::benchmark_data_smithi037_101035_object83732:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.866214+0000", 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0025977090000000001, 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029390620000000001, 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227593 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866214+0000", 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866214+0000", 2023-10-08T06:59:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866214+0000", 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866216+0000", 2023-10-08T06:59:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1900000000000002e-06 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866223+0000", 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3000000000000004e-06 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866229+0000", 2023-10-08T06:59:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.665e-06 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866285+0000", 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6294e-05 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.866429+0000", 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014339800000000001 2023-10-08T06:59:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227595 5.2 5:4595ff39:::benchmark_data_smithi037_101035_object83734:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.867554+0000", 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001257626, 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016380800000000001, 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227595 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867554+0000", 2023-10-08T06:59:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867554+0000", 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867555+0000", 2023-10-08T06:59:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2600000000000001e-07 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867558+0000", 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9330000000000003e-06 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867567+0000", 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7779999999999996e-06 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867574+0000", 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0759999999999997e-06 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867622+0000", 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7500999999999998e-05 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867736+0000", 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114388 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227596 5.c 5:34807108:::benchmark_data_smithi037_101035_object83735:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.867592+0000", 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00121918, 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016389810000000001, 2023-10-08T06:59:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227596 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867592+0000", 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867592+0000", 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867593+0000", 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4000000000000002e-07 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867595+0000", 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2199999999999999e-06 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867601+0000", 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2920000000000001e-06 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867606+0000", 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0690000000000001e-06 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.868958+0000", 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0013523210000000001 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.869042+0000", 2023-10-08T06:59:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3389999999999999e-05 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227597 5.1 5:842fdc73:::benchmark_data_smithi037_101035_object83736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.867616+0000", 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001195619, 2023-10-08T06:59:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001653666, 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227597 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867616+0000", 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867616+0000", 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867616+0000", 2023-10-08T06:59:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2899999999999999e-07 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867618+0000", 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8029999999999999e-06 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867624+0000", 2023-10-08T06:59:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0639999999999999e-06 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867629+0000", 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7210000000000002e-06 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867662+0000", 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3739999999999999e-05 2023-10-08T06:59:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867772+0000", 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109409 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227598 5.5 5:ad2c8b5c:::benchmark_data_smithi037_101035_object83737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.867637+0000", 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0011739700000000001, 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016701419999999999, 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227598 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867637+0000", 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867637+0000", 2023-10-08T06:59:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867638+0000", 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1600000000000002e-07 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867640+0000", 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4499999999999998e-06 2023-10-08T06:59:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867646+0000", 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8510000000000004e-06 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867651+0000", 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6580000000000001e-06 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867696+0000", 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799000000000003e-05 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.867821+0000", 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012540899999999999 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:227577 5.c 5:3fa569a8:::benchmark_data_smithi037_101035_object83716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:09.861331+0000", 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0074801329999999999, 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080320029999999994, 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 227577 2023-10-08T06:59:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861331+0000", 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861331+0000", 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861332+0000", 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5700000000000002e-07 2023-10-08T06:59:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861341+0000", 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7490000000000004e-06 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861349+0000", 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7010000000000002e-06 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861355+0000", 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2029999999999997e-06 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861409+0000", 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3913999999999999e-05 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:09.861532+0000", 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012237200000000001 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 13 2023-10-08T06:59:09.940 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:09.942 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:09.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:09.941+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:10.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:10.041+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:10.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:10.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:10.141+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:10.166 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:10.167 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:10.183 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:10.239 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:10.243 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:10.242+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:10.259 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:10.260 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:10.260 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:10.260 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:10.262 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:10.263 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:10.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:10.344+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:10.406 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:10.406 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:10.420 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:10.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:10.461+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:10.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:59:10.546 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:10.545+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:10.592 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:10.593 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:10.607 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:10.648 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:10.647+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:10.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:10.747+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:10.821 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:10.822 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:10.836 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:10.881 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:10.880+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:10.950 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:10.949+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:11.008 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:11.009 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:11.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:11.063 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:11.062+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:11.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:11.151+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:11.205 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:11.206 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:11.222 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:11.253 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:11.252+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:11.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:11.353+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:11.438 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:11.439 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:11.453 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:11.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:11.494+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:11.514 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:59:11.555 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:11.555+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:11.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:11.655+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:11.678 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:11.678 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:11.694 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:11.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:11.757+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:11.858 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:11.858+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:11.866 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:11.867 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:11.880 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:11.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:11.958+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:12.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:12.059+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:12.089 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:12.089 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:12.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:12.162 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:12.161+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:12.263 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:12.262+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:12.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:12.277 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:12.277 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:12.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:12.364 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:12.363+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:12.416 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:12.437 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:12.440 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:12.441 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:12.465 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:12.464+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:12.476 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:234658 5.9 5:97faca80:::benchmark_data_smithi037_101035_object90797:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:12.472017+0000", 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0043271389999999998, 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043557279999999997, 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:12.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 234658 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472017+0000", 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472017+0000", 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472017+0000", 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9299999999999997e-07 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472021+0000", 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.766e-06 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472030+0000", 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3379999999999994e-06 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472036+0000", 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6840000000000001e-06 2023-10-08T06:59:12.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472084+0000", 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7518000000000001e-05 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472182+0000", 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8034000000000004e-05 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472254+0000", 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2504999999999998e-05 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475177+0000", 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002922334 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:234660 5.1 5:81bed2e1:::benchmark_data_smithi037_101035_object90799:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:12.472056+0000", 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.004287473, 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00438676, 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 234660 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.483 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472056+0000", 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472056+0000", 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472057+0000", 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472060+0000", 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.79e-06 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472070+0000", 2023-10-08T06:59:12.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.028e-05 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472081+0000", 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0903e-05 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472130+0000", 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9496999999999997e-05 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472275+0000", 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000145224 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:234661 5.7 5:e29ee141:::benchmark_data_smithi037_101035_object90800:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:12.472094+0000", 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0042496110000000004, 2023-10-08T06:59:12.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043993970000000002, 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 234661 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472094+0000", 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472094+0000", 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472095+0000", 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9999999999999998e-07 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472097+0000", 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.497e-06 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472103+0000", 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0270000000000001e-06 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472109+0000", 2023-10-08T06:59:12.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.677e-06 2023-10-08T06:59:12.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472151+0000", 2023-10-08T06:59:12.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1727999999999998e-05 2023-10-08T06:59:12.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.472234+0000", 2023-10-08T06:59:12.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3725000000000002e-05 2023-10-08T06:59:12.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.493 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.493 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:234662 5.6 5:6922eea1:::benchmark_data_smithi037_101035_object90801:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:12.494 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:12.474949+0000", 2023-10-08T06:59:12.494 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.001395201, 2023-10-08T06:59:12.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015841970000000001, 2023-10-08T06:59:12.494 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.494 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:12.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.495 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.495 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 234662 2023-10-08T06:59:12.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.495 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474949+0000", 2023-10-08T06:59:12.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474949+0000", 2023-10-08T06:59:12.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474949+0000", 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2699999999999999e-07 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474953+0000", 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4489999999999999e-06 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474962+0000", 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8490000000000001e-06 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474969+0000", 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4320000000000004e-06 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475029+0000", 2023-10-08T06:59:12.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0096999999999997e-05 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475164+0000", 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013477699999999999 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:234664 5.1 5:87640b41:::benchmark_data_smithi037_101035_object90803:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:12.474983+0000", 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0013606320000000001, 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015889840000000001, 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:12.501 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.502 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 234664 2023-10-08T06:59:12.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.502 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474983+0000", 2023-10-08T06:59:12.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474983+0000", 2023-10-08T06:59:12.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474983+0000", 2023-10-08T06:59:12.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2000000000000001e-07 2023-10-08T06:59:12.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474985+0000", 2023-10-08T06:59:12.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.702e-06 2023-10-08T06:59:12.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474990+0000", 2023-10-08T06:59:12.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4390000000000002e-06 2023-10-08T06:59:12.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.474993+0000", 2023-10-08T06:59:12.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2550000000000002e-06 2023-10-08T06:59:12.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475052+0000", 2023-10-08T06:59:12.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8928999999999998e-05 2023-10-08T06:59:12.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475141+0000", 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9480000000000004e-05 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:234668 5.f 5:f0f2aba2:::benchmark_data_smithi037_101035_object90807:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:12.509 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:12.475197+0000", 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0011468380000000001, 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014131700000000001, 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 234668 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475197+0000", 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475197+0000", 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475198+0000", 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1399999999999995e-07 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475202+0000", 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1389999999999997e-06 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475212+0000", 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8190000000000003e-06 2023-10-08T06:59:12.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475219+0000", 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9670000000000004e-06 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475262+0000", 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3022000000000002e-05 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475348+0000", 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5864000000000003e-05 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.475411+0000", 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2979999999999997e-05 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:234669 5.c 5:3aed82d3:::benchmark_data_smithi037_101035_object90808:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:12.476071+0000", 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00027267799999999999, 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00058062700000000001, 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.515 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 234669 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476071+0000", 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476071+0000", 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476072+0000", 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0500000000000002e-07 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476080+0000", 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6729999999999992e-06 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476091+0000", 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1464999999999999e-05 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476098+0000", 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0559999999999999e-06 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476149+0000", 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1462999999999998e-05 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:12.476277+0000", 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012748600000000001 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:12.519 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 7 2023-10-08T06:59:12.520 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:12.521 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:12.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:12.564+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:12.666 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:12.665+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:12.698 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:12.698 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:12.698 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:12.698 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:12.698 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:12.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:12.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:12.795+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:12.868 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:12.867+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:12.941 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:12.941 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:12.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:12.941 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:12.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.942 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:12.942 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:12.942 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.047128702000002, 2023-10-08T06:59:12.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:12.942 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.942 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:12.943 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.943 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.943 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.943 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:12.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.943 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:12.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:12.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:12.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:12.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:12.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.045412399999996, 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:12.950 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:12.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:12.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:12.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:12.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:12.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:12.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:12.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:12.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:12.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:12.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:12.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:12.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:12.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:12.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:12.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:12.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:12.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:12.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:12.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:12.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:12.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:12.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:12.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:12.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:12.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:12.961 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.962 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.962 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.962 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:12.963 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:12.963 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.043594579000001, 2023-10-08T06:59:12.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:12.963 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.963 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:12.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:12.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.041590282999998, 2023-10-08T06:59:12.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:12.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:12.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.041473967000002, 2023-10-08T06:59:12.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:12.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:12.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:12.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:12.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:12.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.033584019000003, 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.985 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:12.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:12.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:12.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.991 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 51.474227728000002, 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:12.992 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:12.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:12.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:12.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:12.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:12.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:12.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:12.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:12.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:12.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:12.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:12.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:12.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:12.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:12.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:12.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:12.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:12.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:12.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:12.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:12.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:12.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:12.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:13.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:13.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:13.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:13.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.001 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.002 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.002 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:13.002 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 51.473466408999997, 2023-10-08T06:59:13.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:13.003 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.003 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.004 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:13.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.004 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:13.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:13.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:13.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:13.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:13.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:13.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:13.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 51.469550703000003, 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.013 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.019 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 51.469387822999998, 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.020 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:13.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:13.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:13.027 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 51.467724838999999, 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.028 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:13.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:13.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:13.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 51.467458387000001, 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.035 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:13.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:13.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:13.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 51.464703020000002, 2023-10-08T06:59:13.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:13.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0361732929999992, 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:13.057 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.033816259, 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.058 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:13.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:13.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:13.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:13.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0323098389999998, 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:13.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:13.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:13.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.073 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:13.073 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:13.073 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0321018080000002, 2023-10-08T06:59:13.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:13.073 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.073 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.074 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:13.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.074 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:13.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:13.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:13.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:13.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:13.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:13.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:13.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:13.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:13.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:13.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:13.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:13.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:13.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:13.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:13.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:13.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:13.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:13.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:13.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:13.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.084 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.085 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:13.085 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:13.085 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0315305890000008, 2023-10-08T06:59:13.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:13.085 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.086 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.086 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:13.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.087 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:13.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:13.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:13.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:13.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:13.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:13.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:13.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:13.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:13.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:13.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:13.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:13.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:13.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:13.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:13.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:13.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:13.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:13.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:13.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:13.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:13.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:13.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:13.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:13.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:13.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:13.098 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.098 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0292715680000004, 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:13.099 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:13.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:13.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:13.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:13.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:13.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:13.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:13.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:13.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:13.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:13.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:13.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:13.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:13.108 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.108 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.108 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.109 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:13.109 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:13.109 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.0287004450000001, 2023-10-08T06:59:13.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:13.110 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:13.110 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:13.110 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:13.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:13.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:13.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:13.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:13.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:13.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:13.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:13.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:13.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:13.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:13.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:13.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:13.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:13.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:13.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:13.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:13.116 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:13.119 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:13.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:13.116+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:13.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:13.218+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:13.289 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:13.289 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:13.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:236862 5.e 5:78634828:::benchmark_data_smithi037_101035_object93001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:13.288695+0000", 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00011864199999999999, 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141383, 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.290 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236862 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288695+0000", 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288695+0000", 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288696+0000", 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1310000000000001e-06 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288701+0000", 2023-10-08T06:59:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3150000000000002e-06 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288710+0000", 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2560000000000008e-06 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288726+0000", 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6541999999999998e-05 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288762+0000", 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5267e-05 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288848+0000", 2023-10-08T06:59:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6006000000000003e-05 2023-10-08T06:59:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:236864 5.e 5.73e75e5e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:13.288746+0000", 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.7502000000000005e-05, 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000153342, 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.296 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236864 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288746+0000", 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288746+0000", 2023-10-08T06:59:13.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288747+0000", 2023-10-08T06:59:13.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1200000000000003e-07 2023-10-08T06:59:13.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288750+0000", 2023-10-08T06:59:13.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1310000000000002e-06 2023-10-08T06:59:13.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288755+0000", 2023-10-08T06:59:13.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2549999999999997e-06 2023-10-08T06:59:13.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288764+0000", 2023-10-08T06:59:13.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0950000000000002e-06 2023-10-08T06:59:13.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.302 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:236867 5.4 5:2bfc0c5b:::benchmark_data_smithi037_101035_object93006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:13.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:13.288852+0000", 2023-10-08T06:59:13.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9999619, 2023-10-08T06:59:13.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114932, 2023-10-08T06:59:13.303 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.303 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2023-10-08T06:59:13.303 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.303 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.303 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.304 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236867 2023-10-08T06:59:13.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.304 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288852+0000", 2023-10-08T06:59:13.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288852+0000", 2023-10-08T06:59:13.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288852+0000", 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5599999999999995e-07 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288855+0000", 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4040000000000002e-06 2023-10-08T06:59:13.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288861+0000", 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8549999999999998e-06 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288865+0000", 2023-10-08T06:59:13.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2370000000000003e-06 2023-10-08T06:59:13.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288928+0000", 2023-10-08T06:59:13.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3347000000000002e-05 2023-10-08T06:59:13.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.310 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:236868 5.4 5.54afec64 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:13.288874+0000", 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9999394, 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016017599999999999, 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.311 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236868 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288874+0000", 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288874+0000", 2023-10-08T06:59:13.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288875+0000", 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7599999999999998e-07 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288877+0000", 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1339999999999998e-06 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288883+0000", 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5770000000000001e-06 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288886+0000", 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0639999999999998e-06 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:236870 5.8 5:12124b53:::benchmark_data_smithi037_101035_object93009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:13.288946+0000", 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9998674, 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015663, 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.315 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236870 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288946+0000", 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288946+0000", 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288946+0000", 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5199999999999998e-07 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288948+0000", 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.843e-06 2023-10-08T06:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288953+0000", 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5140000000000003e-06 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.288956+0000", 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0709999999999999e-06 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.289000+0000", 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4218999999999998e-05 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:236871 5.4 5.dac92eb4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:13.289135+0000", 2023-10-08T06:59:13.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9996791, 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8072000000000003e-05, 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236871 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.289135+0000", 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.289135+0000", 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.289135+0000", 2023-10-08T06:59:13.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.22e-07 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.289137+0000", 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9719999999999999e-06 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.289142+0000", 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1669999999999998e-06 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:13.289145+0000", 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-06 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 6 2023-10-08T06:59:13.323 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:13.325 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:13.325 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:13.324+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:13.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:13.424+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:13.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:13.525+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:13.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:59:13.532 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:13.532 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:13.532 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:13.532 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:13.532 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:13.546 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:13.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:13.625+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.857624705000006, 2023-10-08T06:59:13.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:13.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:13.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:13.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.732 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.854916485999993, 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:13.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:13.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:13.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.851924195999999, 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:13.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:13.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:13.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.836883333999999, 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:13.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:13.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.836780476999998, 2023-10-08T06:59:13.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:13.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:13.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:13.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.836717184000001, 2023-10-08T06:59:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:13.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:13.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.836443906, 2023-10-08T06:59:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:13.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:13.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.833453863000003, 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:13.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.832102935000002, 2023-10-08T06:59:13.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:13.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:13.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:13.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.781 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.831964171999999, 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:13.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:13.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:13.787 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.831585707999999, 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:13.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.829424174000003, 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:13.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:13.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.797 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.821085291000003, 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:13.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:13.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.057656473000002, 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.804 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:13.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.057111812000002, 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:13.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:13.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:13.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.815 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.057023553000001, 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.816 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.821 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.056989127000001, 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:13.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.055894551000002, 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.827 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:13.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.055370717999999, 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:13.833 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:13.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:13.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.054412495999998, 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:13.839 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:13.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:13.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:13.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:13.844 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:13.846 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:13.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:13.844+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:13.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:13.945+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:14.030 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:14.030 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:14.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.031 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238844 5.d 5:b33fd966:::benchmark_data_smithi037_101035_object94983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.031 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.022210+0000", 2023-10-08T06:59:14.031 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0064194789999999996, 2023-10-08T06:59:14.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064455390000000001, 2023-10-08T06:59:14.031 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.031 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:14.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.032 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238844 2023-10-08T06:59:14.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.032 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022210+0000", 2023-10-08T06:59:14.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022210+0000", 2023-10-08T06:59:14.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022211+0000", 2023-10-08T06:59:14.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4799999999999998e-07 2023-10-08T06:59:14.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022215+0000", 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.963e-06 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022224+0000", 2023-10-08T06:59:14.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0459999999999994e-06 2023-10-08T06:59:14.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022231+0000", 2023-10-08T06:59:14.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9299999999999997e-06 2023-10-08T06:59:14.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022272+0000", 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1699999999999997e-05 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022380+0000", 2023-10-08T06:59:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107433 2023-10-08T06:59:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.022446+0000", 2023-10-08T06:59:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6004e-05 2023-10-08T06:59:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024228+0000", 2023-10-08T06:59:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001782112 2023-10-08T06:59:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.040 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238849 5.9 5:92e21a2b:::benchmark_data_smithi037_101035_object94988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.040 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.024638+0000", 2023-10-08T06:59:14.040 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0039915719999999997, 2023-10-08T06:59:14.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0041056290000000004, 2023-10-08T06:59:14.040 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238849 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024638+0000", 2023-10-08T06:59:14.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024638+0000", 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024639+0000", 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1200000000000003e-07 2023-10-08T06:59:14.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024642+0000", 2023-10-08T06:59:14.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5370000000000002e-06 2023-10-08T06:59:14.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024651+0000", 2023-10-08T06:59:14.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-06 2023-10-08T06:59:14.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024658+0000", 2023-10-08T06:59:14.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.754e-06 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024696+0000", 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8136000000000002e-05 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024772+0000", 2023-10-08T06:59:14.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6131999999999995e-05 2023-10-08T06:59:14.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.024857+0000", 2023-10-08T06:59:14.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5375000000000002e-05 2023-10-08T06:59:14.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027248+0000", 2023-10-08T06:59:14.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0023901780000000002 2023-10-08T06:59:14.048 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238853 5.d 5:bab6c550:::benchmark_data_smithi037_101035_object94992:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.025359+0000", 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0032709190000000002, 2023-10-08T06:59:14.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034653169999999999, 2023-10-08T06:59:14.050 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.050 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:14.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.050 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238853 2023-10-08T06:59:14.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.051 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025359+0000", 2023-10-08T06:59:14.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025359+0000", 2023-10-08T06:59:14.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025359+0000", 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5999999999999999e-07 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025361+0000", 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3190000000000002e-06 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025369+0000", 2023-10-08T06:59:14.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5719999999999997e-06 2023-10-08T06:59:14.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025373+0000", 2023-10-08T06:59:14.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3229999999999999e-06 2023-10-08T06:59:14.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025415+0000", 2023-10-08T06:59:14.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2159000000000001e-05 2023-10-08T06:59:14.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025548+0000", 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132316 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025660+0000", 2023-10-08T06:59:14.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011268399999999999 2023-10-08T06:59:14.057 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.057 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.057 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.057 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238854 5.c 5:3adc2893:::benchmark_data_smithi037_101035_object94993:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.025384+0000", 2023-10-08T06:59:14.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0032457530000000001, 2023-10-08T06:59:14.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035187640000000002, 2023-10-08T06:59:14.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.058 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:14.058 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.058 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.059 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.059 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238854 2023-10-08T06:59:14.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.059 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025384+0000", 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025384+0000", 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025384+0000", 2023-10-08T06:59:14.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2899999999999999e-07 2023-10-08T06:59:14.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025386+0000", 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.165e-06 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025393+0000", 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4350000000000002e-06 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025398+0000", 2023-10-08T06:59:14.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5550000000000002e-06 2023-10-08T06:59:14.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025473+0000", 2023-10-08T06:59:14.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4540000000000001e-05 2023-10-08T06:59:14.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025592+0000", 2023-10-08T06:59:14.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119021 2023-10-08T06:59:14.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.028880+0000", 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032881160000000002 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.066 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238855 5.c 5:330e972f:::benchmark_data_smithi037_101035_object94994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.066 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.025414+0000", 2023-10-08T06:59:14.066 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003215978, 2023-10-08T06:59:14.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035643459999999999, 2023-10-08T06:59:14.066 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.066 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238855 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025414+0000", 2023-10-08T06:59:14.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025414+0000", 2023-10-08T06:59:14.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025414+0000", 2023-10-08T06:59:14.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2300000000000002e-07 2023-10-08T06:59:14.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025416+0000", 2023-10-08T06:59:14.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1469999999999999e-06 2023-10-08T06:59:14.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025423+0000", 2023-10-08T06:59:14.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3990000000000001e-06 2023-10-08T06:59:14.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.025428+0000", 2023-10-08T06:59:14.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4829999999999999e-06 2023-10-08T06:59:14.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027565+0000", 2023-10-08T06:59:14.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021367080000000002 2023-10-08T06:59:14.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027643+0000", 2023-10-08T06:59:14.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8076000000000003e-05 2023-10-08T06:59:14.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.073 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.074 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238856 5.5 5:a8a7da45:::benchmark_data_smithi037_101035_object94995:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.074 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.027107+0000", 2023-10-08T06:59:14.074 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0015225919999999999, 2023-10-08T06:59:14.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019422230000000001, 2023-10-08T06:59:14.074 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.074 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:14.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238856 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027107+0000", 2023-10-08T06:59:14.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027107+0000", 2023-10-08T06:59:14.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027108+0000", 2023-10-08T06:59:14.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4799999999999997e-07 2023-10-08T06:59:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027112+0000", 2023-10-08T06:59:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5719999999999996e-06 2023-10-08T06:59:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027124+0000", 2023-10-08T06:59:14.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1024e-05 2023-10-08T06:59:14.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027132+0000", 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4300000000000006e-06 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027178+0000", 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5843999999999997e-05 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027282+0000", 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103893 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238857 5.5 5.abd03745 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.027342+0000", 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0012872879999999999, 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770787, 2023-10-08T06:59:14.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238857 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027342+0000", 2023-10-08T06:59:14.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027342+0000", 2023-10-08T06:59:14.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027343+0000", 2023-10-08T06:59:14.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2200000000000004e-07 2023-10-08T06:59:14.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027346+0000", 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5980000000000001e-06 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027355+0000", 2023-10-08T06:59:14.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9160000000000007e-06 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027363+0000", 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1930000000000004e-06 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238858 5.7 5:e1347b85:::benchmark_data_smithi037_101035_object94997:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.087 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.027376+0000", 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0012531510000000001, 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001794931, 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238858 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027376+0000", 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027376+0000", 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027377+0000", 2023-10-08T06:59:14.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4799999999999999e-07 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027380+0000", 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.745e-06 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027387+0000", 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4939999999999997e-06 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027393+0000", 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9240000000000004e-06 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027439+0000", 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5977999999999999e-05 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027553+0000", 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356199999999999 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:238859 5.f 5:ffd0b809:::benchmark_data_smithi037_101035_object94998:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.027446+0000", 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0011833519999999999, 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017932989999999999, 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 238859 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027446+0000", 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027446+0000", 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027447+0000", 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5000000000000002e-07 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027450+0000", 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2119999999999999e-06 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027458+0000", 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6750000000000002e-06 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027465+0000", 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3019999999999997e-06 2023-10-08T06:59:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027513+0000", 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7837000000000003e-05 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027642+0000", 2023-10-08T06:59:14.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012922899999999999 2023-10-08T06:59:14.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027752+0000", 2023-10-08T06:59:14.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010942600000000001 2023-10-08T06:59:14.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.098 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.098 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.098 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:238844 5.d e59/32)", 2023-10-08T06:59:14.098 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:14.027702+0000", 2023-10-08T06:59:14.098 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00092735400000000003, 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016109760000000001, 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027702+0000", 2023-10-08T06:59:14.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027702+0000", 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027703+0000", 2023-10-08T06:59:14.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027708+0000", 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3900000000000003e-06 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027717+0000", 2023-10-08T06:59:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3100000000000006e-06 2023-10-08T06:59:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.027724+0000", 2023-10-08T06:59:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1339999999999998e-06 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.029300+0000", 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015762249999999999 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:14.029310+0000", 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5319999999999995e-06 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 10 2023-10-08T06:59:14.105 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:14.106 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:14.105+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:14.107 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:14.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:14.205+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:14.310 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:14.307+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:14.328 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:14.329 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:14.329 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:14.329 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:14.329 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:14.344 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:14.409 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:14.408+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:14.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:14.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:14.509+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:59:14.571 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.677844542000003, 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.676128239999997, 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.674310419000001, 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.672306122999998, 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.672189807000002, 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.664299859000003, 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.104943568000003, 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.104182248999997, 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.100266542999996, 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.100103662999999, 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.098440678999999, 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.098174227000001, 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:14.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:14.650 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.095418860000002, 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:14.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:14.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.666889133, 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:14.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:14.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.664532099000001, 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.665 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:14.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.663025679, 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.672 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.662817648000001, 2023-10-08T06:59:14.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:14.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.662246429, 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:14.685 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:14.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:14.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:14.692 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.659987407999999, 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:14.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:14.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:14.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:14.699 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 10.659416285000001, 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:14.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:14.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:14.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:14.704 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:14.706 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:14.704+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:14.706 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:14.706 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:14.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:14.707 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:14.708 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:14.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:14.805+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:14.876 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:14.876 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:14.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:14.933 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:14.932+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:15.007+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:15.058 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:15.058 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:15.072 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:15.114 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:15.113+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.211 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:15.211+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.289 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:15.289 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:15.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:15.343 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:15.342+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.412 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:15.411+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.491 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:15.492 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:15.506 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:15.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2023-10-08T06:59:15.513 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:15.512+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.613 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:15.612+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.695 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:15.695 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:15.715 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:15.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:15.713+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:15.815 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:15.814+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:15.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:15.917+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:15.939 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:15.939 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:15.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:16.018 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:16.017+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:16.119 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:16.118+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:16.132 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:16.132 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:16.145 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:16.229 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:16.228+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:16.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:16.320+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:16.364 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:16.364 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:16.380 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:16.423 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:16.422+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:16.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:16.523+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:16.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:59:16.592 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:16.593 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:16.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:16.624 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:16.623+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:16.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:16.726 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:16.725+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:16.792 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:16.792 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:16.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:16.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:16.850+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:16.862 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:16.884 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:16.887 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:16.887 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:16.928 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:16.927+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:16.987 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:16.987 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:17.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:17.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:17.043+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:17.130 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:17.129+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:17.226 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.332378124999998, 2023-10-08T06:59:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.330661823, 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.328844001999997, 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.326839706000001, 2023-10-08T06:59:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.326723389999998, 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.318833441999999, 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.759477150999999, 2023-10-08T06:59:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.758715832, 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.754800125999999, 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.754637246000001, 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.752974262000002, 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.752707809999997, 2023-10-08T06:59:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.749952442999998, 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.321422716000001, 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.319065682, 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.317559262, 2023-10-08T06:59:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.317351231, 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.316780012000001, 2023-10-08T06:59:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.314520991, 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.313949868, 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:17.375 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:17.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:17.377 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:17.375+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:17.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:17.476+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:59:17.553 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:17.553 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:17.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248487 5.a 5:5c26a4fe:::benchmark_data_smithi037_101035_object104626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.545272+0000", 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0070610569999999999, 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070879039999999999, 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.554 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248487 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545272+0000", 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545272+0000", 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545273+0000", 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1900000000000003e-07 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545275+0000", 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.61e-06 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545283+0000", 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6510000000000001e-06 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545290+0000", 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2930000000000003e-06 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545328+0000", 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7905999999999999e-05 2023-10-08T06:59:17.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.545332+0000", 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9249999999999997e-06 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550765+0000", 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054324730000000002 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550899+0000", 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013442900000000001 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248490 5.4 5:22a9be48:::benchmark_data_smithi037_101035_object104629:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.547146+0000", 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0051871369999999997, 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053066529999999997, 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:17.562 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248490 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547146+0000", 2023-10-08T06:59:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547146+0000", 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547147+0000", 2023-10-08T06:59:17.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1900000000000002e-07 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547150+0000", 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3129999999999999e-06 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547159+0000", 2023-10-08T06:59:17.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7919999999999998e-06 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547166+0000", 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9929999999999998e-06 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547216+0000", 2023-10-08T06:59:17.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0309000000000002e-05 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.547222+0000", 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9989999999999997e-06 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550875+0000", 2023-10-08T06:59:17.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036524550000000002 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551002+0000", 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127265 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:248491 5.d e61/32 5:bac17ae4:::benchmark_data_smithi037_101035_object104630:head v 61'15137, mlcod=60'15132)", 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.548891+0000", 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0034418140000000001, 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036477530000000001, 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:17.569 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548891+0000", 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548891+0000", 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548892+0000", 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4099999999999998e-07 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548897+0000", 2023-10-08T06:59:17.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7609999999999998e-06 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548908+0000", 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1396999999999999e-05 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548914+0000", 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6230000000000002e-06 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548960+0000", 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.548978+0000", 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8199e-05 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:248493 5.d e61/32 5:b8190705:::benchmark_data_smithi037_101035_object104632:head v 61'15138, mlcod=60'15132)", 2023-10-08T06:59:17.574 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.550874+0000", 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0014594300000000001, 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001726163, 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550874+0000", 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550874+0000", 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550874+0000", 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1900000000000003e-07 2023-10-08T06:59:17.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550880+0000", 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4140000000000002e-06 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550888+0000", 2023-10-08T06:59:17.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6279999999999994e-06 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550895+0000", 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7070000000000003e-06 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550932+0000", 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6692e-05 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.550949+0000", 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7059999999999999e-05 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248496 5.0 5:0c41a055:::benchmark_data_smithi037_101035_object104635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.551093+0000", 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001240068, 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015706100000000001, 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248496 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551093+0000", 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551093+0000", 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551094+0000", 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2399999999999997e-07 2023-10-08T06:59:17.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551098+0000", 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5499999999999996e-06 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551108+0000", 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4509999999999998e-06 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551115+0000", 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1949999999999997e-06 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551161+0000", 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5451999999999998e-05 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551233+0000", 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2712000000000004e-05 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.585 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248497 5.a 5.5d6099fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.551733+0000", 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00060000799999999996, 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099678500000000003, 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:17.586 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248497 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551733+0000", 2023-10-08T06:59:17.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551733+0000", 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551734+0000", 2023-10-08T06:59:17.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8999999999999996e-07 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551737+0000", 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.433e-06 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551746+0000", 2023-10-08T06:59:17.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4600000000000003e-06 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.551752+0000", 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8409999999999996e-06 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248498 5.e 5.cd928b0e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.552479+0000", 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9998546, 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030727100000000002, 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.591 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248498 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552479+0000", 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552479+0000", 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552479+0000", 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552483+0000", 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0559999999999998e-06 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552493+0000", 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4150000000000005e-06 2023-10-08T06:59:17.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552500+0000", 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0790000000000003e-06 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.595 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248499 5.b 5:d573ee4e:::benchmark_data_smithi037_101035_object104638:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.552509+0000", 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.999824, 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033666399999999997, 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.596 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248499 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552509+0000", 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552509+0000", 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552510+0000", 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5600000000000001e-07 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552512+0000", 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1509999999999998e-06 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552517+0000", 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7100000000000004e-06 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552522+0000", 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6120000000000001e-06 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552793+0000", 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027072199999999999 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248500 5.b 5.95a81f6b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.552535+0000", 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9997983, 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037086200000000001, 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248500 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552535+0000", 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552535+0000", 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552535+0000", 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0899999999999997e-07 2023-10-08T06:59:17.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552538+0000", 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3870000000000002e-06 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552545+0000", 2023-10-08T06:59:17.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2899999999999997e-06 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552550+0000", 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8740000000000003e-06 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248501 5.8 5.9d37e5e8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.552563+0000", 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9997702, 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00040184800000000001, 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248501 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552563+0000", 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552563+0000", 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552563+0000", 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7899999999999999e-07 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552566+0000", 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6419999999999999e-06 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552574+0000", 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.469e-06 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552579+0000", 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8599999999999998e-06 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:248502 5.4 5.c2c35f44 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:17.552590+0000", 2023-10-08T06:59:17.610 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.999743, 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043591600000000001, 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 248502 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:17.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552590+0000", 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552590+0000", 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552591+0000", 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6199999999999998e-07 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552593+0000", 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.39e-06 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552600+0000", 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4880000000000004e-06 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:17.552605+0000", 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1540000000000001e-06 2023-10-08T06:59:17.614 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.615 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:17.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:17.615 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:17.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 11 2023-10-08T06:59:17.615 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:17.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:17.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:17.615+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:17.717 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:17.717+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:17.790 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:17.790 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:17.790 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:17.790 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:17.790 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:17.805 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:17.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:17.817+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:17.918 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:17.918+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:18.019 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.152106193999998, 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:18.020 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:18.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.149397974999999, 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:18.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:18.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:18.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.146405685000005, 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:18.034 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:18.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.040 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.131364822999998, 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:18.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.131261965999997, 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.047 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:18.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.052 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.131198673, 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:18.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:18.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.130925394999998, 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.059 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:18.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:18.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.064 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.127935352000002, 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:18.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.070 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.126584424000001, 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:18.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.126445660999998, 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:18.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:18.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.126067196999998, 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:18.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.087 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.123905663000002, 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:18.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:18.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:18.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:18.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.093 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.115566780000002, 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:18.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:18.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.352137962, 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:18.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:18.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.351593301000001, 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:18.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:18.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:18.111 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.351505041999999, 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:18.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:18.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.351470616, 2023-10-08T06:59:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:18.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:18.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.35037604, 2023-10-08T06:59:18.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:18.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:18.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.349852206999998, 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:18.128 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:18.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:18.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.348893984999997, 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.134 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:18.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:18.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:18.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:18.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.139 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:18.139 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:18.139 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:18.139 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:18.018+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:18.140 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:18.183 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:18.182+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:18.243 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:18.242+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:18.333 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250724 5.7 5:e2988544:::benchmark_data_smithi037_101035_object106863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.330699+0000", 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002110495, 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021290279999999998, 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250724 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330699+0000", 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330699+0000", 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330700+0000", 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3399999999999998e-07 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330704+0000", 2023-10-08T06:59:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.738e-06 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330712+0000", 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2989999999999997e-06 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330719+0000", 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7290000000000003e-06 2023-10-08T06:59:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330761+0000", 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2001e-05 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330855+0000", 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4233000000000004e-05 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250726 5.6 5:6fc6fdde:::benchmark_data_smithi037_101035_object106865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.330740+0000", 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0020692850000000001, 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021453069999999999, 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250726 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330740+0000", 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330740+0000", 2023-10-08T06:59:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330741+0000", 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3300000000000002e-07 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330744+0000", 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8150000000000002e-06 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330751+0000", 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2609999999999996e-06 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330757+0000", 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9120000000000003e-06 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330807+0000", 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0445000000000002e-05 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330915+0000", 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010807299999999999 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250711 5.f 5:f3f2902c:::benchmark_data_smithi037_101035_object106850:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.325102+0000", 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0077078829999999996, 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078283780000000004, 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250711 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325102+0000", 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325102+0000", 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325102+0000", 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1300000000000001e-07 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325105+0000", 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3949999999999999e-06 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325111+0000", 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5799999999999997e-06 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325117+0000", 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5799999999999999e-06 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.327025+0000", 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019080779999999999 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.327103+0000", 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7892999999999994e-05 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.327168+0000", 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4824000000000001e-05 2023-10-08T06:59:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250713 5.7 5:e61802d4:::benchmark_data_smithi037_101035_object106852:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.325127+0000", 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0076830470000000001, 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078467669999999993, 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250713 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325127+0000", 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325127+0000", 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325127+0000", 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1399999999999997e-07 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325130+0000", 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4959999999999999e-06 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325136+0000", 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4409999999999998e-06 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.325140+0000", 2023-10-08T06:59:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2740000000000001e-06 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.326999+0000", 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018583460000000001 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.327072+0000", 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2939000000000001e-05 2023-10-08T06:59:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250716 5.6 5:6f8f1252:::benchmark_data_smithi037_101035_object106855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.328305+0000", 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0045049640000000002, 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047085369999999996, 2023-10-08T06:59:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250716 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328305+0000", 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328305+0000", 2023-10-08T06:59:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328306+0000", 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2600000000000001e-07 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328310+0000", 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0389999999999998e-06 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328321+0000", 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1677e-05 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328328+0000", 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9399999999999996e-06 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328380+0000", 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1314999999999999e-05 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328492+0000", 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011259799999999999 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250718 5.f 5:fbbb7ec3:::benchmark_data_smithi037_101035_object106857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.328354+0000", 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0044556320000000002, 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047083369999999999, 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250718 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328354+0000", 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328354+0000", 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328355+0000", 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328357+0000", 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8289999999999999e-06 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328365+0000", 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8849999999999999e-06 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328371+0000", 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7100000000000004e-06 2023-10-08T06:59:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328480+0000", 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010853000000000001 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328549+0000", 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9151000000000003e-05 2023-10-08T06:59:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328612+0000", 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2805999999999995e-05 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250719 5.6 5:6cce57b0:::benchmark_data_smithi037_101035_object106858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.328380+0000", 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0044297219999999997, 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047680220000000002, 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250719 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328380+0000", 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328380+0000", 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328380+0000", 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328383+0000", 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.903e-06 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328391+0000", 2023-10-08T06:59:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7829999999999999e-06 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.328396+0000", 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1039999999999998e-06 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.329511+0000", 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011143500000000001 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.329588+0000", 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7688999999999994e-05 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:250722 5.9 5:9853e0a6:::benchmark_data_smithi037_101035_object106861:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:18.330471+0000", 2023-10-08T06:59:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0023385300000000001, 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0027609890000000002, 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 250722 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330471+0000", 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330471+0000", 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330472+0000", 2023-10-08T06:59:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4899999999999995e-07 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330475+0000", 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0000000000000001e-06 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330486+0000", 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1731e-05 2023-10-08T06:59:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330491+0000", 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8690000000000003e-06 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330542+0000", 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0769000000000001e-05 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330660+0000", 2023-10-08T06:59:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011809199999999999 2023-10-08T06:59:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:18.330729+0000", 2023-10-08T06:59:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9214999999999994e-05 2023-10-08T06:59:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 8 2023-10-08T06:59:18.379 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:18.381 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:18.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:18.379+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:18.481 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:18.480+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:18.583 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:18.582+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:18.610 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:18.610 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:18.624 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:18.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:18.683+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:18.785 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:18.784+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.915950721999998, 2023-10-08T06:59:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.91423442, 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.912416598999997, 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.910412303000001, 2023-10-08T06:59:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.910295986999998, 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.902406038999999, 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.343049747999999, 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.342288429, 2023-10-08T06:59:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.338372722999999, 2023-10-08T06:59:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.338209843000001, 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.336546859000002, 2023-10-08T06:59:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.336280406999997, 2023-10-08T06:59:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.333525039999998, 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.904995313000001, 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.902638279, 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.901131858999999, 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.900923828, 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.900352609, 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.898093588, 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.897522465, 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:18.971 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:18.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:18.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:18.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:18.971+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:19.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:19.072+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:19.124 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:19.147 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:19.148 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:19.148 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:19.150 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:19.150 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:19.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:19.207 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.206+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:19.275 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.274+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:19.337 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:19.338 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:19.351 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:19.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:19.375+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:19.476 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.475+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:19.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:59:19.560 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:19.560 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:19.575 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:19.617 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.615+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:19.679 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.678+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:19.754 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:19.754 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:19.769 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:19.779 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.779+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:19.880 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.879+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:19.942 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:19.942 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:19.959 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:19.981 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:19.981+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:20.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:20.081+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:20.143 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:20.143 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:20.159 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:20.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:20.199+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:20.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:20.283+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:20.328 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:20.328 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:20.343 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:20.387 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:20.386+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:20.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:20.484+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:20.519 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:20.519 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:20.535 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:59:20.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:20.585+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:20.687 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:20.686+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:20.750 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:20.750 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:20.764 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:20.805 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:20.804+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:20.889 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:20.888+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:20.943 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:20.943 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:20.958 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:21.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:21.000+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:21.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:21.091+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:21.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:21.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:21.193 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:21.192+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:21.294 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:21.293+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:21.304 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:21.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2023-10-08T06:59:21.325 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:21.328 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:21.328 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.487159277000003, 2023-10-08T06:59:21.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:21.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:21.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.485442974999998, 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.388 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:21.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:21.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:21.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:21.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.396 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:21.396 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:21.396 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.483625154000002, 2023-10-08T06:59:21.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:21.396 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.396 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:21.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.403 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.481620857999999, 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:21.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:21.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:21.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:21.411 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.481504542000003, 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:21.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:21.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:21.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:21.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:21.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:21.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.473614593999997, 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.914258302999997, 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:21.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.435 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.913496983999998, 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.436 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:21.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:21.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:21.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:21.443 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:21.444 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.909581277999997, 2023-10-08T06:59:21.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:21.444 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.444 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.444 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.444 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.445 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.445 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:21.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.445 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:21.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:21.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:21.452 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.909418398, 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:21.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:21.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:21.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.907755414, 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:21.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.462 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:21.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:21.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:21.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:21.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:21.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:21.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:21.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:21.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:21.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:21.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:21.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:21.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:21.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:21.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:21.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:21.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:21.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:21.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:21.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:21.471 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.471 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.472 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.472 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:21.472 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:21.472 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.907488962000002, 2023-10-08T06:59:21.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:21.473 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.473 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.473 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.473 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.473 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.474 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:21.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.474 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:21.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:21.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:21.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:21.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:21.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:21.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:21.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:21.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:21.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:21.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:21.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:21.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:21.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:21.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:21.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:21.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:21.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:21.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:21.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:21.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.483 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:21.484 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:21.484 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.904733595000003, 2023-10-08T06:59:21.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:21.484 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.484 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.484 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.485 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.485 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.485 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:21.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.485 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:21.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:21.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:21.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:21.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:21.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:21.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:21.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:21.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:21.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:21.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:21.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:21.493 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.476203867999999, 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:21.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:21.501 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.501 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.501 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.501 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.473846834, 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.502 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:21.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:21.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:21.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:21.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:21.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.510 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.510 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:21.511 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:21.511 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.472340414000001, 2023-10-08T06:59:21.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:21.511 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.511 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.512 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.512 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:21.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.512 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:21.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:21.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:21.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:21.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:21.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:21.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:21.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:21.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:21.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:21.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:21.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:21.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:21.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:21.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:21.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.472132383000002, 2023-10-08T06:59:21.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:21.522 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.522 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.522 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.522 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.522 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.522 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:21.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:21.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:21.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:21.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:21.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.471561164000001, 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.529 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:21.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:21.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:21.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:21.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:21.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.469302143, 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:21.537 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:21.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:21.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.46873102, 2023-10-08T06:59:21.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:21.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:21.550 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:21.550 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:21.552 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:21.550+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:21.553 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:21.652 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:21.651+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:21.724 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:21.724 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:21.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:259893 5.d e62/32 5:b102b003:::benchmark_data_smithi037_101035_object116032:head v 62'15870, mlcod=62'15868)", 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:21.723558+0000", 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.000572281, 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059380200000000005, 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723558+0000", 2023-10-08T06:59:21.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723558+0000", 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723558+0000", 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.03e-07 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723563+0000", 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.561e-06 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723571+0000", 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9950000000000005e-06 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723577+0000", 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2049999999999999e-06 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723634+0000", 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6885000000000002e-05 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723653+0000", 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8868999999999998e-05 2023-10-08T06:59:21.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:259884 5.f e62/20 5:f35a8586:::benchmark_data_smithi037_101035_object116023:head v 62'16495, mlcod=62'16493)", 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:21.721196+0000", 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002933813, 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030336429999999999, 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:21.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721196+0000", 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721196+0000", 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721197+0000", 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5899999999999996e-07 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721203+0000", 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5929999999999996e-06 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721212+0000", 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0880000000000001e-06 2023-10-08T06:59:21.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721219+0000", 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8800000000000002e-06 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721264+0000", 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5062000000000003e-05 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.721284+0000", 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0718000000000001e-05 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:259892 5.f e62/20 5:f577bf8a:::benchmark_data_smithi037_101035_object116031:head v 62'16496, mlcod=62'16493)", 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:21.723277+0000", 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00085315, 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010230180000000001, 2023-10-08T06:59:21.733 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723277+0000", 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:21.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723277+0000", 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723278+0000", 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7700000000000004e-07 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723284+0000", 2023-10-08T06:59:21.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9329999999999998e-06 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723295+0000", 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0907000000000001e-05 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723303+0000", 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1559999999999995e-06 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723352+0000", 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8789999999999999e-05 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723375+0000", 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2969999999999999e-05 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:21.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:259895 5.e 5:70305a27:::benchmark_data_smithi037_101035_object116034:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:21.723412+0000", 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00071775300000000001, 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00092296700000000001, 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:21.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 259895 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723412+0000", 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723412+0000", 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:21.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723413+0000", 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.108e-06 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723417+0000", 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3699999999999999e-06 2023-10-08T06:59:21.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723427+0000", 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0370000000000001e-05 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723434+0000", 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5509999999999996e-06 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723481+0000", 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7200000000000002e-05 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:21.723596+0000", 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115017 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:21.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.743 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:21.743 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:21.743 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 4 2023-10-08T06:59:21.743 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:21.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:21.785 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:21.785+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:21.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:21.853+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:21.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:21.954+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:21.958 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:21.959 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:21.959 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:21.959 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:21.959 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:21.975 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:22.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:22.055+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:22.156 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:22.157 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:22.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:22.157 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:22.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.158 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:22.158 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:22.158 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.288873633999998, 2023-10-08T06:59:22.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:22.158 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:22.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:22.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:22.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:22.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:22.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:22.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:22.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:22.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:22.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:22.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:22.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:22.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:22.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.170 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.286165414999999, 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:22.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:22.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:22.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.177 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.283173125000005, 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.178 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:22.183 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.268132262999998, 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.184 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.268029405999997, 2023-10-08T06:59:22.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:22.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:22.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:22.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.267966113, 2023-10-08T06:59:22.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:22.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:22.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:22.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:22.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:22.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.267692834999998, 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:22.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.264702792000001, 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.209 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.263351864000001, 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.216 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:22.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.263213100999998, 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.222 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:22.228 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.262834636999997, 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:22.234 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.260673103000002, 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:22.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:22.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.239 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.252334220000002, 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:22.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:22.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 60.488905402, 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 60.488360741000001, 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 60.488272481999999, 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 60.488238056, 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 60.48714348, 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 60.486619646999998, 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 60.485661425000004, 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:22.289 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:22.291 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:22.290+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:22.291 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:22.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:22.390+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261921 5.9 5:9950341c:::benchmark_data_smithi037_101035_object118060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.464303+0000", 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0051389510000000001, 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051693629999999997, 2023-10-08T06:59:22.471 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261921 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464303+0000", 2023-10-08T06:59:22.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464303+0000", 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464304+0000", 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.308e-06 2023-10-08T06:59:22.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464310+0000", 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4539999999999998e-06 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464319+0000", 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0520000000000007e-06 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464327+0000", 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1589999999999993e-06 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464386+0000", 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9413999999999997e-05 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464714+0000", 2023-10-08T06:59:22.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032760599999999998 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464829+0000", 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011454 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261923 5.c 5:33dbf898:::benchmark_data_smithi037_101035_object118062:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.476 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.464467+0000", 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0049750009999999997, 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050844690000000003, 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261923 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464467+0000", 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464467+0000", 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464468+0000", 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.44e-07 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464471+0000", 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5260000000000002e-06 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464478+0000", 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9999999999999999e-06 2023-10-08T06:59:22.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464485+0000", 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0079999999999996e-06 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464540+0000", 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4925e-05 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464627+0000", 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6768999999999995e-05 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469423+0000", 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047959989999999996 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469473+0000", 2023-10-08T06:59:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0281000000000002e-05 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469551+0000", 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8317000000000002e-05 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261925 5.d 5:bfaf8185:::benchmark_data_smithi037_101035_object118064:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.464523+0000", 2023-10-08T06:59:22.482 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0049192150000000002, 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051328800000000003, 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261925 2023-10-08T06:59:22.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464523+0000", 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464523+0000", 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464523+0000", 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.23e-07 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464526+0000", 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9079999999999999e-06 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464534+0000", 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2259999999999999e-06 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.464540+0000", 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2609999999999999e-06 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466566+0000", 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00202629 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466700+0000", 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013402499999999999 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466827+0000", 2023-10-08T06:59:22.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012646000000000001 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469043+0000", 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002216572 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261927 5.5 5:a0e8c477:::benchmark_data_smithi037_101035_object118066:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.466377+0000", 2023-10-08T06:59:22.489 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003065332, 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033599609999999999, 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261927 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466377+0000", 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466377+0000", 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466378+0000", 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0100000000000001e-06 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466382+0000", 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8060000000000002e-06 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466390+0000", 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4549999999999998e-06 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466397+0000", 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.126e-06 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466610+0000", 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00021281499999999999 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466735+0000", 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012555500000000001 2023-10-08T06:59:22.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261928 5.2 5:4ac46749:::benchmark_data_smithi037_101035_object118067:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.466418+0000", 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.003023502, 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003390831, 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.494 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261928 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466418+0000", 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466418+0000", 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466419+0000", 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0999999999999999e-07 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466421+0000", 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4040000000000002e-06 2023-10-08T06:59:22.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466433+0000", 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.188e-05 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466439+0000", 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1009999999999997e-06 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466581+0000", 2023-10-08T06:59:22.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000141459 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466701+0000", 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119918 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261929 5.9 5:98b35805:::benchmark_data_smithi037_101035_object118068:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.499 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.466691+0000", 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002751468, 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031897850000000001, 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261929 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466691+0000", 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466691+0000", 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466691+0000", 2023-10-08T06:59:22.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3500000000000005e-07 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466696+0000", 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4510000000000002e-06 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466705+0000", 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0129999999999999e-06 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466712+0000", 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5460000000000003e-06 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466863+0000", 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000151001 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466983+0000", 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119901 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467091+0000", 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107868 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261930 5.3 5:c39c57d9:::benchmark_data_smithi037_101035_object118069:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.466869+0000", 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0025733119999999999, 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030932569999999999, 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261930 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.505 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466869+0000", 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466869+0000", 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466870+0000", 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9999999999999996e-07 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466874+0000", 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8740000000000003e-06 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466886+0000", 2023-10-08T06:59:22.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1573000000000001e-05 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466894+0000", 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0430000000000008e-06 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466955+0000", 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1078e-05 2023-10-08T06:59:22.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467069+0000", 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113795 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261931 5.9 5:9d9c0e57:::benchmark_data_smithi037_101035_object118070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.466912+0000", 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0025296630000000001, 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031241089999999999, 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261931 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466912+0000", 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466912+0000", 2023-10-08T06:59:22.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466913+0000", 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0900000000000001e-07 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466916+0000", 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.146e-06 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466924+0000", 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3939999999999996e-06 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.466931+0000", 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4370000000000004e-06 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468362+0000", 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001430656 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468435+0000", 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3824000000000003e-05 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468499+0000", 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4008000000000001e-05 2023-10-08T06:59:22.514 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261932 5.5 5:ae7ae500:::benchmark_data_smithi037_101035_object118071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.467067+0000", 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0023751760000000001, 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030429519999999998, 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.515 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261932 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467067+0000", 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467067+0000", 2023-10-08T06:59:22.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467068+0000", 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4499999999999996e-07 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467072+0000", 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2950000000000004e-06 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467080+0000", 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4849999999999992e-06 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.467087+0000", 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8399999999999997e-06 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469056+0000", 2023-10-08T06:59:22.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019684619999999998 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469182+0000", 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000126821 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261934 5.3 5:cd88a785:::benchmark_data_smithi037_101035_object118073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.519 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.468636+0000", 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00080622099999999998, 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015455219999999999, 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261934 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468636+0000", 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468636+0000", 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468637+0000", 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.144e-06 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468644+0000", 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2629999999999997e-06 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468654+0000", 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8109999999999997e-06 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468663+0000", 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9870000000000005e-06 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.468995+0000", 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00033225600000000001 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469120+0000", 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012451399999999999 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.524 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261936 5.2 5:4ed9ff45:::benchmark_data_smithi037_101035_object118075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.469119+0000", 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00032311500000000001, 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00113126, 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.525 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261936 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469119+0000", 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469119+0000", 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469119+0000", 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999996e-07 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469123+0000", 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3919999999999999e-06 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469129+0000", 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5189999999999998e-06 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469134+0000", 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8130000000000003e-06 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469175+0000", 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0955999999999999e-05 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469257+0000", 2023-10-08T06:59:22.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729000000000003e-05 2023-10-08T06:59:22.530 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.530 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.530 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:261939 5.2 5.142d1162 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:22.469265+0000", 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00017717899999999999, 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001053107, 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:22.531 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 261939 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469265+0000", 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469265+0000", 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469265+0000", 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9100000000000003e-07 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469269+0000", 2023-10-08T06:59:22.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7440000000000001e-06 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469279+0000", 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3549999999999994e-06 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:22.469286+0000", 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9249999999999998e-06 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.534 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.535 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:22.535 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 12 2023-10-08T06:59:22.535 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:22.536 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:22.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:22.535+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:22.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:59:22.636 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:22.637+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:22.737 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:22.737+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:22.759 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:22.759 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:22.759 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:22.759 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:22.759 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:22.774 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:22.838 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:22.838+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:22.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:22.938+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:22.953 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:22.953 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:22.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:22.953 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:22.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.953 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.059814832000001, 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.954 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:22.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:22.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:22.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:22.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.963 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.058098530000002, 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.964 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:22.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:22.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:22.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:22.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.056280708999999, 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:22.972 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.973 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.973 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.973 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.973 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.973 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:22.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:22.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:22.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:22.980 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.054276412999997, 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.981 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:22.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:22.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.989 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.054160097, 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.990 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:22.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:22.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:22.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:22.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.046270149000001, 2023-10-08T06:59:22.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:22.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:23.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:23.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:23.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:23.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.486913858000001, 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.007 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.486152539000003, 2023-10-08T06:59:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.482236833000002, 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.482073952999997, 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.480410968999998, 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.480144516999999, 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.47738915, 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.048859423, 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.046502389, 2023-10-08T06:59:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.044995968999999, 2023-10-08T06:59:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.044787937999999, 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.044216719000001, 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.041957698000001, 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.041386575000001, 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:23.122 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:23.124 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:23.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:23.122+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:23.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:23.224+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:23.302 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:264207 5.b 5:d93b9a56:::benchmark_data_smithi037_101035_object120346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:23.299719+0000", 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021235690000000001, 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021512079999999999, 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 264207 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299719+0000", 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299719+0000", 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299720+0000", 2023-10-08T06:59:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8400000000000004e-07 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299723+0000", 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7170000000000002e-06 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299732+0000", 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9509999999999995e-06 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299739+0000", 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9090000000000003e-06 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299794+0000", 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5331999999999998e-05 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.299906+0000", 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111148 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:264202 5.d e62/32 5:bca70d91:::benchmark_data_smithi037_101035_object120341:head v 62'16176, mlcod=62'16172)", 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:23.300560+0000", 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00128265, 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001389333, 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300560+0000", 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300560+0000", 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300561+0000", 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4399999999999999e-07 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300567+0000", 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5599999999999999e-06 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300581+0000", 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3923e-05 2023-10-08T06:59:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300591+0000", 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3079999999999997e-06 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300646+0000", 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5019999999999998e-05 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300667+0000", 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1719e-05 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:264208 5.b 5:dcd2d07f:::benchmark_data_smithi037_101035_object120347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:23.300783+0000", 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001059946, 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012309459999999999, 2023-10-08T06:59:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 264208 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300783+0000", 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300783+0000", 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300783+0000", 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8699999999999995e-07 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300787+0000", 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.585e-06 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300796+0000", 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6879999999999994e-06 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.300804+0000", 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2320000000000004e-06 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301600+0000", 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00079654200000000002 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301683+0000", 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2783999999999999e-05 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:264212 5.d e62/32)", 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:23.301784+0000", 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.8063000000000003e-05, 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000291873, 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301784+0000", 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301784+0000", 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301785+0000", 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6599999999999996e-07 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301790+0000", 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.938e-06 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301799+0000", 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9209999999999998e-06 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301804+0000", 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2530000000000004e-06 2023-10-08T06:59:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:264213 5.f e62/20 5:f622e9a3:::benchmark_data_smithi037_101035_object120352:head v 62'16763, mlcod=62'16761)", 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:23.301822+0000", 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.1001000000000001e-05, 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031331799999999998, 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301822+0000", 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301822+0000", 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301822+0000", 2023-10-08T06:59:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301826+0000", 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0119999999999999e-06 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301831+0000", 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7709999999999997e-06 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301834+0000", 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1640000000000001e-06 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301870+0000", 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6093000000000002e-05 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301892+0000", 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1739e-05 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:264210 5.9 e62/20 5:92550e2e:::benchmark_data_smithi037_101035_object120349:head v 62'16451, mlcod=62'16449)", 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:23.301875+0000", 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9999676, 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032510900000000002, 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301875+0000", 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301875+0000", 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301875+0000", 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9699999999999995e-07 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301882+0000", 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3470000000000004e-06 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301894+0000", 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2271e-05 2023-10-08T06:59:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301901+0000", 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4240000000000004e-06 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301945+0000", 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3226999999999998e-05 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:23.301959+0000", 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3956e-05 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 6 2023-10-08T06:59:23.327 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:23.329 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:23.329 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:23.328+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:23.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:23.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:23.428+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:23.482 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:23.503 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:23.503 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:23.504 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:23.504 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:23.506 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:23.506 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:23.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:23.529+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:23.545 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:23.545 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:23.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:59:23.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:23.629+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:23.731 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:23.731+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:23.733 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:23.733 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:23.749 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:23.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:23.831+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:23.919 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:23.919 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:23.933 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:23.933+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:23.936 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:24.034 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:24.034+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:24.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:24.134+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:24.151 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:24.151 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:24.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:24.236 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:24.236+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:24.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:24.336+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:24.395 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:24.396 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:24.409 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:24.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:24.449+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:24.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:24.538+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:24.580 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:24.580 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:24.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:24.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:24.639+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:24.742 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:24.742+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:24.764 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:24.764 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:24.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:24.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:24.842+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:24.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:24.943+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:24.990 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:24.991 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:25.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:25.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:25.051+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:25.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:25.145+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:25.159 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:25.160 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:25.170 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:25.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:25.253+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:25.348 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:25.349+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:25.364 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:25.364 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:25.380 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:25.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:25.463+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:25.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:25.550 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:25.551+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:25.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:59:25.601 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:25.601 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:25.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:25.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:25.656+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:25.689 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:25.689 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:25.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:25.752+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:25.787 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:25.787 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:25.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.787 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:270315 5.4 5:2d7e6ad2:::benchmark_data_smithi037_101035_object126454:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:25.787 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.785394+0000", 2023-10-08T06:59:25.787 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00081205399999999999, 2023-10-08T06:59:25.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083210200000000004, 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 270315 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785394+0000", 2023-10-08T06:59:25.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785394+0000", 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785394+0000", 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1600000000000001e-07 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785398+0000", 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3100000000000001e-06 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785407+0000", 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7679999999999997e-06 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785414+0000", 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2590000000000003e-06 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785461+0000", 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7624999999999999e-05 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785609+0000", 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147851 2023-10-08T06:59:25.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:270301 5.a 5:5289a9c5:::benchmark_data_smithi037_101035_object126440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.780030+0000", 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0061761580000000002, 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062434259999999998, 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:25.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 270301 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780030+0000", 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780030+0000", 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780030+0000", 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6899999999999997e-07 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780034+0000", 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.126e-06 2023-10-08T06:59:25.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780046+0000", 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1824999999999999e-05 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780054+0000", 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9349999999999994e-06 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780112+0000", 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7362999999999999e-05 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780250+0000", 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013889499999999999 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.796 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:270302 5.0 5:0a5dbc4c:::benchmark_data_smithi037_101035_object126441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.780641+0000", 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0055644170000000003, 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056710789999999999, 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 270302 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780641+0000", 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780641+0000", 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780642+0000", 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8000000000000005e-07 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780647+0000", 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4549999999999997e-06 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780654+0000", 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7910000000000005e-06 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780662+0000", 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2250000000000003e-06 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780722+0000", 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0633e-05 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.780878+0000", 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000155742 2023-10-08T06:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:270305 5.0 5:093665fb:::benchmark_data_smithi037_101035_object126444:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.781068+0000", 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0051376199999999999, 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052813230000000001, 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.802 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 270305 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.781068+0000", 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.781068+0000", 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.781069+0000", 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9199999999999999e-07 2023-10-08T06:59:25.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.781073+0000", 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3390000000000003e-06 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.781094+0000", 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0908999999999999e-05 2023-10-08T06:59:25.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.781101+0000", 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6800000000000004e-06 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783076+0000", 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019752799999999998 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783220+0000", 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144182 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:270308 5.e 5:71d49016:::benchmark_data_smithi037_101035_object126447:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.783406+0000", 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002800266, 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029885419999999998, 2023-10-08T06:59:25.807 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 270308 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783406+0000", 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783406+0000", 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783406+0000", 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0999999999999998e-07 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783410+0000", 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9260000000000002e-06 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783418+0000", 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6690000000000006e-06 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783424+0000", 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6389999999999997e-06 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783469+0000", 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5200000000000001e-05 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783556+0000", 2023-10-08T06:59:25.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7441999999999994e-05 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:270309 5.d e63/32 5:b10ee0ca:::benchmark_data_smithi037_101035_object126448:head v 63'16527, mlcod=63'16524)", 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.783886+0000", 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0023198060000000002, 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025798079999999998, 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.812 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783886+0000", 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783886+0000", 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783887+0000", 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4600000000000004e-07 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783892+0000", 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0900000000000004e-06 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783903+0000", 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1282e-05 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783909+0000", 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5110000000000003e-06 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783953+0000", 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4125999999999997e-05 2023-10-08T06:59:25.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.783967+0000", 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4012000000000001e-05 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:270310 5.0 5:082f08cd:::benchmark_data_smithi037_101035_object126449:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.784070+0000", 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0021355189999999998, 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024676400000000001, 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 270310 2023-10-08T06:59:25.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784070+0000", 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784070+0000", 2023-10-08T06:59:25.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784071+0000", 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0800000000000004e-07 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784075+0000", 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5880000000000002e-06 2023-10-08T06:59:25.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784086+0000", 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.129e-05 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784093+0000", 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3379999999999999e-06 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784800+0000", 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00070653000000000003 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.784937+0000", 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013750399999999999 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:270312 5.f e63/20 5:f6a3c649:::benchmark_data_smithi037_101035_object126451:head v 63'17155, mlcod=63'17153)", 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:25.785381+0000", 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00082443800000000004, 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001231579, 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785381+0000", 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785381+0000", 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785382+0000", 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6100000000000001e-07 2023-10-08T06:59:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785387+0000", 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1309999999999997e-06 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785398+0000", 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0711e-05 2023-10-08T06:59:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785406+0000", 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6570000000000003e-06 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785451+0000", 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4322e-05 2023-10-08T06:59:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:25.785469+0000", 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8175000000000001e-05 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2023-10-08T06:59:25.827 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:25.828 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:25.871 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:25.871+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:25.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:25.953+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:26.000 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:26.000 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:26.016 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:26.057 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:26.057+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:26.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:26.155+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 97.364126162999995, 2023-10-08T06:59:26.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:26.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:26.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:26.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.238 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 97.361417943999996, 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:26.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:26.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.245 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 97.358425654000001, 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:26.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.343384791999995, 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:26.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:26.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:26.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:26.256 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.343281934999993, 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.343218641999997, 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.262 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:26.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.342945364000002, 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:26.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:26.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.273 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.339955321000005, 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:26.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.338604392999997, 2023-10-08T06:59:26.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:26.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:26.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.338465630000002, 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.285 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:26.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:26.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:26.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.338087165999994, 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.291 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:26.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:26.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:26.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.335925631999999, 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:26.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.327586749000005, 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:26.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:26.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 64.564157930999997, 2023-10-08T06:59:26.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:26.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 64.563613270000005, 2023-10-08T06:59:26.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:26.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:26.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 64.563525010999996, 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:26.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:26.325 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 64.563490584999997, 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:26.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 64.562396008999997, 2023-10-08T06:59:26.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:26.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:26.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:26.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:26.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 64.561872175999994, 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:26.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.343 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 64.560913954, 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:26.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:26.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:26.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:26.349 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:26.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:26.348+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:26.350 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:26.451 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:26.451+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:26.530 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272344 5.1 5:86d0fead:::benchmark_data_smithi037_101035_object128483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.521144+0000", 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0072862739999999997, 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073182880000000001, 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.531 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272344 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521144+0000", 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521144+0000", 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521144+0000", 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2999999999999999e-07 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521149+0000", 2023-10-08T06:59:26.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6020000000000002e-06 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521160+0000", 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1178999999999999e-05 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521168+0000", 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6290000000000001e-06 2023-10-08T06:59:26.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525221+0000", 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040530180000000002 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525341+0000", 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119768 2023-10-08T06:59:26.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272348 5.9 5:9be4e1c2:::benchmark_data_smithi037_101035_object128487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.521498+0000", 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0069320789999999998, 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070812189999999997, 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:26.536 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272348 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521498+0000", 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521498+0000", 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521498+0000", 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7300000000000005e-07 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521502+0000", 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7799999999999998e-06 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521509+0000", 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6050000000000003e-06 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.521514+0000", 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.87e-06 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525141+0000", 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036270460000000001 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526401+0000", 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012599930000000001 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526504+0000", 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102882 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.541 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272351 5.3 5:cb39749f:::benchmark_data_smithi037_101035_object128490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.522599+0000", 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0058309920000000001, 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060705619999999998, 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272351 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.522599+0000", 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.522599+0000", 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.522599+0000", 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5700000000000002e-07 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.522606+0000", 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8839999999999997e-06 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.522616+0000", 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.679e-06 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.522624+0000", 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.14e-06 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524933+0000", 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0023089669999999999 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525054+0000", 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012136799999999999 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272352 5.1 5:84f11601:::benchmark_data_smithi037_101035_object128491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.523105+0000", 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0053250750000000003, 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056416970000000002, 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.546 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272352 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523105+0000", 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523105+0000", 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523105+0000", 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3200000000000004e-07 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523110+0000", 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.143e-06 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523119+0000", 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2739999999999996e-06 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523126+0000", 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4939999999999997e-06 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526866+0000", 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037394640000000001 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526978+0000", 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011212199999999999 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272355 5.d 5:b95b467c:::benchmark_data_smithi037_101035_object128494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.524219+0000", 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0042103460000000002, 2023-10-08T06:59:26.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004607402, 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272355 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524219+0000", 2023-10-08T06:59:26.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524219+0000", 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524220+0000", 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8700000000000005e-07 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524223+0000", 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1420000000000002e-06 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524234+0000", 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0869e-05 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524240+0000", 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2609999999999999e-06 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524290+0000", 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9889999999999998e-05 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524434+0000", 2023-10-08T06:59:26.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000143955 2023-10-08T06:59:26.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.524550+0000", 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115536 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526471+0000", 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001921009 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.557 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272356 5.c 5:386b4086:::benchmark_data_smithi037_101035_object128495:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.525446+0000", 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0029834739999999998, 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034758240000000002, 2023-10-08T06:59:26.558 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272356 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525446+0000", 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525446+0000", 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525447+0000", 2023-10-08T06:59:26.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8100000000000001e-07 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525455+0000", 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0590000000000003e-06 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525466+0000", 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1038e-05 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525475+0000", 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4449999999999996e-06 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526344+0000", 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00086927800000000002 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526557+0000", 2023-10-08T06:59:26.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000213136 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272357 5.3 5:cbae23cb:::benchmark_data_smithi037_101035_object128496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.525494+0000", 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0029355319999999998, 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035058419999999999, 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.563 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272357 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525494+0000", 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525494+0000", 2023-10-08T06:59:26.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525495+0000", 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4000000000000002e-07 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525498+0000", 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0340000000000001e-06 2023-10-08T06:59:26.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525506+0000", 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4109999999999996e-06 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525513+0000", 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2030000000000003e-06 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526756+0000", 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001242115 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.526845+0000", 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9223999999999998e-05 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.567 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272359 5.2 5:4c519334:::benchmark_data_smithi037_101035_object128498:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.525622+0000", 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0028080259999999999, 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034619149999999999, 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272359 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525622+0000", 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525622+0000", 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525622+0000", 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9500000000000002e-07 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525627+0000", 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3229999999999999e-06 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525637+0000", 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0018e-05 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525644+0000", 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3420000000000002e-06 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525692+0000", 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8041999999999998e-05 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525830+0000", 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000138307 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.572 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272360 5.1 5:82f6775a:::benchmark_data_smithi037_101035_object128499:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.525669+0000", 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002760738, 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003491447, 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.573 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272360 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525669+0000", 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525669+0000", 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525670+0000", 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.61e-07 2023-10-08T06:59:26.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525673+0000", 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.021e-06 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525684+0000", 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1535000000000001e-05 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.525691+0000", 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6800000000000004e-06 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528735+0000", 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0030437329999999999 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528848+0000", 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011322799999999999 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272361 5.7 5:ea118f65:::benchmark_data_smithi037_101035_object128500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.527886+0000", 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00054339000000000004, 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001350953, 2023-10-08T06:59:26.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272361 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.527886+0000", 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.527886+0000", 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.527887+0000", 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6400000000000001e-07 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.527892+0000", 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2719999999999997e-06 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.527904+0000", 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1858000000000001e-05 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.527914+0000", 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2359999999999993e-06 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.527970+0000", 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6144000000000003e-05 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528099+0000", 2023-10-08T06:59:26.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000129035 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272362 5.d 5:b438a576:::benchmark_data_smithi037_101035_object128501:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.528097+0000", 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.000333247, 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012046820000000001, 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.583 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272362 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528097+0000", 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528097+0000", 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528097+0000", 2023-10-08T06:59:26.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6499999999999998e-07 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528105+0000", 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3409999999999997e-06 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528116+0000", 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1071e-05 2023-10-08T06:59:26.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528124+0000", 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8509999999999999e-06 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528169+0000", 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5775999999999997e-05 2023-10-08T06:59:26.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528283+0000", 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000113286 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528395+0000", 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011212799999999999 2023-10-08T06:59:26.589 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272363 5.2 5:40be504d:::benchmark_data_smithi037_101035_object128502:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.528143+0000", 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00028644800000000002, 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012396989999999999, 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.590 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272363 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528143+0000", 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528143+0000", 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528144+0000", 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7700000000000004e-07 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528147+0000", 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.112e-06 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528155+0000", 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1450000000000008e-06 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528162+0000", 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.421e-06 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528247+0000", 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5515999999999999e-05 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528366+0000", 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118997 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272365 5.1 5.4dc4b091 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.528179+0000", 2023-10-08T06:59:26.595 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00025086599999999998, 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012755640000000001, 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272365 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528179+0000", 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528179+0000", 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528180+0000", 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2399999999999998e-07 2023-10-08T06:59:26.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528182+0000", 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.852e-06 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528190+0000", 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8269999999999998e-06 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528197+0000", 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272366 5.f 5.bcf67f9f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.528911+0000", 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9995189, 2023-10-08T06:59:26.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00060729100000000004, 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272366 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528911+0000", 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528911+0000", 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528912+0000", 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5000000000000001e-07 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528916+0000", 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8219999999999997e-06 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528927+0000", 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0638e-05 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.528935+0000", 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9330000000000001e-06 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272368 5.3 5:c6ec0b9f:::benchmark_data_smithi037_101035_object128507:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.529226+0000", 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9992042, 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000362863, 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.603 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272368 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529226+0000", 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529226+0000", 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529227+0000", 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3200000000000004e-07 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529231+0000", 2023-10-08T06:59:26.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1710000000000004e-06 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529244+0000", 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2863e-05 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529251+0000", 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3529999999999997e-06 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529300+0000", 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8761999999999998e-05 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.529434+0000", 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000134263 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:272341 5.1 5:8eac0c88:::benchmark_data_smithi037_101035_object128480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:26.519496+0000", 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0089335760000000004, 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010167898999999999, 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 272341 2023-10-08T06:59:26.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.519496+0000", 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.519496+0000", 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.519497+0000", 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7400000000000003e-07 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.519500+0000", 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1580000000000001e-06 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:26.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.519508+0000", 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0609999999999996e-06 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.519515+0000", 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7710000000000001e-06 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523117+0000", 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036021809999999999 2023-10-08T06:59:26.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:26.523270+0000", 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015275799999999999 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 16 2023-10-08T06:59:26.612 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:26.614 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:26.613+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:59:26.615 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:26.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:26.713+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:26.805 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:26.805 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:26.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:26.815+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:26.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:26.916 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:26.916+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:27.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:27.016+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:27.045 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.151316127000001, 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:27.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.149599824999996, 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.055 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:27.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.147782004000007, 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:27.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:27.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.145777707999997, 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:27.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:27.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:27.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.075 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.145661391999994, 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.076 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:27.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:27.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:27.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:27.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:27.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:27.083 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.137771443999995, 2023-10-08T06:59:27.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:27.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:27.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.578415152999995, 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:27.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:27.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.577653834000003, 2023-10-08T06:59:27.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:27.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:27.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.573738128000002, 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:27.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.573575247999997, 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:27.113 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:27.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:27.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:27.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.571912264000005, 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:27.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:27.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:27.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.571645812, 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.126 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:27.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.131 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.568890444999994, 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.132 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:27.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:27.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.137 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.140360718, 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.138 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:27.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:27.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:27.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.138003684000001, 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.145 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:27.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:27.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.136497263999999, 2023-10-08T06:59:27.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:27.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:27.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.136289232999999, 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:27.157 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:27.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:27.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:27.163 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.135718013999998, 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.164 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:27.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:27.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.170 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.133458993000001, 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:27.171 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:27.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:27.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.132887870000001, 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:27.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:27.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.183 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:27.183 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:27.183 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:27.184 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:27.184+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:27.185 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:27.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~71s 2023-10-08T06:59:27.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:27.284+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:27.354 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:274644 5.e 5:7c7f71b4:::benchmark_data_smithi037_101035_object130783:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T06:59:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:27.349785+0000", 2023-10-08T06:59:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0039915009999999997, 2023-10-08T06:59:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040170420000000002, 2023-10-08T06:59:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 274644 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349785+0000", 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349785+0000", 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349786+0000", 2023-10-08T06:59:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5000000000000002e-07 2023-10-08T06:59:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349790+0000", 2023-10-08T06:59:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9700000000000001e-06 2023-10-08T06:59:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349799+0000", 2023-10-08T06:59:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2779999999999999e-06 2023-10-08T06:59:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349806+0000", 2023-10-08T06:59:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3799999999999999e-06 2023-10-08T06:59:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349854+0000", 2023-10-08T06:59:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8798000000000003e-05 2023-10-08T06:59:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.349955+0000", 2023-10-08T06:59:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010019200000000001 2023-10-08T06:59:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:274640 5.f e64/20 5:ff64e522:::benchmark_data_smithi037_101035_object130779:head v 64'17404, mlcod=64'17400)", 2023-10-08T06:59:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:27.351103+0000", 2023-10-08T06:59:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002673932, 2023-10-08T06:59:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027724719999999998, 2023-10-08T06:59:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351103+0000", 2023-10-08T06:59:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351103+0000", 2023-10-08T06:59:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351104+0000", 2023-10-08T06:59:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8599999999999998e-07 2023-10-08T06:59:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351109+0000", 2023-10-08T06:59:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7660000000000004e-06 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351124+0000", 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5007999999999999e-05 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351131+0000", 2023-10-08T06:59:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8600000000000004e-06 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351180+0000", 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8402999999999997e-05 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.351200+0000", 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0778999999999999e-05 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:274649 5.a 5:5905d7ab:::benchmark_data_smithi037_101035_object130788:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:27.352485+0000", 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0012922330000000001, 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145177, 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 274649 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352485+0000", 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352485+0000", 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352485+0000", 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2799999999999996e-07 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352489+0000", 2023-10-08T06:59:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0419999999999996e-06 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352500+0000", 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0437e-05 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352506+0000", 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8880000000000002e-06 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352548+0000", 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2451999999999999e-05 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:27.352630+0000", 2023-10-08T06:59:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2238999999999996e-05 2023-10-08T06:59:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 3 2023-10-08T06:59:27.374 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:27.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:27.419 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:27.418+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:27.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:27.486+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:27.552 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:27.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:27.552 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:27.552 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:27.553 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:27.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:27.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:27.586+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:27.689 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:27.688+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:27.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:27.786 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:27.786 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:27.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:27.787 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:27.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.787 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:27.787 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:27.787 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.918147168999994, 2023-10-08T06:59:27.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:27.788 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.788 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.788 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.788 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.789 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.789 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:27.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.789 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:27.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:27.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:27.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:27.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:27.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:27.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:27.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:27.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:27.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:27.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:27.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.915438949999995, 2023-10-08T06:59:27.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:27.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:27.805 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.912446660000001, 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:27.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.810 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.897405797999994, 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:27.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:27.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:27.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:27.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:27.819 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.897302941000007, 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:27.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:27.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.825 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.897239647999996, 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.826 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:27.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:27.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:27.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:27.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:27.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:27.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:27.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:27.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:27.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:27.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:27.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:27.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:27.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:27.835 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.835 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.835 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.896966370000001, 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:27.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:27.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.893976327000004, 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:27.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:27.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.892625398999996, 2023-10-08T06:59:27.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:27.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.892486636000001, 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:27.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:27.861 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.892108171999993, 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:27.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:27.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:27.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:27.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.866 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.889946637999998, 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:27.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.881607755000005, 2023-10-08T06:59:27.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:27.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:27.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:27.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:27.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:27.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:27.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:27.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:27.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:27.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:27.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:27.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:27.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:27.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.118178936999996, 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:27.882 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:27.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:27.887 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.117634276000004, 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.888 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:27.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.117546016999995, 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:27.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:27.899 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.117511590999996, 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:27.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:27.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.116417014999996, 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:27.904 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:27.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:27.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.115893181999994, 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:27.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:27.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.915 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.114934959999999, 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:27.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:27.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:27.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.920 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:27.921 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:27.921 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:27.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:27.921+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:27.923 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:27.923 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:27.924 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:27.924 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:27.925 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:28.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:28.023+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:28.100 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:28.100 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:28.115 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:28.124 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:28.124+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:28.226 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:28.225+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:28.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:28.327+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:28.335 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:28.335 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:28.348 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:28.428 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:28.427+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:28.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:28.528+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:28.566 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:28.566 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:28.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:28.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T06:59:28.629 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:28.628+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:28.730 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:28.729+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:28.753 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:28.753 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:28.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:28.851 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:28.850+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:28.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:28.932+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:28.979 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:28.979 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:28.992 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:29.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:29.033+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:29.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:29.134+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:29.205 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:29.205 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:29.219 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:29.235 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:29.234+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:29.336 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:29.335+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:29.394 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:29.394 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:29.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:29.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:29.454+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:29.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:29.537+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:29.581 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2023-10-08T06:59:29.586 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:29.587 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:29.601 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:29.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:29.642+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:29.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:29.740+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:29.825 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:29.825 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:29.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:29.842 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:29.840+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:29.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:29.942 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:29.941+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:30.018 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:30.019 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:30.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:30.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.042+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:30.096 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:30.097 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:30.097 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:30.097 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:30.099 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:30.100 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:30.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.143+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:30.243 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:30.244 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:30.244 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:30.244 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:30.244 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:30.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.244+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:30.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:30.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.344+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:30.432 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 101.56489945, 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 101.562191231, 2023-10-08T06:59:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 101.55919894100001, 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.544158078999999, 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.544055221999997, 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.543991929000001, 2023-10-08T06:59:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.543718651000006, 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.540728607999995, 2023-10-08T06:59:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.539377680000001, 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.539238917000006, 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.538860452999998, 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.536698919000003, 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.528360035999995, 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 68.764931218000001, 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 68.764386556999995, 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 68.764298298, 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 68.764263872000001, 2023-10-08T06:59:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:30.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:30.539 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 68.763169296000001, 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:30.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:30.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 68.762645462999998, 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:30.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:30.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 68.761687241000004, 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:30.551 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:30.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:30.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:30.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:30.556 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:30.558 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:30.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.557+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:30.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.658+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:30.738 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:30.738 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:30.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.738 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283835 5.2 5:4f6a021e:::benchmark_data_smithi037_101035_object139974:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.738 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.732840+0000", 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0042100410000000003, 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042288459999999996, 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283835 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.732840+0000", 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.732840+0000", 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.732841+0000", 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7000000000000005e-07 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.732843+0000", 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3760000000000002e-06 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.732850+0000", 2023-10-08T06:59:30.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7710000000000001e-06 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.732856+0000", 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.604e-06 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734741+0000", 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018852840000000001 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734875+0000", 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013410700000000001 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283837 5.5 5:a1f04567:::benchmark_data_smithi037_101035_object139976:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.734228+0000", 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0028225630000000002, 2023-10-08T06:59:30.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0028937390000000002, 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283837 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734228+0000", 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734228+0000", 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734229+0000", 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3399999999999999e-07 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734232+0000", 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0970000000000002e-06 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734240+0000", 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5469999999999997e-06 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734245+0000", 2023-10-08T06:59:30.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9810000000000003e-06 2023-10-08T06:59:30.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734549+0000", 2023-10-08T06:59:30.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000303493 2023-10-08T06:59:30.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734639+0000", 2023-10-08T06:59:30.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0501999999999995e-05 2023-10-08T06:59:30.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.749 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.750 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283838 5.9 5:98846ee4:::benchmark_data_smithi037_101035_object139977:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.750 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.734255+0000", 2023-10-08T06:59:30.750 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0027957310000000001, 2023-10-08T06:59:30.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029123180000000001, 2023-10-08T06:59:30.751 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.751 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:30.751 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.751 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.751 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.752 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283838 2023-10-08T06:59:30.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.752 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734255+0000", 2023-10-08T06:59:30.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734255+0000", 2023-10-08T06:59:30.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734255+0000", 2023-10-08T06:59:30.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3599999999999999e-07 2023-10-08T06:59:30.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734257+0000", 2023-10-08T06:59:30.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6619999999999999e-06 2023-10-08T06:59:30.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734262+0000", 2023-10-08T06:59:30.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1379999999999998e-06 2023-10-08T06:59:30.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734265+0000", 2023-10-08T06:59:30.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4000000000000001e-06 2023-10-08T06:59:30.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734298+0000", 2023-10-08T06:59:30.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2858999999999998e-05 2023-10-08T06:59:30.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734426+0000", 2023-10-08T06:59:30.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012752099999999999 2023-10-08T06:59:30.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:30.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734533+0000", 2023-10-08T06:59:30.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000107706 2023-10-08T06:59:30.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:30.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.736952+0000", 2023-10-08T06:59:30.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024181379999999998 2023-10-08T06:59:30.762 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.762 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.762 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.763 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283839 5.d 5:b547258b:::benchmark_data_smithi037_101035_object139978:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.763 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.734273+0000", 2023-10-08T06:59:30.763 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0027777449999999999, 2023-10-08T06:59:30.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0029623649999999998, 2023-10-08T06:59:30.764 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2023-10-08T06:59:30.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.764 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.765 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283839 2023-10-08T06:59:30.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.765 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734273+0000", 2023-10-08T06:59:30.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734273+0000", 2023-10-08T06:59:30.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734273+0000", 2023-10-08T06:59:30.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1199999999999999e-07 2023-10-08T06:59:30.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734275+0000", 2023-10-08T06:59:30.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.513e-06 2023-10-08T06:59:30.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734278+0000", 2023-10-08T06:59:30.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7299999999999999e-06 2023-10-08T06:59:30.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734281+0000", 2023-10-08T06:59:30.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7190000000000001e-06 2023-10-08T06:59:30.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734542+0000", 2023-10-08T06:59:30.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000260869 2023-10-08T06:59:30.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734655+0000", 2023-10-08T06:59:30.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011341300000000001 2023-10-08T06:59:30.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:30.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.734759+0000", 2023-10-08T06:59:30.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103607 2023-10-08T06:59:30.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:30.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.736912+0000", 2023-10-08T06:59:30.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021534000000000002 2023-10-08T06:59:30.776 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.776 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.776 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.777 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283842 5.9 5:95c81ba8:::benchmark_data_smithi037_101035_object139981:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.777 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.737118+0000", 2023-10-08T06:59:30.777 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9999323, 2023-10-08T06:59:30.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000220261, 2023-10-08T06:59:30.777 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.778 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:30.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.778 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.778 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283842 2023-10-08T06:59:30.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.779 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737118+0000", 2023-10-08T06:59:30.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737118+0000", 2023-10-08T06:59:30.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737119+0000", 2023-10-08T06:59:30.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:30.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737123+0000", 2023-10-08T06:59:30.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5300000000000001e-06 2023-10-08T06:59:30.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737131+0000", 2023-10-08T06:59:30.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7169999999999997e-06 2023-10-08T06:59:30.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737138+0000", 2023-10-08T06:59:30.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9469999999999997e-06 2023-10-08T06:59:30.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737177+0000", 2023-10-08T06:59:30.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9053e-05 2023-10-08T06:59:30.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737264+0000", 2023-10-08T06:59:30.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6347999999999994e-05 2023-10-08T06:59:30.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.786 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.787 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283845 5.5 5:a1c3af03:::benchmark_data_smithi037_101035_object139984:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.787 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.737171+0000", 2023-10-08T06:59:30.787 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9998798, 2023-10-08T06:59:30.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000260122, 2023-10-08T06:59:30.787 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.787 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:30.788 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.788 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.788 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.788 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283845 2023-10-08T06:59:30.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.788 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737171+0000", 2023-10-08T06:59:30.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737171+0000", 2023-10-08T06:59:30.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737172+0000", 2023-10-08T06:59:30.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3300000000000001e-07 2023-10-08T06:59:30.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737175+0000", 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.016e-06 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737183+0000", 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4600000000000003e-06 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737190+0000", 2023-10-08T06:59:30.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2089999999999999e-06 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737239+0000", 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8783999999999999e-05 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737373+0000", 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013393199999999999 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.793 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283846 5.3 5:c238304e:::benchmark_data_smithi037_101035_object139985:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.737209+0000", 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9998412, 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00031519399999999998, 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.794 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283846 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737209+0000", 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737209+0000", 2023-10-08T06:59:30.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737210+0000", 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3e-07 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737213+0000", 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8959999999999999e-06 2023-10-08T06:59:30.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737220+0000", 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2649999999999999e-06 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737227+0000", 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1980000000000004e-06 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737274+0000", 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6201e-05 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737366+0000", 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2063000000000003e-05 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:283847 5.1 5:82fd64d9:::benchmark_data_smithi037_101035_object139986:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:30.737240+0000", 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9998102, 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00037726900000000001, 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 283847 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.799 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737240+0000", 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737240+0000", 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737241+0000", 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2799999999999996e-07 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737243+0000", 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3300000000000001e-06 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:30.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737250+0000", 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3929999999999996e-06 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737255+0000", 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4879999999999998e-06 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737292+0000", 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6918000000000001e-05 2023-10-08T06:59:30.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:30.737402+0000", 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000109691 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 8 2023-10-08T06:59:30.803 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:30.805 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:30.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.804+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:30.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:30.905+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:31.006 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:31.005+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:31.027 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:31.027 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:31.027 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:31.027 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:31.027 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:31.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:31.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:31.125+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:31.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:31.208+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:31.264 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.370883235999997, 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.369166934000006, 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.272 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.274 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.274 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:31.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.274 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:31.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:31.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:31.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:31.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:31.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:31.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:31.282 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.367349113000003, 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:31.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:31.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:31.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:31.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:31.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:31.289 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.289 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.365344816999993, 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.290 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:31.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:31.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:31.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:31.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:31.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:31.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:31.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:31.299 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.365228501000004, 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.300 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:31.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:31.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.306 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.357338553000005, 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.307 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:31.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:31.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:31.313 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.797982262000005, 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:31.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:31.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:31.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.797220942999999, 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.320 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:31.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:31.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:31.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.793305236999998, 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.327 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:31.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.332 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.793142356999994, 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.333 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:31.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.791479373000001, 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:31.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:31.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.344 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.791212920999996, 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:31.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:31.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.788457554000004, 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.351 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:31.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.359927827, 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:31.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:31.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:31.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.363 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.357570793000001, 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.364 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:31.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.370 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.356064372999999, 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:31.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:31.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:31.376 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.355856341999999, 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:31.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:31.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.355285123000002, 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:31.382 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:31.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:31.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.388 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.353026102000001, 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:31.389 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:31.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.395 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.352454979000001, 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:31.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:31.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:31.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:31.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.400 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:31.400 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:31.400 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:31.401 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:31.400+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:31.402 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:31.502 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:31.502+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:31.578 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:31.578 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:31.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.578 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:286068 5.0 5:0145e3a1:::benchmark_data_smithi037_101035_object142207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:31.578 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.567989+0000", 2023-10-08T06:59:31.578 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0083627900000000002, 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0083818910000000007, 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 286068 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.567989+0000", 2023-10-08T06:59:31.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.567989+0000", 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.567990+0000", 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2300000000000001e-07 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.567993+0000", 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4020000000000002e-06 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.568001+0000", 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5569999999999998e-06 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.568006+0000", 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1070000000000004e-06 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571256+0000", 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032502020000000002 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:31.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571347+0000", 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0428999999999998e-05 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:286077 5.0 5:0dbfdafb:::benchmark_data_smithi037_101035_object142216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.571440+0000", 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.004912474, 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004977909, 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.583 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 286077 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571440+0000", 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571440+0000", 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571441+0000", 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.192e-06 2023-10-08T06:59:31.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571445+0000", 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3050000000000003e-06 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571455+0000", 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8700000000000004e-06 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.571463+0000", 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1270000000000003e-06 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.572528+0000", 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010650589999999999 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:31.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.572609+0000", 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0716000000000004e-05 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:286080 5.e 5:76cec98e:::benchmark_data_smithi037_101035_object142219:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.573237+0000", 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0031154500000000001, 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032197020000000001, 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.588 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 286080 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573237+0000", 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573237+0000", 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573237+0000", 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4700000000000001e-07 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573241+0000", 2023-10-08T06:59:31.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6799999999999999e-06 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573251+0000", 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0122000000000001e-05 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573257+0000", 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2800000000000003e-06 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573297+0000", 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0877000000000002e-05 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.573375+0000", 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8102000000000005e-05 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:286086 5.0 5:089e0319:::benchmark_data_smithi037_101035_object142225:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.575432+0000", 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00092018700000000004, 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00106364, 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 286086 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575432+0000", 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575432+0000", 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575433+0000", 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7599999999999997e-07 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575436+0000", 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8079999999999998e-06 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575447+0000", 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0338e-05 2023-10-08T06:59:31.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575452+0000", 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.412e-06 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575498+0000", 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5597999999999999e-05 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:31.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575624+0000", 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012595999999999999 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:286087 5.a 5:5fb53a1d:::benchmark_data_smithi037_101035_object142226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.575465+0000", 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00088689200000000002, 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001068109, 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.597 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 286087 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575465+0000", 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575465+0000", 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575466+0000", 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4400000000000001e-07 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575468+0000", 2023-10-08T06:59:31.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.446e-06 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575475+0000", 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.584e-06 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575480+0000", 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6019999999999999e-06 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575546+0000", 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5357000000000005e-05 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575713+0000", 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016761799999999999 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:286088 5.a 5.6845ba4a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.575493+0000", 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00085883599999999997, 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010751129999999999, 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.602 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 286088 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575493+0000", 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575493+0000", 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575494+0000", 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2100000000000002e-07 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575496+0000", 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1469999999999999e-06 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575502+0000", 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.003e-06 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575507+0000", 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2129999999999999e-06 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.605 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:286089 5.a 5.54fea44a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.575526+0000", 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00082600000000000002, 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010714450000000001, 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 286089 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575526+0000", 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575526+0000", 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575527+0000", 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8599999999999998e-07 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575529+0000", 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7980000000000001e-06 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575536+0000", 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7209999999999997e-06 2023-10-08T06:59:31.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575541+0000", 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.096e-06 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.609 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:286084 5.9 e65/20 5:9caa3206:::benchmark_data_smithi037_101035_object142223:head v 65'17849, mlcod=65'17847)", 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.575646+0000", 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00070604999999999995, 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098199000000000008, 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575646+0000", 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575646+0000", 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575647+0000", 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5400000000000001e-07 2023-10-08T06:59:31.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575652+0000", 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0350000000000001e-06 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575660+0000", 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0129999999999993e-06 2023-10-08T06:59:31.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575665+0000", 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6119999999999998e-06 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575713+0000", 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7824000000000002e-05 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575733+0000", 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9658999999999999e-05 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:286085 5.d e65/32 5:b3c7ad4e:::benchmark_data_smithi037_101035_object142224:head v 65'17446, mlcod=65'17444)", 2023-10-08T06:59:31.614 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:59:31.575679+0000", 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00067271599999999996, 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098478099999999989, 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575679+0000", 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575679+0000", 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575680+0000", 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0900000000000001e-07 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:31.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575682+0000", 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5900000000000002e-06 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575687+0000", 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0150000000000003e-06 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575691+0000", 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2909999999999999e-06 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575725+0000", 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4099e-05 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:59:31.575744+0000", 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9293999999999999e-05 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:31.619 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2023-10-08T06:59:31.619 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 9 2023-10-08T06:59:31.619 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:31.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:59:31.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:31.620+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:31.621 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:31.721 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:31.721+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:31.823 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:31.822+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:31.834 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:31.834 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:31.834 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:31.834 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:31.834 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:31.849 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:31.933 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:31.932+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:32.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:32.025+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:32.069 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:32.069 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:32.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:32.069 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:32.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.20202450399999, 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:32.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:32.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:32.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:32.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.19931628499999, 2023-10-08T06:59:32.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:32.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:32.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.196323995, 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:32.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:32.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.181283132999994, 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.091 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:32.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:32.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.181180276000006, 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:32.097 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:32.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:32.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:32.103 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.181116982999995, 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:32.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:32.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.109 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.180843705000001, 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:32.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:32.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.115 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.177853662000004, 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:32.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:32.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:32.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.121 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.176502733999996, 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:32.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:32.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:32.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:32.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.176363971000001, 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:32.128 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:32.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:32.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.175985506999993, 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:32.134 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:32.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:32.139 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.173823972999998, 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:32.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.165485090000004, 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:32.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:32.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.402056271999996, 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:32.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.401511611000004, 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:32.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:32.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.162 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.401423351999995, 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.163 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:32.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.401388925999996, 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:32.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:32.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.400294349999996, 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:32.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:32.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.399770516999993, 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.180 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:32.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:32.186 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.398812294999999, 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:32.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:32.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.192 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:32.192 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:32.192 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:32.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:32.195 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Removed 143858 objects 2023-10-08T06:59:32.195 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Clean up completed and total clean up time :51.8173 2023-10-08T06:59:32.195 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:32.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:32.194+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:32.295 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:32.294+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:32.327 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:32.327 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2023-10-08T06:59:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:32.335 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:32.340 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:32.360 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:32.363 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:32.364 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:32.396 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:32.395+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:32.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:32.498 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:32.497+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:59:32.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:32.599+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:32.600 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:32.600 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:32.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:32.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:32.700+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:32.789 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:32.789 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:32.799 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:32.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:32.801+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:32.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:32.902+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:32.927 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:32.927 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:32.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:33.003 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:33.002+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:33.066 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:33.067 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:33.077 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:33.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~77s 2023-10-08T06:59:33.118 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:33.117+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:33.205 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:33.204+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:33.217 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:33.217 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:33.229 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:33.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:33.306+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:33.359 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:33.360 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:33.370 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:33.406 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:33.406+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:33.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:33.507+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:33.538 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:33.538 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:33.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:33.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:33.609+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:33.682 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:33.682 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:33.692 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:33.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:33.709+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:33.810 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:33.809+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:33.819 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:33.819 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:33.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:33.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:33.911+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:33.997 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:33.997 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:34.007 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:34.012 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:34.011+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:34.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:34.113+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:34.149 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:34.149 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:34.160 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:34.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:34.244+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:34.314 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:34.314+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:34.330 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:34.330 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:34.340 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:34.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T06:59:34.416 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:34.415+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:34.509 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:34.510 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:34.516 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:34.515+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:34.520 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:34.528 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:34.549 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:34.549 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T06:59:34.550 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T06:59:34.550 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:34.552 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:34.553 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:34.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:59:34.617 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:34.616+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:34.652 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:34.652 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:34.652 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2023-10-08T06:59:34.652 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:34.662 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:34.746 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:34.745+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:34.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:34.820+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:34.828 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:34.829 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:34.829 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:34.829 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:34.829 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:34.839 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:34.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:34.921+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:35.007 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.14082583, 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:35.008 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:35.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:35.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:35.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.138117611, 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:35.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:35.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:35.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.135125321, 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:35.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:35.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.120084458999997, 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.029 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:35.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:35.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.035 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.119981601999996, 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.036 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.119918308999999, 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:35.042 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:35.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.048 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.119645031000005, 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.049 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:35.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:35.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.055 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.116654987999993, 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:35.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:35.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.11530406, 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.063 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:35.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:35.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.115165297000004, 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.069 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:35.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:35.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:35.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:35.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:35.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:35.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.114786832999997, 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:35.076 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:35.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:35.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.081 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.112625299000001, 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.082 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:35.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:35.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.087 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.104286415999994, 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:35.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 73.340857597999999, 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:35.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:35.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:35.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:35.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 73.340312936999993, 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:35.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:35.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.108 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 73.340224677999998, 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.109 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:35.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:35.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:35.115 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 73.340190251999999, 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 73.339095675999999, 2023-10-08T06:59:35.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:35.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:35.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:35.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:35.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.127 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 73.338571842999997, 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:35.128 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:35.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:35.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 73.337613621000003, 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.135 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:35.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:35.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:35.140 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:35.141 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:35.142 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:35.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:35.142+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:35.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:35.243+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:35.283 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:35.283 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:35.284 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2023-10-08T06:59:35.284 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:35.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:35.344 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:35.344+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:35.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:35.445+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:35.463 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2023-10-08T06:59:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2023-10-08T06:59:35.464 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:35.474 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:35.546 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:35.546+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:59:35.644 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:35.644 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2023-10-08T06:59:35.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2023-10-08T06:59:35.644 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2023-10-08T06:59:35.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.644 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95190 5.d 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.751455926000006, 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074269096000000007, 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95190 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.645 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890767+0000", 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890873+0000", 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000105933 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890883+0000", 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.302e-06 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890891+0000", 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999994e-06 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.890937+0000", 2023-10-08T06:59:35.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6208999999999998e-05 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891040+0000", 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102728 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.891165+0000", 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012532600000000001 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.895906+0000", 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047407830000000001 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964980+0000", 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069074382000000004 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965013+0000", 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2209000000000003e-05 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965036+0000", 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3303e-05 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95195 5.d 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.749739624, 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074230946000000006, 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95195 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.652 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892483+0000", 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892484+0000", 2023-10-08T06:59:35.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2299999999999999e-07 2023-10-08T06:59:35.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892556+0000", 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1913000000000001e-05 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892566+0000", 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0524e-05 2023-10-08T06:59:35.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.892572+0000", 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1989999999999997e-06 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893131+0000", 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055972400000000005 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893225+0000", 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3292000000000001e-05 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.893326+0000", 2023-10-08T06:59:35.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000101456 2023-10-08T06:59:35.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.898410+0000", 2023-10-08T06:59:35.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050838599999999999 2023-10-08T06:59:35.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966609+0000", 2023-10-08T06:59:35.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068199010000000004 2023-10-08T06:59:35.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966672+0000", 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3099e-05 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.966714+0000", 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1946000000000001e-05 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95196 5.9 5:986ba3f5:::benchmark_data_smithi037_101035_object95195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:35.662 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.747921802999997, 2023-10-08T06:59:35.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075194762999999998, 2023-10-08T06:59:35.662 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.662 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.663 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95196 2023-10-08T06:59:35.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.663 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:35.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894301+0000", 2023-10-08T06:59:35.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894302+0000", 2023-10-08T06:59:35.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6199999999999997e-07 2023-10-08T06:59:35.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894371+0000", 2023-10-08T06:59:35.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8924000000000006e-05 2023-10-08T06:59:35.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894392+0000", 2023-10-08T06:59:35.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1041000000000001e-05 2023-10-08T06:59:35.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894397+0000", 2023-10-08T06:59:35.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5010000000000004e-06 2023-10-08T06:59:35.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894443+0000", 2023-10-08T06:59:35.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6127000000000001e-05 2023-10-08T06:59:35.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894582+0000", 2023-10-08T06:59:35.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013846799999999999 2023-10-08T06:59:35.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.894747+0000", 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00016494 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904061+0000", 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0093145859999999997 2023-10-08T06:59:35.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969430+0000", 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065368984000000005 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969474+0000", 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3739999999999998e-05 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969496+0000", 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1690000000000001e-05 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.672 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95201 5.9 5:93d6be4a:::benchmark_data_smithi037_101035_object95200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.745917507000001, 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073259849000000002, 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95201 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896305+0000", 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896306+0000", 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1399999999999997e-07 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896362+0000", 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6716999999999999e-05 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896370+0000", 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2470000000000002e-06 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896375+0000", 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0749999999999997e-06 2023-10-08T06:59:35.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896724+0000", 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00034905199999999998 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896843+0000", 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011879099999999999 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896985+0000", 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000142013 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904066+0000", 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070815849999999996 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969521+0000", 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065454393 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969546+0000", 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5873000000000001e-05 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969565+0000", 2023-10-08T06:59:35.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8589000000000001e-05 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95202 5.f 5:fe3a7ddf:::benchmark_data_smithi037_101035_object95201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.745801190999998, 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.068608450000000001, 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.680 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95202 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896421+0000", 2023-10-08T06:59:35.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896422+0000", 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896493+0000", 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0932999999999993e-05 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896498+0000", 2023-10-08T06:59:35.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0629999999999996e-06 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896501+0000", 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5449999999999999e-06 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896548+0000", 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6631000000000001e-05 2023-10-08T06:59:35.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896669+0000", 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012050299999999999 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.896799+0000", 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013067499999999999 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.903963+0000", 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071641589999999998 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.964970+0000", 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.061006460999999998 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965007+0000", 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7058000000000003e-05 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.965030+0000", 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2971000000000001e-05 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.688 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:95205 5.9 5:971368f7:::benchmark_data_smithi037_101035_object95204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:35.688 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:35.688 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.737911242999999, 2023-10-08T06:59:35.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065322161000000004, 2023-10-08T06:59:35.688 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.689 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.689 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.689 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.689 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.689 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 95205 2023-10-08T06:59:35.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.690 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:35.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904311+0000", 2023-10-08T06:59:35.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904312+0000", 2023-10-08T06:59:35.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2023-10-08T06:59:35.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904367+0000", 2023-10-08T06:59:35.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4676000000000003e-05 2023-10-08T06:59:35.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904376+0000", 2023-10-08T06:59:35.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6330000000000008e-06 2023-10-08T06:59:35.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904382+0000", 2023-10-08T06:59:35.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6250000000000004e-06 2023-10-08T06:59:35.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904423+0000", 2023-10-08T06:59:35.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0608999999999997e-05 2023-10-08T06:59:35.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904516+0000", 2023-10-08T06:59:35.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3517000000000006e-05 2023-10-08T06:59:35.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.904612+0000", 2023-10-08T06:59:35.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5619999999999996e-05 2023-10-08T06:59:35.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.909372+0000", 2023-10-08T06:59:35.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047606849999999997 2023-10-08T06:59:35.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969586+0000", 2023-10-08T06:59:35.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060213573999999999 2023-10-08T06:59:35.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969612+0000", 2023-10-08T06:59:35.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5751000000000001e-05 2023-10-08T06:59:35.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:19.969634+0000", 2023-10-08T06:59:35.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1810999999999998e-05 2023-10-08T06:59:35.701 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.701 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.701 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98829 5.f 5:fad07f53:::benchmark_data_smithi037_101035_object98828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.178554951999999, 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.070380592000000006, 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.703 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.703 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.703 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.703 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98829 2023-10-08T06:59:35.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.703 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:35.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463668+0000", 2023-10-08T06:59:35.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:35.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463772+0000", 2023-10-08T06:59:35.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103279 2023-10-08T06:59:35.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463783+0000", 2023-10-08T06:59:35.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1705999999999999e-05 2023-10-08T06:59:35.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.463792+0000", 2023-10-08T06:59:35.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6340000000000007e-06 2023-10-08T06:59:35.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464715+0000", 2023-10-08T06:59:35.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00092298900000000004 2023-10-08T06:59:35.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464803+0000", 2023-10-08T06:59:35.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8338999999999996e-05 2023-10-08T06:59:35.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464901+0000", 2023-10-08T06:59:35.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7782999999999995e-05 2023-10-08T06:59:35.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468159+0000", 2023-10-08T06:59:35.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003257865 2023-10-08T06:59:35.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533969+0000", 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065809716000000004 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534021+0000", 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2327999999999998e-05 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534048+0000", 2023-10-08T06:59:35.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7185000000000001e-05 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98831 5.f 5:fdacafd5:::benchmark_data_smithi037_101035_object98830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.177793632999993, 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.069738833, 2023-10-08T06:59:35.714 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98831 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464429+0000", 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464430+0000", 2023-10-08T06:59:35.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0299999999999998e-07 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464505+0000", 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4929e-05 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464516+0000", 2023-10-08T06:59:35.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.166e-05 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.464523+0000", 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0350000000000004e-06 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466241+0000", 2023-10-08T06:59:35.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017172839999999999 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466341+0000", 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0001 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.466479+0000", 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013833500000000001 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066980679999999997 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534088+0000", 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060910639000000003 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534136+0000", 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534168+0000", 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1649999999999997e-05 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98838 5.c 5:38fa558f:::benchmark_data_smithi037_101035_object98837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.173877927000007, 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065664133999999999, 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98838 2023-10-08T06:59:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468345+0000", 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2099999999999997e-07 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468464+0000", 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000118548 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468477+0000", 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2736e-05 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468488+0000", 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1936000000000001e-05 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468532+0000", 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3207999999999997e-05 2023-10-08T06:59:35.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468647+0000", 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114848 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473177+0000", 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045301400000000002 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533926+0000", 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060748966000000001 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534009+0000", 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3231000000000003e-05 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98839 5.7 5:e915e3c7:::benchmark_data_smithi037_101035_object98838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.173715047000002, 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.065509670000000006, 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98839 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.728 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468508+0000", 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.51e-07 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468549+0000", 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1368000000000001e-05 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468556+0000", 2023-10-08T06:59:35.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1190000000000002e-06 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468562+0000", 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6490000000000002e-06 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468603+0000", 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1137000000000003e-05 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.468718+0000", 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114951 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473183+0000", 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044646249999999998 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533938+0000", 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060755072 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534017+0000", 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9297999999999999e-05 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98841 5.5 5:a5d38ea3:::benchmark_data_smithi037_101035_object98840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.172052062999995, 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063844455999999994, 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98841 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.734 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470171+0000", 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470233+0000", 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1810999999999995e-05 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470242+0000", 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4649999999999994e-06 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470249+0000", 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1459999999999999e-06 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470291+0000", 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1882999999999999e-05 2023-10-08T06:59:35.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470380+0000", 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9407999999999995e-05 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473202+0000", 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002822064 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533939+0000", 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060736625000000002 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534015+0000", 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6316999999999995e-05 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98843 5.c 5:356ca8cb:::benchmark_data_smithi037_101035_object98842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.171785611000004, 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063793752999999995, 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.740 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98843 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470437+0000", 2023-10-08T06:59:35.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470438+0000", 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7100000000000001e-07 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470548+0000", 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000110185 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470556+0000", 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.038e-06 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470562+0000", 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5899999999999998e-06 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470732+0000", 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017076 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.470845+0000", 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000112234 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534043+0000", 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063198643999999998 2023-10-08T06:59:35.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534137+0000", 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3889999999999997e-05 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534231+0000", 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3740999999999996e-05 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:98845 5.1 5:8d601f41:::benchmark_data_smithi037_101035_object98844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.169030243999998, 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.064242102999999995, 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.746 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 98845 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473192+0000", 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473193+0000", 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5199999999999995e-07 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.473241+0000", 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7352999999999999e-05 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533889+0000", 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060648562000000003 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533902+0000", 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.24e-05 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.533956+0000", 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4184000000000002e-05 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.534096+0000", 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013981200000000001 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537281+0000", 2023-10-08T06:59:35.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031848720000000001 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537355+0000", 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4233000000000006e-05 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:58:21.537434+0000", 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9734999999999995e-05 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.751 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211406 5.9 5:9ad66565:::benchmark_data_smithi037_101035_object67545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.740500517000001, 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11746184, 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.752 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211406 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901722+0000", 2023-10-08T06:59:35.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901723+0000", 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901727+0000", 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0409999999999999e-06 2023-10-08T06:59:35.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901735+0000", 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9039999999999992e-06 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901741+0000", 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5320000000000003e-06 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901795+0000", 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3189999999999997e-05 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.901918+0000", 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012386999999999999 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.902030+0000", 2023-10-08T06:59:35.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011185599999999999 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.903806+0000", 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017760919999999999 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019084+0000", 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115277246 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019142+0000", 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8127000000000001e-05 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019184+0000", 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2213999999999999e-05 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211408 5.d 5:b5c4bfe1:::benchmark_data_smithi037_101035_object67547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.738143483000002, 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11517910000000001, 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211408 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904079+0000", 2023-10-08T06:59:35.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904080+0000", 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0100000000000004e-07 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904083+0000", 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3419999999999999e-06 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904091+0000", 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0690000000000002e-06 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904097+0000", 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7620000000000001e-06 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904137+0000", 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9696000000000001e-05 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904215+0000", 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8380999999999994e-05 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.904282+0000", 2023-10-08T06:59:35.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7188999999999997e-05 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019161+0000", 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.114878155 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019176+0000", 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5577e-05 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019220+0000", 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3597000000000003e-05 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019258+0000", 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8531000000000001e-05 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211414 5.c 5:3a10fa78:::benchmark_data_smithi037_101035_object67553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.736637063, 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118476936, 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211414 2023-10-08T06:59:35.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905586+0000", 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.92e-07 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905591+0000", 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1840000000000001e-06 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905600+0000", 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6460000000000005e-06 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905606+0000", 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7039999999999999e-06 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905660+0000", 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3739999999999997e-05 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905771+0000", 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111703 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023946+0000", 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.118174759 2023-10-08T06:59:35.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024003+0000", 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6938999999999998e-05 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.024063+0000", 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9469000000000003e-05 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211416 5.6 5:63b1b80f:::benchmark_data_smithi037_101035_object67555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.736429032, 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.11353049900000001, 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.772 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211416 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:35.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905794+0000", 2023-10-08T06:59:35.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8599999999999999e-07 2023-10-08T06:59:35.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905796+0000", 2023-10-08T06:59:35.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.978e-06 2023-10-08T06:59:35.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905802+0000", 2023-10-08T06:59:35.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.66e-06 2023-10-08T06:59:35.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905806+0000", 2023-10-08T06:59:35.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8959999999999996e-06 2023-10-08T06:59:35.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905838+0000", 2023-10-08T06:59:35.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2155e-05 2023-10-08T06:59:35.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.905910+0000", 2023-10-08T06:59:35.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2564000000000005e-05 2023-10-08T06:59:35.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019191+0000", 2023-10-08T06:59:35.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.113280371 2023-10-08T06:59:35.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019242+0000", 2023-10-08T06:59:35.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1341999999999997e-05 2023-10-08T06:59:35.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019324+0000", 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2146999999999998e-05 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211418 5.d 5:b01e8f01:::benchmark_data_smithi037_101035_object67557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.735857812999999, 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.115310552, 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.783 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211418 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906365+0000", 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0299999999999999e-07 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906368+0000", 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906375+0000", 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5769999999999999e-06 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906379+0000", 2023-10-08T06:59:35.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5820000000000003e-06 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906424+0000", 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4410999999999999e-05 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906530+0000", 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010607600000000001 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.906630+0000", 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010023599999999999 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019450+0000", 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.112820144 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021582+0000", 2023-10-08T06:59:35.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0021317879999999999 2023-10-08T06:59:35.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021634+0000", 2023-10-08T06:59:35.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2253000000000003e-05 2023-10-08T06:59:35.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.021675+0000", 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0970999999999998e-05 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4555.0:211420 5.f 5:fde3530b:::benchmark_data_smithi037_101035_object67559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.733598791999999, 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.121922612, 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4555", 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 211420 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908624+0000", 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908626+0000", 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7060000000000001e-06 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.908634+0000", 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8200000000000003e-06 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019003+0000", 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.110368799 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019012+0000", 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5210000000000002e-06 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019152+0000", 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014080599999999999 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019291+0000", 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013875899999999999 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019426+0000", 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013430199999999999 2023-10-08T06:59:35.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.023999+0000", 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.004573845 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030455+0000", 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064560709999999999 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030507+0000", 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1669999999999998e-05 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.030546+0000", 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9313000000000001e-05 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.797 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4555.0:211406 5.9 e56/20 ondisk, result = 0)", 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.733027668999998, 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.10999468, 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2023-10-08T06:59:35.798 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909195+0000", 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909196+0000", 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5600000000000005e-07 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:03.909200+0000", 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5680000000000001e-06 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.018997+0000", 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.109796227 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019011+0000", 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4194e-05 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2023-10-08T06:59:35.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019067+0000", 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6097999999999997e-05 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019076+0000", 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2699999999999993e-06 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2023-10-08T06:59:35.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2023-10-08T06:59:04.019190+0000", 2023-10-08T06:59:35.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011356700000000001 2023-10-08T06:59:35.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.803 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-10-08T06:59:35.803 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-10-08T06:59:35.803 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:35.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:35.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:35.804+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:35.905 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:35.904+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:35.946 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:35.946 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:35.946 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2023-10-08T06:59:35.946 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:35.956 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:36.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:36.006+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:36.107 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:36.106+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:36.124 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2023-10-08T06:59:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2023-10-08T06:59:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2023-10-08T06:59:36.125 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:36.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:36.222 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:36.218+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28686 5.d 5:bd48eee3:::benchmark_data_smithi037_101035_object28685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 107.437097212, 2023-10-08T06:59:36.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028800170999999999, 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28686 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:36.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865217+0000", 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865218+0000", 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8000000000000001e-07 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865281+0000", 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865288+0000", 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4329999999999998e-06 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865292+0000", 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0840000000000002e-06 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865332+0000", 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0209000000000001e-05 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865438+0000", 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010570500000000001 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.865555+0000", 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011709099999999999 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870291+0000", 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047362710000000002 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893938+0000", 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023646456999999999 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893985+0000", 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6819e-05 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.894018+0000", 2023-10-08T06:59:36.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2811000000000001e-05 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:28690 5.8 5:13ccf4b4:::benchmark_data_smithi037_101035_object28689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 107.434388993, 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027351846999999999, 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.311 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 28690 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.867926+0000", 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5400000000000002e-07 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868039+0000", 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112664 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868045+0000", 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2380000000000002e-06 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868049+0000", 2023-10-08T06:59:36.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3109999999999999e-06 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868095+0000", 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5432000000000001e-05 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868219+0000", 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124027 2023-10-08T06:59:36.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.868337+0000", 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117865 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.893948+0000", 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025610951999999999 2023-10-08T06:59:36.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895186+0000", 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001238772 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895240+0000", 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4055999999999999e-05 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.895277+0000", 2023-10-08T06:59:36.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7076000000000002e-05 2023-10-08T06:59:36.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.318 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:28697 5.a e27/20 5:5ae1bc80:::benchmark_data_smithi037_101035_object28696:head v 27'1704, mlcod=27'1702)", 2023-10-08T06:59:36.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:36.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 107.431396703, 2023-10-08T06:59:36.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029213948999999999, 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870918+0000", 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4200000000000001e-07 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870965+0000", 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6898999999999999e-05 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.870972+0000", 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892576+0000", 2023-10-08T06:59:36.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021603882000000001 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892635+0000", 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9695999999999999e-05 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.892658+0000", 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2861999999999999e-05 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900083+0000", 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074250139999999997 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:57:48.900132+0000", 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8658000000000001e-05 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95178 5.8 5:1b3644f9:::benchmark_data_smithi037_101035_object95177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.416355840999998, 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080783227999999999, 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95178 2023-10-08T06:59:36.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885959+0000", 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.885960+0000", 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0999999999999997e-07 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886029+0000", 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9930000000000003e-05 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886039+0000", 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3500000000000003e-06 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886046+0000", 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129944 2023-10-08T06:59:36.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886314+0000", 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013836600000000001 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966600+0000", 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080285666000000006 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966658+0000", 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7664999999999998e-05 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966742+0000", 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4182000000000001e-05 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95179 5.0 5:085b734e:::benchmark_data_smithi037_101035_object95178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.416252983999996, 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080817251000000007, 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95179 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886062+0000", 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5000000000000003e-07 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886097+0000", 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4683e-05 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886104+0000", 2023-10-08T06:59:36.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3150000000000003e-06 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886110+0000", 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3400000000000003e-06 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886166+0000", 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5779999999999998e-05 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886306+0000", 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013950799999999999 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966752+0000", 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080445841000000004 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966804+0000", 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1907999999999998e-05 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966879+0000", 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5326000000000004e-05 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.336 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95180 5.0 5:04f947f5:::benchmark_data_smithi037_101035_object95179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.416189691, 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080872833000000005, 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95180 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886125+0000", 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1600000000000001e-07 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886163+0000", 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7889000000000003e-05 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886170+0000", 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0029999999999997e-06 2023-10-08T06:59:36.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886176+0000", 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5570000000000003e-06 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888369+0000", 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021931009999999998 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.888494+0000", 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125444 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966887+0000", 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078392481999999999 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966947+0000", 2023-10-08T06:59:36.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654999999999997e-05 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966998+0000", 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1186000000000001e-05 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.342 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95183 5.0 5:0d2cc2f8:::benchmark_data_smithi037_101035_object95182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.415916413000005, 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.080678682000000002, 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95183 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886398+0000", 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886399+0000", 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000002e-07 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886528+0000", 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012927500000000001 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886538+0000", 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6779999999999995e-06 2023-10-08T06:59:36.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.886545+0000", 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9149999999999999e-06 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890276+0000", 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037312489999999999 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890361+0000", 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4792999999999999e-05 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967005+0000", 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076643869000000003 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967038+0000", 2023-10-08T06:59:36.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2960999999999998e-05 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967077+0000", 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8958000000000002e-05 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95187 5.0 5:0336f2c9:::benchmark_data_smithi037_101035_object95186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.348 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.412926369999994, 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077766193999999997, 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95187 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889388+0000", 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889390+0000", 2023-10-08T06:59:36.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889462+0000", 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2868999999999996e-05 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889474+0000", 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1559999999999999e-05 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.889483+0000", 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8920000000000006e-06 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891773+0000", 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002289761 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891895+0000", 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121941 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967081+0000", 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.075186372000000001 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967109+0000", 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8109000000000001e-05 2023-10-08T06:59:36.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967154+0000", 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5289e-05 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95189 5.0 5:032a7592:::benchmark_data_smithi037_101035_object95188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.354 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.411575442, 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.076490033999999998, 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95189 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890739+0000", 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890740+0000", 2023-10-08T06:59:36.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4900000000000004e-07 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890846+0000", 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105828 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890857+0000", 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0869e-05 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890864+0000", 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7190000000000001e-06 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962866+0000", 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.072001986000000004 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962996+0000", 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129398 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967159+0000", 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041626420000000003 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967185+0000", 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6446999999999999e-05 2023-10-08T06:59:36.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.967229+0000", 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4196000000000002e-05 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95193 5.0 5:00f339bd:::benchmark_data_smithi037_101035_object95192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:36.360 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.411436679000005, 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.078513011999999993, 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95193 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890878+0000", 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2499999999999995e-07 2023-10-08T06:59:36.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890957+0000", 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8325999999999995e-05 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890964+0000", 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7109999999999995e-06 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.890970+0000", 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7969999999999997e-06 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964877+0000", 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073907021000000003 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964973+0000", 2023-10-08T06:59:36.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5859999999999994e-05 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969275+0000", 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043022219999999996 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969329+0000", 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3409999999999999e-05 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.969391+0000", 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2139999999999998e-05 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95190 5.d e41/32 5:bb7bea9b:::benchmark_data_smithi037_101035_object95189:head v 41'5814, mlcod=41'5812)", 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.411058214999997, 2023-10-08T06:59:36.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073565463999999997, 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891256+0000", 2023-10-08T06:59:36.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891257+0000", 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9700000000000005e-07 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891313+0000", 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6134999999999997e-05 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891321+0000", 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6389999999999992e-06 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891326+0000", 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0849999999999996e-06 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891360+0000", 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3581000000000003e-05 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.891374+0000", 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4644000000000001e-05 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964781+0000", 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073407132999999999 2023-10-08T06:59:36.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.964822+0000", 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0349999999999998e-05 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:95195 5.d e41/32 5:b3e7b972:::benchmark_data_smithi037_101035_object95194:head v 41'5815, mlcod=41'5812)", 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.408896681000002, 2023-10-08T06:59:36.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.073027834, 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893418+0000", 2023-10-08T06:59:36.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893419+0000", 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1200000000000002e-07 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.893466+0000", 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7681e-05 2023-10-08T06:59:36.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962286+0000", 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068819879 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7053e-05 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962747+0000", 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000433781 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962769+0000", 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1994e-05 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966402+0000", 2023-10-08T06:59:36.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036334330000000001 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966446+0000", 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3300999999999998e-05 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:95204 5.e 5:7379fc08:::benchmark_data_smithi037_101035_object95203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-10-08T06:59:36.376 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.400557797999994, 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.065003421000000006, 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 95204 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901757+0000", 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901758+0000", 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2750000000000001e-06 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.901784+0000", 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6152999999999998e-05 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962292+0000", 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060507629 2023-10-08T06:59:36.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962313+0000", 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1384999999999999e-05 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962399+0000", 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5791999999999994e-05 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.962566+0000", 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016676899999999999 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966630+0000", 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040643509999999999 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966679+0000", 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9150000000000002e-05 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:19.966760+0000", 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0916999999999998e-05 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.382 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99160 5.e 5:77aaa6d1:::benchmark_data_smithi037_101035_object99159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.63712898, 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064609298999999995, 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99160 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665186+0000", 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0999999999999998e-07 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665264+0000", 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7767000000000003e-05 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665272+0000", 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3129999999999999e-06 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665278+0000", 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2660000000000001e-06 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665326+0000", 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8809e-05 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665452+0000", 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012605299999999999 2023-10-08T06:59:36.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729655+0000", 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064202298000000005 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729711+0000", 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6245000000000001e-05 2023-10-08T06:59:36.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729795+0000", 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3937999999999995e-05 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99163 5.b 5:deea3ff0:::benchmark_data_smithi037_101035_object99162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:36.389 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.636584318999994, 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068518333000000001, 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99163 2023-10-08T06:59:36.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665730+0000", 2023-10-08T06:59:36.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665731+0000", 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2900000000000003e-07 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665793+0000", 2023-10-08T06:59:36.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1765000000000002e-05 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665799+0000", 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0349999999999998e-06 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665803+0000", 2023-10-08T06:59:36.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0049999999999998e-06 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665849+0000", 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5843000000000001e-05 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665943+0000", 2023-10-08T06:59:36.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4775e-05 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734133+0000", 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.068189861000000004 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734178+0000", 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.511e-05 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734249+0000", 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0309999999999996e-05 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99164 5.e 5:7f2852ff:::benchmark_data_smithi037_101035_object99163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:36.396 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.636496059999999, 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064924853000000005, 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99164 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665819+0000", 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7599999999999997e-07 2023-10-08T06:59:36.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665855+0000", 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5790999999999997e-05 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665861+0000", 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5830000000000003e-06 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665867+0000", 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9290000000000003e-06 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667363+0000", 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014960100000000001 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727386+0000", 2023-10-08T06:59:36.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.060022460999999999 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730615+0000", 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003229048 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730670+0000", 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5532999999999998e-05 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.730743+0000", 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3022000000000007e-05 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99161 5.9 e42/20 5:926178fb:::benchmark_data_smithi037_101035_object99160:head v 42'6193, mlcod=42'6190)", 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.636461634, 2023-10-08T06:59:36.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.064057981, 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665853+0000", 2023-10-08T06:59:36.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665854+0000", 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7300000000000004e-07 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665910+0000", 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5636000000000001e-05 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665921+0000", 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1144e-05 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665928+0000", 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0380000000000002e-06 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665958+0000", 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0759999999999997e-05 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.665971+0000", 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2268e-05 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729863+0000", 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.063892266000000003 2023-10-08T06:59:36.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.729911+0000", 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7895999999999997e-05 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99166 5.8 5:1979df2c:::benchmark_data_smithi037_101035_object99165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:36.407 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.635367058, 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.067283061000000005, 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99166 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.666948+0000", 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5300000000000003e-07 2023-10-08T06:59:36.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667014+0000", 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6228000000000004e-05 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667025+0000", 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0781999999999999e-05 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667032+0000", 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1470000000000004e-06 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667087+0000", 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5009000000000001e-05 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667221+0000", 2023-10-08T06:59:36.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000134039 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734091+0000", 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.066869695000000007 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734152+0000", 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0687999999999999e-05 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.734231+0000", 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8720000000000005e-05 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4555.0:99167 5.b 5:d847128d:::benchmark_data_smithi037_101035_object99166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.634843224999997, 2023-10-08T06:59:36.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.071371805999999996, 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4555", 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.37:0/850562761", 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 99167 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:36.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667471+0000", 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667472+0000", 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.667532+0000", 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.961e-05 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727254+0000", 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.059722618999999998 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727265+0000", 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0484e-05 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727584+0000", 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000319306 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727729+0000", 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014461000000000001 2023-10-08T06:59:36.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738724+0000", 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010994993 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738773+0000", 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8887000000000001e-05 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.738843+0000", 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0496999999999999e-05 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4555.0:99168 5.9 e42/20 5:91cd64f9:::benchmark_data_smithi037_101035_object99167:head v 42'6194, mlcod=42'6191)", 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.633885003000003, 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.062879142999999998, 2023-10-08T06:59:36.419 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2023-10-08T06:59:36.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668430+0000", 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0699999999999996e-07 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.668480+0000", 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9641999999999997e-05 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727157+0000", 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.058676482000000002 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727199+0000", 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1952000000000001e-05 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727852+0000", 2023-10-08T06:59:36.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065337000000000001 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.727876+0000", 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3657000000000001e-05 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731267+0000", 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033918640000000001 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2023-10-08T06:59:36.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2023-10-08T06:58:21.731309+0000", 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1269000000000001e-05 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2023-10-08T06:59:36.424 INFO:teuthology.orchestra.run.smithi169.stdout:} 2023-10-08T06:59:36.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:36.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:36.425+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:36.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:36.527+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:36.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T06:59:36.565 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-10-08T06:59:36.565 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2023-10-08T06:59:36.566 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2023-10-08T06:59:36.566 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-10-08T06:59:36.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:36.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:36.660+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:36.717 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2023-10-08T06:59:36.729 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:36.728+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:36.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2023-10-08T06:59:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T06:59:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T06:59:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-10-08T06:59:36.740 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T06:59:36.741 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T06:59:36.745 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:36.745 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:36.755 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:36.830 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:36.829+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:36.922 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:36.923 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:36.931 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:36.930+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:36.933 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:37.032 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:37.031+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:37.064 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:37.065 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:37.075 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:37.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:37.133+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:37.175 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2023-10-08T06:59:37.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2023-10-08T06:59:37.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-10-08T06:59:37.233+0000 7f5f6e8a3700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97565) UID: 0 2023-10-08T06:59:37.242 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:37.242 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:37.253 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:37.335 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:37.334+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:37.380 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:37.380 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:37.390 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T06:59:37.435 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:37.435+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:37.531 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:37.531 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:37.536 INFO:tasks.ceph.osd.1.smithi169.stderr:2023-10-08T06:59:37.536+0000 7f7a8bb8c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97554) UID: 0 2023-10-08T06:59:37.541 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T06:59:37.602 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_0' removed 2023-10-08T06:59:37.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T06:59:37.614 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2023-10-08T06:59:37.628 INFO:tasks.thrashosds:joining thrashosds 2023-10-08T06:59:37.668 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:37.668 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:37.679 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T06:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:37.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T06:59:37.957 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:37.957 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:37.968 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T06:59:38.094 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:38.094 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:38.104 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T06:59:38.232 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2023-10-08T06:59:38.232 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T06:59:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2023-10-08T06:59:38.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2023-10-08T06:59:40.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T06:59:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2023-10-08T06:59:41.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T06:59:42.624 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2023-10-08T06:59:44.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2023-10-08T06:59:50.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2023-10-08T06:59:56.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2023-10-08T07:00:02.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~106s 2023-10-08T07:00:07.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2023-10-08T07:00:13.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2023-10-08T07:00:19.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2023-10-08T07:00:25.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2023-10-08T07:00:31.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2023-10-08T07:00:36.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2023-10-08T07:00:42.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~146s 2023-10-08T07:00:47.036 DEBUG:teuthology.orchestra.console.smithi183:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 80 85 GUID: 00000000 0000 0000 0000 0CC47AD938AA DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.183 M : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.183 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:80:85)... Configuring (net0 0c:c4:7a:88:80:85).... Configuring (net0 0c:c4:7a:88:80:85)..... Configuring (net0 0c:c4:7a:88:80:85)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6>                 The selected entry will be started automatically in 5s.            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)   Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6*  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h     [ 0.000000] Linux version 4.1.1.el8.x86_64 (mbuild.eng.bos.resion 8.5.0 20210514 (Red Hat 8.5.0-10) (GCC)) #1 SMP Fri Apr 15 22:12:19 EDT 2022 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eacfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f5f000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.732 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ead max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x3484f000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 192MB of memory at 1728MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078eacfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29129 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ead000-0x78f5efff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f5f000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228722 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] Memory: 1820528K/33437916K available (12293K kernel code, 5865K rwdata, 8292K rodata, 2520K init, 14348K bss, 869504K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 39999 entries in 157 pages [ 0.000000] ftrace: allocated 157 pages with 5 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [tty0] enabled [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20210604 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005001] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013120] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014472] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327253f73fc, max_idle_ns: 440795252387 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.46 BogoMIPS (lpj=3499732) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022020] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.026021] LSM support for eBPF active [ 0.032286] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.035744] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.037021] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038076] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.039225] CPU0: Thermal monitoring enabled (TM1) [ 0.040041] process: using mwait in idle threads [ 0.041001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.042000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.043000] FEATURE SPEC_CTRL Not Present [ 0.044000] FEATURE IBPB_SUPPORT Not Present [ 0.045000] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.046001] Spectre V2 : Mitigation: Retpolines [ 0.047000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.048000] Speculative Store Bypass: Vulnerable [ 0.049004] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050000] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.051231] Freeing SMP alternatives memory: 36K [ 0.053914] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.156975] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.157100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.158001] ... version: 3 [ 0.159000] ... bit width: 48 [ 0.160000] ... generic registers: 4 [ 0.161000] ... value mask: 0000ffffffffffff [ 0.162000] ... max period: 00007fffffffffff [ 0.163000] ... fixed-purpose events: 3 [ 0.164000] ... event mask: 000000070000000f [ 0.165026] rcu: Hierarchical SRCU implementation. [ 0.166842] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.168014] smp: Bringing up secondary CPUs ... [ 0.169066] x86: Booting SMP configuration: [ 0.170002] .... node #0, CPUs: #1 #2 #3 #4 [ 0.173345] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.175001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.177066] #5 #6 #7 [ 0.178546] smp: Brought up 1 node, 8 CPUs [ 0.180001] smpboot: Max logical packages: 1 [ 0.181001] smpboot: Total of 8 processors activated (55995.71 BogoMIPS) [ 0.223021] node 0 deferred pages initialised in 40ms [ 0.228750] devtmpfs: initialized [ 0.229038] x86/mm: Memory block size: 128MB [ 0.232301] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.234060] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.235008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.236064] pinctrl core: initialized pinctrl subsystem [ 0.237119] NET: Registered protocol family 16 [ 0.238080] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.239009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.240008] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.241009] audit: initializing netlink subsys (disabled) [ 0.242008] audit: type=2000 audit(1696748409.242:1): state=initialized audit_enabled=0 res=1 [ 0.251002] cpuidle: using governor menu [ 0.252025] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.253001] ACPI: bus type PCI registered [ 0.254001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.255048] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.256001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.257010] PCI: Using configuration type 1 for base access [ 0.260099] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.261001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.262025] cryptd: max_cpu_qlen set to 1000 [ 0.267063] ACPI: Added _OSI(Module Device) [ 0.271002] ACPI: Added _OSI(Processor Device) [ 0.276001] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.280000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.286000] ACPI: Added _OSI(Linux-Dell-Video) [ 0.290000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.296000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.331109] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.340130] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.349095] ACPI: Dynamic OEM Table Load: [ 0.369361] ACPI: Interpreter enabled [ 0.370011] ACPI: PM: (supports S0 S4 S5) [ 0.371000] ACPI: Using IOAPIC for interrupt routing [ 0.372017] HEST: Enabling Firmware First mode for corrected errors. [ 0.373071] HEST: Table parsing has been initialized. [ 0.374001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.375542] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.399684] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.400003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.402627] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.404249] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.405001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.406028] PCI host bridge to bus 0000:ff [ 0.407001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.408011] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.410019] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.411031] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.412030] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.413031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.414032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.415029] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.416029] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.417031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.418028] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.419030] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.420029] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.421030] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.422030] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.423029] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.424030] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.425028] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.426028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.427030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.428021] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.429036] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.430059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.431042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.432041] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.433041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.434041] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.435111] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.436032] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.437033] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.438043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.439041] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.440041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.441039] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.442031] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.443032] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.444033] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.445032] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.446042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.447041] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.448041] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.449042] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.450035] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.451031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.452031] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.453034] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.454032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.455033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.456031] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.457035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.458029] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.459030] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.460030] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.461021] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.462032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.463031] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.467268] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.468002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.469152] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.470283] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.471000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.472242] PCI host bridge to bus 0000:00 [ 0.473001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.474000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.475000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.476000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.477001] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.478000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.479000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.480011] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.481126] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 0.482042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 0.484042] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 0.485041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 0.486104] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 0.487041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 0.488100] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 0.489007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 0.490108] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 0.491007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 0.493002] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 0.494007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 0.496072] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 0.497007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 0.498105] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 0.499007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 0.500104] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 0.501007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 0.502104] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 0.503007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 0.504106] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 0.505007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 0.506104] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 0.507090] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 0.508114] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 0.509089] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 0.510005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 0.511103] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 0.512185] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 0.513011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 0.514006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 0.515006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 0.516006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 0.517006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 0.518006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 0.519035] pci 0000:00:11.4: PME# supported from D3hot [ 0.521022] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 0.522014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 0.524044] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 0.526044] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 0.527013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 0.528053] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 0.529085] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 0.530013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 0.531051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 0.532097] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 0.533013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 0.534073] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 0.535092] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 0.536065] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 0.537105] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 0.539027] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 0.540104] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 0.541066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 0.542110] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 0.543013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 0.544073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 0.545096] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 0.546174] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 0.547009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 0.548005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 0.549005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 0.550005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 0.551005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 0.552005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 0.553029] pci 0000:00:1f.2: PME# supported from D3hot [ 0.554083] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 0.555013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 0.556016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 0.557197] acpiphp: Slot [1] registered [ 0.558013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.560002] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 0.561008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 0.562015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 0.563003] pci 0000:02:00.0: enabling Extended Tags [ 0.564095] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.565002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.566123] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 0.567009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 0.568004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 0.569009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 0.570004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 0.571037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 0.572017] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.573000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.574008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.575000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.577090] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 0.578009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 0.579004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 0.580009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 0.581004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 0.582036] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 0.583013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.584000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.585007] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.586000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.587130] pci 0000:00:03.0: PCI bridge to [bus 03] [ 0.588001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 0.589001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 0.590002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 0.591028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 0.592060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 0.593065] pci 0000:05:00.0: enabling Extended Tags [ 0.594070] pci 0000:05:00.0: supports D1 D2 [ 0.595000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.596086] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 0.597002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 0.598002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.599047] pci_bus 0000:06: extended config space not accessible [ 0.600026] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 0.601022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 0.602012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 0.603013] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 0.604160] pci 0000:06:00.0: supports D1 D2 [ 0.605000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.607103] pci 0000:05:00.0: PCI bridge to [bus 06] [ 0.608007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 0.609003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.610080] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 0.611017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 0.612018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 0.613009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 0.614119] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 0.615035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.616000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.617021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.618000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.619156] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 0.620017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 0.621018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 0.622009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 0.623114] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 0.624034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.625000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.626021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.627000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.629023] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 0.630002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 0.631002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 0.632003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 0.634492] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 0.635036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.636034] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 0.637034] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.638034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 0.639000] ACPI: PCI: Interrupt link LNKE disabled [ 0.640034] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 0.641000] ACPI: PCI: Interrupt link LNKF disabled [ 0.642034] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 0.643000] ACPI: PCI: Interrupt link LNKG disabled [ 0.644034] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 0.645000] ACPI: PCI: Interrupt link LNKH disabled [ 0.646194] iommu: Default domain type: Passthrough [ 0.647018] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 0.648000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 0.648001] pci 0000:06:00.0: vgaarb: bridge control possible [ 0.649000] vgaarb: loaded [ 0.650062] SCSI subsystem initialized [ 0.651013] ACPI: bus type USB registered [ 0.652010] usbcore: registered new interface driver usbfs [ 0.653005] usbcore: registered new interface driver hub [ 0.654014] usbcore: registered new device driver usb [ 0.655017] pps_core: LinuxPPS API ver. 1 registered [ 0.656000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.657003] PTP clock support registered [ 0.658017] EDAC MC: Ver: 3.0.0 [ 0.660040] PCI: Using ACPI for IRQ routing [ 0.666729] NetLabel: Initializing [ 0.667000] NetLabel: domain hash size = 128 [ 0.668000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.669011] NetLabel: unlabeled traffic allowed by default [ 0.670044] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 0.671000] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 0.674025] clocksource: Switched to clocksource tsc-early [ 0.688900] VFS: Disk quotas dquot_6.6.0 [ 0.692922] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.699934] pnp: PnP ACPI init [ 0.703421] system 00:01: [io 0x0500-0x057f] has been reserved [ 0.709427] system 00:01: [io 0x0400-0x047f] has been reserved [ 0.715433] system 00:01: [io 0x0580-0x059f] has been reserved [ 0.721438] system 00:01: [io 0x0600-0x061f] has been reserved [ 0.727435] system 00:01: [io 0x0880-0x0883] has been reserved [ 0.733436] system 00:01: [io 0x0800-0x081f] has been reserved [ 0.739441] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 0.746144] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 0.752843] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 0.759543] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 0.766242] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 0.772942] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 0.779642] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 0.786508] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 0.792513] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 0.798520] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 0.804528] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 0.810533] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 0.817268] pnp: PnP ACPI: found 5 devices [ 0.826778] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.835791] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 0.847382] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 0.855316] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.860365] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.865413] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.872286] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.879954] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.887973] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.895731] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.903835] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.911507] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.919523] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.927281] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.935387] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.943056] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.951075] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.958831] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.966936] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.974604] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.982623] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.990381] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.998484] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.003532] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.009705] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.016580] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.024428] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.029480] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.034526] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.040702] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.047582] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.052893] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.059067] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.065947] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 1.073791] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 1.081723] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 1.089575] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 1.097507] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.102558] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.108732] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.115607] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.123457] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.132609] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.138869] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.145134] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.152087] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.159047] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.166008] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.172968] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.179320] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.184978] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.191323] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.198642] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.204298] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.210643] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.216293] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.222638] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.228289] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.234636] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.242063] NET: Registered protocol family 2 [ 1.246700] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.256064] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 1.265049] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.273643] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 1.281338] TCP: Hash tables configured (established 262144 bind 65536) [ 1.288142] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 1.295997] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.303109] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.310696] NET: Registered protocol family 1 [ 1.315138] NET: Registered protocol family 44 [ 1.319746] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.343744] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x61f took 16315 usecs [ 1.367658] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x61f took 16010 usecs [ 1.375167] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.381702] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.390192] Unpacking initramfs... [ 1.670535] Freeing initrd memory: 28484K [ 1.674692] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.681216] software IO TLB: mapped [mem 0x0000000068000000-0x000000006c000000] (64MB) [ 1.689245] ACPI: bus type thunderbolt registered [ 1.707295] Initialise system trusted keyrings [ 1.711830] Key type blacklist registered [ 1.715943] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.723882] zbud: loaded [ 1.726747] pstore: using deflate compression [ 1.731379] Platform Keyring initialized [ 1.805610] NET: Registered protocol family 38 [ 1.810140] Key type asymmetric registered [ 1.814316] Asymmetric key parser 'x509' registered [ 1.819280] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 1.834606] io scheduler mq-deadline registered [ 1.839221] io scheduler kyber registered [ 1.843333] io scheduler bfq registered [ 1.847313] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.854609] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.860593] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.866568] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.872525] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.878483] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.884430] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.890386] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.897775] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.906249] ACPI: Power Button [PWRB] [ 1.910021] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.917542] ACPI: Power Button [PWRF] [ 1.922386] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.929997] pstore: Registered erst as persistent store backend [ 1.936152] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.943732] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.970669] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.998719] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.006501] Non-volatile memory driver v1.3 [ 2.011192] rdac: device handler registered [ 2.015527] hp_sw: device handler registered [ 2.019878] emc: device handler registered [ 2.024079] alua: device handler registered [ 2.028413] libphy: Fixed MDIO Bus: probed [ 2.032638] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.039249] ehci-pci: EHCI PCI platform driver [ 2.043871] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.049210] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.056716] ehci-pci 0000:00:1a.0: debug port 2 [ 2.065230] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.077042] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.082907] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.091275] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.098596] usb usb1: Product: EHCI Host Controller [ 2.103555] usb usb1: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.110685] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.115464] hub 1-0:1.0: USB hub found [ 2.119298] hub 1-0:1.0: 2 ports detected [ 2.123562] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.128909] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 2.136413] ehci-pci 0000:00:1d.0: debug port 2 [ 2.144928] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.157037] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.162893] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.171267] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.178586] usb usb2: Product: EHCI Host Controller [ 2.183547] usb usb2: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.190677] usb usb2: SerialNumber: 0000:00:1d.0 [ 2.195450] hub 2-0:1.0: USB hub found [ 2.199280] hub 2-0:1.0: 2 ports detected [ 2.203468] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.209739] ohci-pci: OHCI PCI platform driver [ 2.214276] uhci_hcd: USB Universal Host Controller Interface driver [ 2.220817] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.226171] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.234719] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.244088] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.252456] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.259776] usb usb3: Product: xHCI Host Controller [ 2.264737] usb usb3: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.271866] usb usb3: SerialNumber: 0000:00:14.0 [ 2.276733] hub 3-0:1.0: USB hub found [ 2.280575] hub 3-0:1.0: 15 ports detected [ 2.286389] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.291755] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.299252] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.305617] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 2.313988] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.321317] usb usb4: Product: xHCI Host Controller [ 2.326277] usb usb4: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.333406] usb usb4: SerialNumber: 0000:00:14.0 [ 2.338367] hub 4-0:1.0: USB hub found [ 2.342207] hub 4-0:1.0: 6 ports detected [ 2.347146] usbcore: registered new interface driver usbserial_generic [ 2.353761] usbserial: USB Serial support registered for generic [ 2.359876] i8042: PNP: No PS/2 controller found. [ 2.364719] mousedev: PS/2 mouse device common for all mice [ 2.370458] rtc_cmos 00:00: RTC can wake from S4 [ 2.375320] rtc_cmos 00:00: registered as rtc0 [ 2.379859] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 2.387624] intel_pstate: Intel P-state driver initializing [ 2.393535] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.400920] hid: raw HID events driver (C) Jiri Kosina [ 2.406168] usbcore: registered new interface driver usbhid [ 2.411831] usbhid: USB HID core driver [ 2.415836] drop_monitor: Initializing network drop monitor service [ 2.422230] Initializing XFRM netlink socket [ 2.426658] NET: Registered protocol family 10 [ 2.431382] Segment Routing with IPv6 [ 2.435142] NET: Registered protocol family 17 [ 2.439759] mpls_gso: MPLS GSO support [ 2.443962] microcode: sig=0x406f1, pf=0x1, revision=0xb000010 [ 2.449985] microcode: Microcode Update Driver: v2.2. [ 2.450057] resctrl: L3 allocation detected [ 2.459451] resctrl: L3DATA allocation detected [ 2.464062] resctrl: L3CODE allocation detected [ 2.468675] resctrl: L3 monitoring detected [ 2.472943] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 2.472947] AVX2 version of gcm_enc/dec engaged. [ 2.484259] AES CTR mode by8 optimization enabled [ 2.514009] sched_clock: Marking stable (2514003604, 0)->(5557787019, -3043783415) [ 2.521796] registered taskstats version 1 [ 2.526101] Loading compiled-in X.509 certificates [ 2.545425] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.553025] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 2.553705] usb 1-1: New USB device strings: Mfr=0,oduct=0, SerialNumber=0 [ 2.556265] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: fcec8079a12caa6a157125702c0054357b4fc157' [ 2.556548] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.556806] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.556839] zswap: loaded using pool lzo/zbud [ 2.578407] page_owner is disabled [ 2.590345] hub 1-1:1.0: USB hub found [ 2.605571] Key type big_key registered [ 2.608814] hub 1-1:1.0: 6 ports detected [ 2.614888] Key type encrypted registered [ 2.624701] ima: No TPM chip found, activating TPM-bypass! [ 2.628431] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.630269] ima: Allocated hash algorithm: sha256 [ 2.638541] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.643379] ima: No architecture policies found [ 2.655224] evm: Initialising EVM extended attributes: [ 2.655457] hub 2-1:1.0: USB hub found [ 2.660445] evm: security.selinux [ 2.660445] evm: security.ima [ 2.660446] evm: security.capability [ 2.660446] evm: HMAC attrs: 0x1 [ 2.664308] rtc_cmos 00:00: setting system clock to 2023-10-08 07:00:14 UTC (1696748414) [ 2.667838] hub 2-1:1.0: 8 ports detected [ 2.686222] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.698436] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.706035] hub 3-12:1.0: USB hub found [ 2.710022] hub 3-12:1.0: 4 ports detected [ 2.714443] Freeing unused decrypted memory: 2036K [ 2.719024] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.725596] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.736101] Freeing unused kernel image (initmem) memory: 2520K [ 2.742108] clocksource: Switched to clocksource tsc [ 2.747154] Write protecting the kernel read-only data: 24576k [ 2.753445] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 2.760430] Freeing unused kernel image (rodata/data gap) memory: 1948K [ 2.776402] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 2.811142] systemd[1]: Detected architecture x86-64. [ 2.816285] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 2.840083] systemd[1]: Set hostname to . [ 2.884604] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 2.894283] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 2.907114] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 2.917275] systemd[1]: Listening on udev Control Socket. [ ol Socket. [ d[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 2.941108] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Sockets. Starting Journal Service... Starting Apply Kernel Variables... Starting Create Volatile Files and Directories... Starting Setup Virtual Console... [ 3.009030] usb 3-12.umber 3 using xhlist of required st…ce nodes for the current kernel... [ OK ] Started Apply Kernel Variables. [ OK ] Started Journal Service. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Startinine hook... [ 3.113338] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.122137] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.134814] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ 3.198237] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 Startin[ 3.210855] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 g udev Coldplug [ 3.223975] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ OK ] Reached target System Initialization. [ 3.350679] dca service started, version 1.12.1 Starting dracut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reach[ 3.372897] igb: Intel(R) Gigabit Ethernet Network Driver ed target Paths.[ 3.379084] igb: Copyright (c) 2007-2014 Intel Corporation. [ OK ] Reached target Basic System. [ 3.398483] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 3.406710] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.414681] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 3.420891] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 3.423350] scsi host0: ahci [ 3.423636] nvme nvme0: pci function 0000:02:00.0 [ 3.424467] scsi host1: ahci [ 3.430688] nvme nvme0: 8/0/0 default/read/poll queues [ 3.433173] scsi host2: ahci [ 3.438529] nvme0n1: detected capacity change from 0 to 400088457216 [ 3.440921] scsi host3: ahci [ 3.441133] igb 0000:07:00.0: added PHC on eth0 [ 3.441135] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 3.441136] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:aa [ 3.441211] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 3.441213] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.490196] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 3.496404] igb 0000:07:00.1: added PHC on eth1 [ 3.497701] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 3.502312] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 3.509802] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 3.516762] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:ab [ 3.524262] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 3.524489] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 3.531561] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 3.538986] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.547262] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.567373] scsi host4: ahci [ 3.568872] igb 0000:07:00.0 eno1: renamed from eth0 [ 3.570904] scsi host5: ahci [ 3.578934] scsi host6: ahci [ 3.579021] scsi host7: ahci [ 3.579112] scsi host8: ahci [ 3.579239] scsi host9: ahci [ 3.579302] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 3.579305] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 3.579308] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 3.579310] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 3.579312] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 3.579316] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 3.580237] igb 0000:07:00.1 eno2: renamed from eth1 [ 3.590265] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 3.590270] ast 0000:06:00.0: [drm] AST 2400 detected [ 3.590289] ast 0000:06:00.0: [drm] Analog VGA only [ 3.590312] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 3.591339] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 3.700404] fbcon: astdrmfb (fb0) is primary device [ 3.812527] Console: switching to colour frame buffer device 128x48 [ 3.829266] ata4: SATA link down (SStatus 0 SControl 300) [ 3.830008] ata3: SATA link down (SStatus 0 SControl 300) [ 3.838144] ata2: SATA link down (SStatus 0 SControl 300) [ 3.842044] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 3.885067] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 3.891374] ata10: SATA link down (SStatus 0 SControl 300) [ 3.896924] ata7: SATA link down (SStatus 0 SControl 300) [ 3.902430] ata9: SATA link down (SStatus 0 SControl 300) [ 3.907957] ata6: SATA link down (SStatus 0 SControl 300) [ 3.913463] ata8: SATA link down (SStatus 0 SControl 300) [ 3.913541] ata1: SATA link down (SStatus 0 SControl 300) [ 3.919639] ata5.00: NCQ Send/Recv Log not supported [ 3.929324] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 3.929326] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 3.936910] ata5.00: NCQ Send/Recv Log not supported [ 3.948051] ata5.00: configured for UDMA/133 [ 3.948249] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 3.965440] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 3.974720] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 3.982853] sd 4:0:0:0: [sda] Write Protect is off [ 3.987963] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 4.008403] sda: sda1 [ 4.015789] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 4.564315] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.575031] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.583981] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 4.590595] ixgbe 0000:03:00.0: 0c:c4:7a:88:80:84 [ 4.610234] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 4.617478] libphy: ixgbe-mdio: probed [ 4.806215] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.816931] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.825878] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 4.833347] ixgbe 0000:03:00.1: 0c:c4:7a:88:80:85 [ 4.842074] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 4.849418] libphy: ixgbe-mdio: probed [ 4.855128] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 4.902413] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…b72-f581-4b1d-8578-0d8161fd4ca1... [* ] A start job is running for File Sys…-8578-0d8161fd4ca1 (9s / no limit) [ OK ] Started File System Check on /dev/d…86b72-f581-4b1d-8578-0d8161fd4ca1. Mounting /sysroot... [ 12.901907] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. Starting Plymouth switch root service... [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. Stopping udev Kernel Device Manager... [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Starting Setup Virtual Console... [ OK ] Stopped Apply Kernel Variables. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 13.313866] printk: systemd: 12 output lines suppressed due to ratelimiting [ 13.988767] SELinux: policy capability network_peer_controls=1 [ 13.995024] SELinux: policy capability open_perms=1 [ 14.000300] SELinux: policy capability extended_socket_class=1 [ 14.006516] SELinux: policy capability always_check_network=0 [ 14.012640] SELinux: policy capability cgroup_seclabel=1 [ 14.018323] SELinux: policy capability nnp_nosuid_transition=1 [ 14.057003] audit: type=1403 audit(1696748425.894:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 14.058502] systemd[1]: Successfully loaded SELinux policy in 236.164ms. [ 14.132065] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.300ms. [ 14.164800] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 14.202533] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 14.236261] systemd[1]: Set hostname to . [ 15.165188] systemd[1]: systemd-journald.service: Succeeded. [ 15.187764] systemd[1]: initrd-switch-root.service: Succeeded. [ 15.195632] systemd[1]: Stopped Switch Root. [ OK [[ 15.201138] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 15.201224] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 15.201279] systemd[1]: Stopped Journal Service. [ OK [[ 15.230115] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Mounting Kernel Debug File System... Mounting Huge Pages File System... Mounting POSIX Message Queue File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Stopped target Switch Root. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Created slice User and Session Slice. [ OK ] Created slice system-getty.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Slices. [ OK ] Reached target Swap. [ OK ] Listening on udev Control Socket. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on RPCbind Server Activation Socket. Starting Read and set NIS domainname from /etc/sysconfig/network... Starting Load Kernel Modules... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ 15.458653] device-mapper: uevent: version 1.0.3 [ 15.458834] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com [ OK ] Listening on Process Core Dump Socket. [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target RPC Port Mapper. Starting[ 15.504119] EXT4-fs (sda1): re-mounted. Opts: (null) Create list of required st…ce nodes for the current kernel... [ OK ] Stopped t[ 15.520622] fuse: init (API version 7.33) arget Initrd Root File System. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting Setup Virtual Console... [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. Starting Remount Root and Kernel File Systems... [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Mounted FUSE Control File System. [ OK ] Started Apply Kernel Variables. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load/Save Random Seed. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Restore /run/initramfs on shutdown... Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ 16.180787] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Started Create Volatile Files and Directorie[ 16.202475] igb 0000:07:00.0: DCA enabled s. Starting Security [ 16.207662] igb 0000:07:00.1: DCA enabled Auditing Service... Starting RPC Bind... Mounting RPC Pipe File System... [ 16.284800] IPMI message handler: version 39.2 [ 16.339429] ipmi device interface [ 16.366569] ipmi_si: IPMI System Interface driver [ OK ] Started RPC [ 16.377478] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS Bind. [ 16.386240] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 16.389163] RPC: Registered named UNIX socket transport module. [ 16.395778] ipmi_si: Adding SMBIOS-specified kcs state machine [ 16.401386] RPC: Registered udp transport module. [ 16.410662] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 16.413985] RPC: Registered tcp transport module. [ 16.422366] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 16.426585] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.438967] power_meter ACPI000D:00: Found ACPI power meter. [ OK ] Created slic[ 16.453054] power_meter ACPI000D:00: Ignoring unsafe software power cap! e system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ OK [[ 16.475183] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt 0m] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 16.523601] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 16.533146] ipmi_si: Adding ACPI-specified kcs state machine [ 16.533263] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 16.545527] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 16.577087] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 16.600504] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 16.641551] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 16.672827] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 16.676401] ipmi_ssif: IPMI SSIF Interface driver [ 16.685667] iTCO_vendor_support: vendor-support=0 [ 16.686297] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 16.686298] RAPL PMU: hw unit of domain package 2^-14 Joules [ 16.686299] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 16.687266] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 16.687315] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 16.687472] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Reached target Timers. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ 16.918046] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 16.941559] XFS (dm-4): Mounting V5 Filesystem [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting System Security Services Daemon... [ OK ] Started irqbalance daemon. [ OK ] Started Machine Check Exception Loggin[ 16.991194] XFS (dm-4): Ending clean mount g Daemon. Starting Avahi mDNS/DNS-SD Stack... Starting Resets System Activity Logs... Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Load CPU microcode update... Starting Kernel Samepage Merging... Starting NTP client/server... Starting VDO volume services... Starting Authorization Manager... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started LVM event activation on device 259:0. [ OK ] Mounted /var/lib/ceph. [ 17.257394] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 17.268762] EDAC sbridge: Ver: 1.1.2 [ 17.392575] intel_rapl_common: Found RAPL domain package [ 17.415038] intel_rapl_common: Found RAPL domain dram [ 17.420499] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Load CPU microcode update. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started NTP client/server. [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 19.079961] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. [ 19.142757] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 19.152711] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 19.211818] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 19.237584] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 19.285050] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ OK ] Started Authorization Manager. [ 19.399966] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 19.410719] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 19.457784] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 19.568013] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 19.675466] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 19.783116] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 19.808227] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Permit User Sessions... Starting CUPS Scheduler... Starting Login Service... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. [ OK ] Started Nagios Remote Plugin Executor. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... Starting /etc/rc.d/rc.local Compatibility... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips= + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' '' '!=' '' ']' + '[' 1 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips= + attempts=2 + sleep 1 + '[' '' '!=' '' ']' + '[' 2 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.183 + attempts=3 + sleep 1 + '[' 172.21.15.183 '!=' '' ']' + set -e + '[' -n 172.21.15.183 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.183 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.183 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi183.front.sepia.ceph.com + '[' -n smithi183.front.sepia.ceph.com ']' + hostname smithi183.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi183 + echo smithi183 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.183 smithi183.front.sepia.ceph.com smithi183\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T07:00:47.039 DEBUG:teuthology.orchestra.console.smithi183:expect after: smithi183 login: 2023-10-08T07:00:47.093 DEBUG:teuthology.orchestra.console.smithi183:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 80 85 GUID: 00000000 0000 0000 0000 0CC47AD938AA DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.183 M : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.183 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:80:85)... Configuring (net0 0c:c4:7a:88:80:85).... Configuring (net0 0c:c4:7a:88:80:85)..... Configuring (net0 0c:c4:7a:88:80:85)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6>                 The selected entry will be started automatically in 5s.            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)   Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6*  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h     [ 0.000000] Linux version 4.1.1.el8.x86_64 (mbuild.eng.bos.resion 8.5.0 20210514 (Red Hat 8.5.0-10) (GCC)) #1 SMP Fri Apr 15 22:12:19 EDT 2022 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eacfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f5f000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.732 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ead max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x3484f000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 192MB of memory at 1728MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078eacfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29129 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ead000-0x78f5efff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f5f000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228722 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] Memory: 1820528K/33437916K available (12293K kernel code, 5865K rwdata, 8292K rodata, 2520K init, 14348K bss, 869504K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 39999 entries in 157 pages [ 0.000000] ftrace: allocated 157 pages with 5 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [tty0] enabled [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20210604 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005001] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013120] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014472] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327253f73fc, max_idle_ns: 440795252387 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.46 BogoMIPS (lpj=3499732) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022020] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.026021] LSM support for eBPF active [ 0.032286] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.035744] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.037021] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038076] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.039225] CPU0: Thermal monitoring enabled (TM1) [ 0.040041] process: using mwait in idle threads [ 0.041001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.042000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.043000] FEATURE SPEC_CTRL Not Present [ 0.044000] FEATURE IBPB_SUPPORT Not Present [ 0.045000] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.046001] Spectre V2 : Mitigation: Retpolines [ 0.047000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.048000] Speculative Store Bypass: Vulnerable [ 0.049004] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050000] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.051231] Freeing SMP alternatives memory: 36K [ 0.053914] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.156975] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.157100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.158001] ... version: 3 [ 0.159000] ... bit width: 48 [ 0.160000] ... generic registers: 4 [ 0.161000] ... value mask: 0000ffffffffffff [ 0.162000] ... max period: 00007fffffffffff [ 0.163000] ... fixed-purpose events: 3 [ 0.164000] ... event mask: 000000070000000f [ 0.165026] rcu: Hierarchical SRCU implementation. [ 0.166842] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.168014] smp: Bringing up secondary CPUs ... [ 0.169066] x86: Booting SMP configuration: [ 0.170002] .... node #0, CPUs: #1 #2 #3 #4 [ 0.173345] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.175001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.177066] #5 #6 #7 [ 0.178546] smp: Brought up 1 node, 8 CPUs [ 0.180001] smpboot: Max logical packages: 1 [ 0.181001] smpboot: Total of 8 processors activated (55995.71 BogoMIPS) [ 0.223021] node 0 deferred pages initialised in 40ms [ 0.228750] devtmpfs: initialized [ 0.229038] x86/mm: Memory block size: 128MB [ 0.232301] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.234060] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.235008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.236064] pinctrl core: initialized pinctrl subsystem [ 0.237119] NET: Registered protocol family 16 [ 0.238080] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.239009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.240008] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.241009] audit: initializing netlink subsys (disabled) [ 0.242008] audit: type=2000 audit(1696748409.242:1): state=initialized audit_enabled=0 res=1 [ 0.251002] cpuidle: using governor menu [ 0.252025] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.253001] ACPI: bus type PCI registered [ 0.254001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.255048] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.256001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.257010] PCI: Using configuration type 1 for base access [ 0.260099] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.261001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.262025] cryptd: max_cpu_qlen set to 1000 [ 0.267063] ACPI: Added _OSI(Module Device) [ 0.271002] ACPI: Added _OSI(Processor Device) [ 0.276001] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.280000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.286000] ACPI: Added _OSI(Linux-Dell-Video) [ 0.290000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.296000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.331109] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.340130] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.349095] ACPI: Dynamic OEM Table Load: [ 0.369361] ACPI: Interpreter enabled [ 0.370011] ACPI: PM: (supports S0 S4 S5) [ 0.371000] ACPI: Using IOAPIC for interrupt routing [ 0.372017] HEST: Enabling Firmware First mode for corrected errors. [ 0.373071] HEST: Table parsing has been initialized. [ 0.374001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.375542] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.399684] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.400003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.402627] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.404249] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.405001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.406028] PCI host bridge to bus 0000:ff [ 0.407001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.408011] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.410019] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.411031] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.412030] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.413031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.414032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.415029] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.416029] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.417031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.418028] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.419030] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.420029] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.421030] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.422030] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.423029] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.424030] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.425028] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.426028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.427030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.428021] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.429036] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.430059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.431042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.432041] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.433041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.434041] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.435111] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.436032] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.437033] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.438043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.439041] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.440041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.441039] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.442031] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.443032] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.444033] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.445032] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.446042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.447041] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.448041] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.449042] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.450035] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.451031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.452031] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.453034] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.454032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.455033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.456031] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.457035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.458029] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.459030] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.460030] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.461021] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.462032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.463031] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.467268] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.468002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.469152] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.470283] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.471000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.472242] PCI host bridge to bus 0000:00 [ 0.473001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.474000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.475000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.476000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.477001] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.478000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.479000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.480011] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.481126] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 0.482042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 0.484042] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 0.485041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 0.486104] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 0.487041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 0.488100] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 0.489007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 0.490108] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 0.491007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 0.493002] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 0.494007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 0.496072] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 0.497007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 0.498105] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 0.499007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 0.500104] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 0.501007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 0.502104] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 0.503007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 0.504106] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 0.505007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 0.506104] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 0.507090] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 0.508114] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 0.509089] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 0.510005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 0.511103] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 0.512185] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 0.513011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 0.514006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 0.515006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 0.516006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 0.517006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 0.518006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 0.519035] pci 0000:00:11.4: PME# supported from D3hot [ 0.521022] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 0.522014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 0.524044] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 0.526044] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 0.527013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 0.528053] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 0.529085] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 0.530013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 0.531051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 0.532097] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 0.533013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 0.534073] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 0.535092] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 0.536065] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 0.537105] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 0.539027] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 0.540104] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 0.541066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 0.542110] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 0.543013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 0.544073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 0.545096] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 0.546174] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 0.547009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 0.548005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 0.549005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 0.550005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 0.551005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 0.552005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 0.553029] pci 0000:00:1f.2: PME# supported from D3hot [ 0.554083] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 0.555013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 0.556016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 0.557197] acpiphp: Slot [1] registered [ 0.558013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.560002] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 0.561008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 0.562015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 0.563003] pci 0000:02:00.0: enabling Extended Tags [ 0.564095] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.565002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.566123] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 0.567009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 0.568004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 0.569009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 0.570004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 0.571037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 0.572017] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.573000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.574008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.575000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.577090] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 0.578009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 0.579004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 0.580009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 0.581004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 0.582036] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 0.583013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.584000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.585007] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.586000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.587130] pci 0000:00:03.0: PCI bridge to [bus 03] [ 0.588001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 0.589001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 0.590002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 0.591028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 0.592060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 0.593065] pci 0000:05:00.0: enabling Extended Tags [ 0.594070] pci 0000:05:00.0: supports D1 D2 [ 0.595000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.596086] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 0.597002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 0.598002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.599047] pci_bus 0000:06: extended config space not accessible [ 0.600026] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 0.601022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 0.602012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 0.603013] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 0.604160] pci 0000:06:00.0: supports D1 D2 [ 0.605000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.607103] pci 0000:05:00.0: PCI bridge to [bus 06] [ 0.608007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 0.609003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.610080] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 0.611017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 0.612018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 0.613009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 0.614119] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 0.615035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.616000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.617021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.618000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.619156] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 0.620017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 0.621018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 0.622009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 0.623114] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 0.624034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.625000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.626021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.627000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.629023] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 0.630002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 0.631002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 0.632003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 0.634492] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 0.635036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.636034] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 0.637034] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.638034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 0.639000] ACPI: PCI: Interrupt link LNKE disabled [ 0.640034] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 0.641000] ACPI: PCI: Interrupt link LNKF disabled [ 0.642034] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 0.643000] ACPI: PCI: Interrupt link LNKG disabled [ 0.644034] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 0.645000] ACPI: PCI: Interrupt link LNKH disabled [ 0.646194] iommu: Default domain type: Passthrough [ 0.647018] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 0.648000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 0.648001] pci 0000:06:00.0: vgaarb: bridge control possible [ 0.649000] vgaarb: loaded [ 0.650062] SCSI subsystem initialized [ 0.651013] ACPI: bus type USB registered [ 0.652010] usbcore: registered new interface driver usbfs [ 0.653005] usbcore: registered new interface driver hub [ 0.654014] usbcore: registered new device driver usb [ 0.655017] pps_core: LinuxPPS API ver. 1 registered [ 0.656000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.657003] PTP clock support registered [ 0.658017] EDAC MC: Ver: 3.0.0 [ 0.660040] PCI: Using ACPI for IRQ routing [ 0.666729] NetLabel: Initializing [ 0.667000] NetLabel: domain hash size = 128 [ 0.668000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.669011] NetLabel: unlabeled traffic allowed by default [ 0.670044] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 0.671000] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 0.674025] clocksource: Switched to clocksource tsc-early [ 0.688900] VFS: Disk quotas dquot_6.6.0 [ 0.692922] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.699934] pnp: PnP ACPI init [ 0.703421] system 00:01: [io 0x0500-0x057f] has been reserved [ 0.709427] system 00:01: [io 0x0400-0x047f] has been reserved [ 0.715433] system 00:01: [io 0x0580-0x059f] has been reserved [ 0.721438] system 00:01: [io 0x0600-0x061f] has been reserved [ 0.727435] system 00:01: [io 0x0880-0x0883] has been reserved [ 0.733436] system 00:01: [io 0x0800-0x081f] has been reserved [ 0.739441] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 0.746144] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 0.752843] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 0.759543] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 0.766242] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 0.772942] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 0.779642] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 0.786508] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 0.792513] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 0.798520] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 0.804528] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 0.810533] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 0.817268] pnp: PnP ACPI: found 5 devices [ 0.826778] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.835791] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 0.847382] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 0.855316] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.860365] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.865413] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.872286] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.879954] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.887973] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.895731] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.903835] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.911507] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.919523] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.927281] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.935387] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.943056] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.951075] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.958831] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.966936] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.974604] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.982623] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.990381] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.998484] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.003532] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.009705] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.016580] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.024428] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.029480] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.034526] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.040702] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.047582] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.052893] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.059067] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.065947] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 1.073791] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 1.081723] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 1.089575] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 1.097507] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.102558] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.108732] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.115607] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.123457] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.132609] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.138869] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.145134] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.152087] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.159047] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.166008] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.172968] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.179320] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.184978] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.191323] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.198642] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.204298] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.210643] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.216293] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.222638] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.228289] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.234636] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.242063] NET: Registered protocol family 2 [ 1.246700] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.256064] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 1.265049] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.273643] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 1.281338] TCP: Hash tables configured (established 262144 bind 65536) [ 1.288142] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 1.295997] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.303109] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.310696] NET: Registered protocol family 1 [ 1.315138] NET: Registered protocol family 44 [ 1.319746] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.343744] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x61f took 16315 usecs [ 1.367658] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x61f took 16010 usecs [ 1.375167] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.381702] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.390192] Unpacking initramfs... [ 1.670535] Freeing initrd memory: 28484K [ 1.674692] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.681216] software IO TLB: mapped [mem 0x0000000068000000-0x000000006c000000] (64MB) [ 1.689245] ACPI: bus type thunderbolt registered [ 1.707295] Initialise system trusted keyrings [ 1.711830] Key type blacklist registered [ 1.715943] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.723882] zbud: loaded [ 1.726747] pstore: using deflate compression [ 1.731379] Platform Keyring initialized [ 1.805610] NET: Registered protocol family 38 [ 1.810140] Key type asymmetric registered [ 1.814316] Asymmetric key parser 'x509' registered [ 1.819280] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 1.834606] io scheduler mq-deadline registered [ 1.839221] io scheduler kyber registered [ 1.843333] io scheduler bfq registered [ 1.847313] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.854609] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.860593] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.866568] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.872525] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.878483] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.884430] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.890386] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.897775] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.906249] ACPI: Power Button [PWRB] [ 1.910021] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.917542] ACPI: Power Button [PWRF] [ 1.922386] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.929997] pstore: Registered erst as persistent store backend [ 1.936152] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.943732] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.970669] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.998719] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.006501] Non-volatile memory driver v1.3 [ 2.011192] rdac: device handler registered [ 2.015527] hp_sw: device handler registered [ 2.019878] emc: device handler registered [ 2.024079] alua: device handler registered [ 2.028413] libphy: Fixed MDIO Bus: probed [ 2.032638] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.039249] ehci-pci: EHCI PCI platform driver [ 2.043871] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.049210] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.056716] ehci-pci 0000:00:1a.0: debug port 2 [ 2.065230] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.077042] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.082907] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.091275] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.098596] usb usb1: Product: EHCI Host Controller [ 2.103555] usb usb1: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.110685] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.115464] hub 1-0:1.0: USB hub found [ 2.119298] hub 1-0:1.0: 2 ports detected [ 2.123562] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.128909] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 2.136413] ehci-pci 0000:00:1d.0: debug port 2 [ 2.144928] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.157037] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.162893] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.171267] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.178586] usb usb2: Product: EHCI Host Controller [ 2.183547] usb usb2: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.190677] usb usb2: SerialNumber: 0000:00:1d.0 [ 2.195450] hub 2-0:1.0: USB hub found [ 2.199280] hub 2-0:1.0: 2 ports detected [ 2.203468] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.209739] ohci-pci: OHCI PCI platform driver [ 2.214276] uhci_hcd: USB Universal Host Controller Interface driver [ 2.220817] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.226171] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.234719] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.244088] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.252456] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.259776] usb usb3: Product: xHCI Host Controller [ 2.264737] usb usb3: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.271866] usb usb3: SerialNumber: 0000:00:14.0 [ 2.276733] hub 3-0:1.0: USB hub found [ 2.280575] hub 3-0:1.0: 15 ports detected [ 2.286389] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.291755] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.299252] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.305617] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 2.313988] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.321317] usb usb4: Product: xHCI Host Controller [ 2.326277] usb usb4: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.333406] usb usb4: SerialNumber: 0000:00:14.0 [ 2.338367] hub 4-0:1.0: USB hub found [ 2.342207] hub 4-0:1.0: 6 ports detected [ 2.347146] usbcore: registered new interface driver usbserial_generic [ 2.353761] usbserial: USB Serial support registered for generic [ 2.359876] i8042: PNP: No PS/2 controller found. [ 2.364719] mousedev: PS/2 mouse device common for all mice [ 2.370458] rtc_cmos 00:00: RTC can wake from S4 [ 2.375320] rtc_cmos 00:00: registered as rtc0 [ 2.379859] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 2.387624] intel_pstate: Intel P-state driver initializing [ 2.393535] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.400920] hid: raw HID events driver (C) Jiri Kosina [ 2.406168] usbcore: registered new interface driver usbhid [ 2.411831] usbhid: USB HID core driver [ 2.415836] drop_monitor: Initializing network drop monitor service [ 2.422230] Initializing XFRM netlink socket [ 2.426658] NET: Registered protocol family 10 [ 2.431382] Segment Routing with IPv6 [ 2.435142] NET: Registered protocol family 17 [ 2.439759] mpls_gso: MPLS GSO support [ 2.443962] microcode: sig=0x406f1, pf=0x1, revision=0xb000010 [ 2.449985] microcode: Microcode Update Driver: v2.2. [ 2.450057] resctrl: L3 allocation detected [ 2.459451] resctrl: L3DATA allocation detected [ 2.464062] resctrl: L3CODE allocation detected [ 2.468675] resctrl: L3 monitoring detected [ 2.472943] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 2.472947] AVX2 version of gcm_enc/dec engaged. [ 2.484259] AES CTR mode by8 optimization enabled [ 2.514009] sched_clock: Marking stable (2514003604, 0)->(5557787019, -3043783415) [ 2.521796] registered taskstats version 1 [ 2.526101] Loading compiled-in X.509 certificates [ 2.545425] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.553025] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 2.553705] usb 1-1: New USB device strings: Mfr=0,oduct=0, SerialNumber=0 [ 2.556265] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: fcec8079a12caa6a157125702c0054357b4fc157' [ 2.556548] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.556806] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.556839] zswap: loaded using pool lzo/zbud [ 2.578407] page_owner is disabled [ 2.590345] hub 1-1:1.0: USB hub found [ 2.605571] Key type big_key registered [ 2.608814] hub 1-1:1.0: 6 ports detected [ 2.614888] Key type encrypted registered [ 2.624701] ima: No TPM chip found, activating TPM-bypass! [ 2.628431] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.630269] ima: Allocated hash algorithm: sha256 [ 2.638541] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.643379] ima: No architecture policies found [ 2.655224] evm: Initialising EVM extended attributes: [ 2.655457] hub 2-1:1.0: USB hub found [ 2.660445] evm: security.selinux [ 2.660445] evm: security.ima [ 2.660446] evm: security.capability [ 2.660446] evm: HMAC attrs: 0x1 [ 2.664308] rtc_cmos 00:00: setting system clock to 2023-10-08 07:00:14 UTC (1696748414) [ 2.667838] hub 2-1:1.0: 8 ports detected [ 2.686222] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.698436] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.706035] hub 3-12:1.0: USB hub found [ 2.710022] hub 3-12:1.0: 4 ports detected [ 2.714443] Freeing unused decrypted memory: 2036K [ 2.719024] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.725596] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.736101] Freeing unused kernel image (initmem) memory: 2520K [ 2.742108] clocksource: Switched to clocksource tsc [ 2.747154] Write protecting the kernel read-only data: 24576k [ 2.753445] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 2.760430] Freeing unused kernel image (rodata/data gap) memory: 1948K [ 2.776402] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 2.811142] systemd[1]: Detected architecture x86-64. [ 2.816285] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 2.840083] systemd[1]: Set hostname to . [ 2.884604] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 2.894283] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 2.907114] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 2.917275] systemd[1]: Listening on udev Control Socket. [ ol Socket. [ d[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 2.941108] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Sockets. Starting Journal Service... Starting Apply Kernel Variables... Starting Create Volatile Files and Directories... Starting Setup Virtual Console... [ 3.009030] usb 3-12.umber 3 using xhlist of required st…ce nodes for the current kernel... [ OK ] Started Apply Kernel Variables. [ OK ] Started Journal Service. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Startinine hook... [ 3.113338] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.122137] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.134814] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ 3.198237] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 Startin[ 3.210855] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 g udev Coldplug [ 3.223975] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ OK ] Reached target System Initialization. [ 3.350679] dca service started, version 1.12.1 Starting dracut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reach[ 3.372897] igb: Intel(R) Gigabit Ethernet Network Driver ed target Paths.[ 3.379084] igb: Copyright (c) 2007-2014 Intel Corporation. [ OK ] Reached target Basic System. [ 3.398483] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 3.406710] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.414681] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 3.420891] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 3.423350] scsi host0: ahci [ 3.423636] nvme nvme0: pci function 0000:02:00.0 [ 3.424467] scsi host1: ahci [ 3.430688] nvme nvme0: 8/0/0 default/read/poll queues [ 3.433173] scsi host2: ahci [ 3.438529] nvme0n1: detected capacity change from 0 to 400088457216 [ 3.440921] scsi host3: ahci [ 3.441133] igb 0000:07:00.0: added PHC on eth0 [ 3.441135] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 3.441136] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:aa [ 3.441211] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 3.441213] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.490196] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 3.496404] igb 0000:07:00.1: added PHC on eth1 [ 3.497701] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 3.502312] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 3.509802] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 3.516762] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:ab [ 3.524262] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 3.524489] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 3.531561] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 3.538986] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.547262] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.567373] scsi host4: ahci [ 3.568872] igb 0000:07:00.0 eno1: renamed from eth0 [ 3.570904] scsi host5: ahci [ 3.578934] scsi host6: ahci [ 3.579021] scsi host7: ahci [ 3.579112] scsi host8: ahci [ 3.579239] scsi host9: ahci [ 3.579302] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 3.579305] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 3.579308] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 3.579310] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 3.579312] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 3.579316] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 3.580237] igb 0000:07:00.1 eno2: renamed from eth1 [ 3.590265] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 3.590270] ast 0000:06:00.0: [drm] AST 2400 detected [ 3.590289] ast 0000:06:00.0: [drm] Analog VGA only [ 3.590312] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 3.591339] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 3.700404] fbcon: astdrmfb (fb0) is primary device [ 3.812527] Console: switching to colour frame buffer device 128x48 [ 3.829266] ata4: SATA link down (SStatus 0 SControl 300) [ 3.830008] ata3: SATA link down (SStatus 0 SControl 300) [ 3.838144] ata2: SATA link down (SStatus 0 SControl 300) [ 3.842044] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 3.885067] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 3.891374] ata10: SATA link down (SStatus 0 SControl 300) [ 3.896924] ata7: SATA link down (SStatus 0 SControl 300) [ 3.902430] ata9: SATA link down (SStatus 0 SControl 300) [ 3.907957] ata6: SATA link down (SStatus 0 SControl 300) [ 3.913463] ata8: SATA link down (SStatus 0 SControl 300) [ 3.913541] ata1: SATA link down (SStatus 0 SControl 300) [ 3.919639] ata5.00: NCQ Send/Recv Log not supported [ 3.929324] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 3.929326] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 3.936910] ata5.00: NCQ Send/Recv Log not supported [ 3.948051] ata5.00: configured for UDMA/133 [ 3.948249] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 3.965440] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 3.974720] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 3.982853] sd 4:0:0:0: [sda] Write Protect is off [ 3.987963] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 4.008403] sda: sda1 [ 4.015789] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 4.564315] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.575031] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.583981] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 4.590595] ixgbe 0000:03:00.0: 0c:c4:7a:88:80:84 [ 4.610234] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 4.617478] libphy: ixgbe-mdio: probed [ 4.806215] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.816931] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.825878] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 4.833347] ixgbe 0000:03:00.1: 0c:c4:7a:88:80:85 [ 4.842074] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 4.849418] libphy: ixgbe-mdio: probed [ 4.855128] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 4.902413] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…b72-f581-4b1d-8578-0d8161fd4ca1... [* ] A start job is running for File Sys…-8578-0d8161fd4ca1 (9s / no limit) [ OK ] Started File System Check on /dev/d…86b72-f581-4b1d-8578-0d8161fd4ca1. Mounting /sysroot... [ 12.901907] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. Starting Plymouth switch root service... [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. Stopping udev Kernel Device Manager... [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Starting Setup Virtual Console... [ OK ] Stopped Apply Kernel Variables. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 13.313866] printk: systemd: 12 output lines suppressed due to ratelimiting [ 13.988767] SELinux: policy capability network_peer_controls=1 [ 13.995024] SELinux: policy capability open_perms=1 [ 14.000300] SELinux: policy capability extended_socket_class=1 [ 14.006516] SELinux: policy capability always_check_network=0 [ 14.012640] SELinux: policy capability cgroup_seclabel=1 [ 14.018323] SELinux: policy capability nnp_nosuid_transition=1 [ 14.057003] audit: type=1403 audit(1696748425.894:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 14.058502] systemd[1]: Successfully loaded SELinux policy in 236.164ms. [ 14.132065] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.300ms. [ 14.164800] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 14.202533] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 14.236261] systemd[1]: Set hostname to . [ 15.165188] systemd[1]: systemd-journald.service: Succeeded. [ 15.187764] systemd[1]: initrd-switch-root.service: Succeeded. [ 15.195632] systemd[1]: Stopped Switch Root. [ OK [[ 15.201138] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 15.201224] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 15.201279] systemd[1]: Stopped Journal Service. [ OK [[ 15.230115] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Mounting Kernel Debug File System... Mounting Huge Pages File System... Mounting POSIX Message Queue File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Stopped target Switch Root. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Created slice User and Session Slice. [ OK ] Created slice system-getty.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Slices. [ OK ] Reached target Swap. [ OK ] Listening on udev Control Socket. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on RPCbind Server Activation Socket. Starting Read and set NIS domainname from /etc/sysconfig/network... Starting Load Kernel Modules... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ 15.458653] device-mapper: uevent: version 1.0.3 [ 15.458834] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com [ OK ] Listening on Process Core Dump Socket. [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target RPC Port Mapper. Starting[ 15.504119] EXT4-fs (sda1): re-mounted. Opts: (null) Create list of required st…ce nodes for the current kernel... [ OK ] Stopped t[ 15.520622] fuse: init (API version 7.33) arget Initrd Root File System. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting Setup Virtual Console... [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. Starting Remount Root and Kernel File Systems... [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Mounted FUSE Control File System. [ OK ] Started Apply Kernel Variables. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load/Save Random Seed. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Restore /run/initramfs on shutdown... Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ 16.180787] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Started Create Volatile Files and Directorie[ 16.202475] igb 0000:07:00.0: DCA enabled s. Starting Security [ 16.207662] igb 0000:07:00.1: DCA enabled Auditing Service... Starting RPC Bind... Mounting RPC Pipe File System... [ 16.284800] IPMI message handler: version 39.2 [ 16.339429] ipmi device interface [ 16.366569] ipmi_si: IPMI System Interface driver [ OK ] Started RPC [ 16.377478] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS Bind. [ 16.386240] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 16.389163] RPC: Registered named UNIX socket transport module. [ 16.395778] ipmi_si: Adding SMBIOS-specified kcs state machine [ 16.401386] RPC: Registered udp transport module. [ 16.410662] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 16.413985] RPC: Registered tcp transport module. [ 16.422366] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 16.426585] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.438967] power_meter ACPI000D:00: Found ACPI power meter. [ OK ] Created slic[ 16.453054] power_meter ACPI000D:00: Ignoring unsafe software power cap! e system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ OK [[ 16.475183] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt 0m] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 16.523601] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 16.533146] ipmi_si: Adding ACPI-specified kcs state machine [ 16.533263] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 16.545527] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 16.577087] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 16.600504] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 16.641551] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 16.672827] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 16.676401] ipmi_ssif: IPMI SSIF Interface driver [ 16.685667] iTCO_vendor_support: vendor-support=0 [ 16.686297] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 16.686298] RAPL PMU: hw unit of domain package 2^-14 Joules [ 16.686299] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 16.687266] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 16.687315] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 16.687472] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Reached target Timers. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ 16.918046] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 16.941559] XFS (dm-4): Mounting V5 Filesystem [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting System Security Services Daemon... [ OK ] Started irqbalance daemon. [ OK ] Started Machine Check Exception Loggin[ 16.991194] XFS (dm-4): Ending clean mount g Daemon. Starting Avahi mDNS/DNS-SD Stack... Starting Resets System Activity Logs... Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Load CPU microcode update... Starting Kernel Samepage Merging... Starting NTP client/server... Starting VDO volume services... Starting Authorization Manager... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started LVM event activation on device 259:0. [ OK ] Mounted /var/lib/ceph. [ 17.257394] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 17.268762] EDAC sbridge: Ver: 1.1.2 [ 17.392575] intel_rapl_common: Found RAPL domain package [ 17.415038] intel_rapl_common: Found RAPL domain dram [ 17.420499] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Load CPU microcode update. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started NTP client/server. [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 19.079961] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. [ 19.142757] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 19.152711] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 19.211818] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 19.237584] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 19.285050] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ OK ] Started Authorization Manager. [ 19.399966] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 19.410719] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 19.457784] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 19.568013] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 19.675466] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 19.783116] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 19.808227] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Permit User Sessions... Starting CUPS Scheduler... Starting Login Service... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. [ OK ] Started Nagios Remote Plugin Executor. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... Starting /etc/rc.d/rc.local Compatibility... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips= + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' '' '!=' '' ']' + '[' 1 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips= + attempts=2 + sleep 1 + '[' '' '!=' '' ']' + '[' 2 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.183 + attempts=3 + sleep 1 + '[' 172.21.15.183 '!=' '' ']' + set -e + '[' -n 172.21.15.183 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.183 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.183 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi183.front.sepia.ceph.com + '[' -n smithi183.front.sepia.ceph.com ']' + hostname smithi183.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi183 + echo smithi183 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.183 smithi183.front.sepia.ceph.com smithi183\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi183 login: [disconnect] 2023-10-08T07:00:47.199 INFO:teuthology.misc:Re-opening connections... 2023-10-08T07:00:47.199 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T07:00:47.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T07:00:47.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T07:00:47.756 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-08T07:00:48.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T07:00:48.028 DEBUG:teuthology.misc:waited 0.8291633129119873 2023-10-08T07:00:48.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2023-10-08T07:00:49.029 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T07:00:49.029 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi183.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2023-10-08T07:00:49.029 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-10-08T07:00:49.150 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T07:00:49.195 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T07:00:49.195 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T07:00:49.197 INFO:tasks.ceph.osd.2:Started 2023-10-08T07:00:49.198 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:00:49.326 INFO:teuthology.orchestra.run.smithi183.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2023-10-08T07:00:49.329 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-08T07:00:49.330 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2023-10-08T07:00:50.061 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T07:00:49.990+0000 7f46de1b2640 -1 Falling back to public interface 2023-10-08T07:00:54.331 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:00:54.451 INFO:teuthology.orchestra.run.smithi183.stderr:no valid command found; 10 closest matches: 2023-10-08T07:00:54.451 INFO:teuthology.orchestra.run.smithi183.stderr:0 2023-10-08T07:00:54.452 INFO:teuthology.orchestra.run.smithi183.stderr:1 2023-10-08T07:00:54.452 INFO:teuthology.orchestra.run.smithi183.stderr:2 2023-10-08T07:00:54.452 INFO:teuthology.orchestra.run.smithi183.stderr:abort 2023-10-08T07:00:54.452 INFO:teuthology.orchestra.run.smithi183.stderr:assert 2023-10-08T07:00:54.452 INFO:teuthology.orchestra.run.smithi183.stderr:config diff 2023-10-08T07:00:54.452 INFO:teuthology.orchestra.run.smithi183.stderr:config diff get 2023-10-08T07:00:54.453 INFO:teuthology.orchestra.run.smithi183.stderr:config get 2023-10-08T07:00:54.453 INFO:teuthology.orchestra.run.smithi183.stderr:config help [] 2023-10-08T07:00:54.453 INFO:teuthology.orchestra.run.smithi183.stderr:config set ... 2023-10-08T07:00:54.453 INFO:teuthology.orchestra.run.smithi183.stderr:admin_socket: invalid command 2023-10-08T07:00:54.454 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-08T07:00:54.455 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2023-10-08T07:00:54.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-08T07:00:56.026 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T07:00:55.954+0000 7f46de1b2640 -1 osd.2 38 log_to_monitors true 2023-10-08T07:00:56.738 INFO:tasks.ceph.osd.2.smithi183.stderr:2023-10-08T07:00:56.665+0000 7f46ca144700 -1 osd.2 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T07:00:59.456 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:00:59.595 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-10-08T07:00:59.596 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2023-10-08T07:00:59.596 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2023-10-08T07:00:59.596 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-10-08T07:01:04.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2023-10-08T07:01:04.762 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a: {} 2023-10-08T07:01:04.771 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b: {} 2023-10-08T07:01:04.781 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c: {} 2023-10-08T07:01:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:mon.a: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-10-08T07:01:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:mon.b: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-10-08T07:01:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:mon.c: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-10-08T07:01:04.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-10-08T07:01:05.861 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2023-10-08T07:01:05.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2023-10-08T07:01:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.0 primary-affinity to 1 (8655362) 2023-10-08T07:01:06.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-10-08T07:01:07.876 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2023-10-08T07:01:07.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2023-10-08T07:01:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.1 primary-affinity to 1 (8655362) 2023-10-08T07:01:08.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-10-08T07:01:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2023-10-08T07:01:09.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2023-10-08T07:01:10.892 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.2 primary-affinity to 1 (8655362) 2023-10-08T07:01:10.906 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2023-10-08T07:01:10.906 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2023-10-08T07:01:10.906 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2023-10-08T07:01:10.906 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2023-10-08T07:01:10.906 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T07:01:10.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:01:11.250 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:11.250 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":80,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T07:01:10.881837+0000","last_up_change":"2023-10-08T07:00:57.716764+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":38,"up_from":73,"up_thru":73,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6801","nonce":3759124899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6803","nonce":3759124899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6807","nonce":3759124899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6805","nonce":3759124899}]},"public_addr":"172.21.15.183:6801/3759124899","cluster_addr":"172.21.15.183:6803/3759124899","heartbeat_back_addr":"172.21.15.183:6807/3759124899","heartbeat_front_addr":"172.21.15.183:6805/3759124899","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":38}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:01:11.264 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T07:01:11.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:01:11.597 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:11.597 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":80,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T07:01:10.881837+0000","last_up_change":"2023-10-08T07:00:57.716764+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":38,"up_from":73,"up_thru":73,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6801","nonce":3759124899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6803","nonce":3759124899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6807","nonce":3759124899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6805","nonce":3759124899}]},"public_addr":"172.21.15.183:6801/3759124899","cluster_addr":"172.21.15.183:6803/3759124899","heartbeat_back_addr":"172.21.15.183:6807/3759124899","heartbeat_front_addr":"172.21.15.183:6805/3759124899","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":38}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:01:11.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T07:01:11.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T07:01:11.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T07:01:11.784 INFO:teuthology.orchestra.run.smithi037.stdout:34359738421 2023-10-08T07:01:11.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:01:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:313532612613 2023-10-08T07:01:11.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:01:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:34359738421 2023-10-08T07:01:11.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:01:12.146 INFO:teuthology.orchestra.run.smithi037.stdout:34359738420 2023-10-08T07:01:12.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.0 2023-10-08T07:01:12.189 INFO:teuthology.orchestra.run.smithi037.stdout:313532612611 2023-10-08T07:01:12.190 INFO:teuthology.orchestra.run.smithi037.stdout:34359738420 2023-10-08T07:01:12.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.1 2023-10-08T07:01:12.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 313532612613 got 313532612611 for osd.2 2023-10-08T07:01:13.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:01:13.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:01:13.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:01:13.537 INFO:teuthology.orchestra.run.smithi037.stdout:34359738420 2023-10-08T07:01:13.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.0 2023-10-08T07:01:13.562 INFO:teuthology.orchestra.run.smithi037.stdout:313532612611 2023-10-08T07:01:13.565 INFO:teuthology.orchestra.run.smithi037.stdout:34359738420 2023-10-08T07:01:13.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 313532612613 got 313532612611 for osd.2 2023-10-08T07:01:13.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.1 2023-10-08T07:01:14.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:01:14.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:01:14.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:01:14.917 INFO:teuthology.orchestra.run.smithi037.stdout:34359738421 2023-10-08T07:01:14.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738421 for osd.0 2023-10-08T07:01:14.932 DEBUG:teuthology.parallel:result is None 2023-10-08T07:01:14.955 INFO:teuthology.orchestra.run.smithi037.stdout:313532612613 2023-10-08T07:01:14.956 INFO:teuthology.orchestra.run.smithi037.stdout:34359738421 2023-10-08T07:01:14.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 313532612613 got 313532612613 for osd.2 2023-10-08T07:01:14.971 DEBUG:teuthology.parallel:result is None 2023-10-08T07:01:14.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738421 for osd.1 2023-10-08T07:01:14.972 DEBUG:teuthology.parallel:result is None 2023-10-08T07:01:14.972 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-10-08T07:01:14.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:01:15.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:01:15.366 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2023-10-08T07:01:15.007648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679228,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436292,"statfs":{"total":289910292480,"available":289214763008,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135536"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889369+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:09.889369+0000","last_peered":"2023-10-08T07:01:09.889369+0000","last_clean":"2023-10-08T07:01:09.889369+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:09.889369+0000","last_undegraded":"2023-10-08T07:01:09.889369+0000","last_fullsized":"2023-10-08T07:01:09.889369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879623+0000","last_change":"2023-10-08T07:00:58.757022+0000","last_active":"2023-10-08T07:01:09.879623+0000","last_peered":"2023-10-08T07:01:09.879623+0000","last_clean":"2023-10-08T07:01:09.879623+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:09.879623+0000","last_undegraded":"2023-10-08T07:01:09.879623+0000","last_fullsized":"2023-10-08T07:01:09.879623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:57.715272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876818+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:09.876818+0000","last_peered":"2023-10-08T07:01:09.876818+0000","last_clean":"2023-10-08T07:01:09.876818+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:09.876818+0000","last_undegraded":"2023-10-08T07:01:09.876818+0000","last_fullsized":"2023-10-08T07:01:09.876818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876767+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:09.876767+0000","last_peered":"2023-10-08T07:01:09.876767+0000","last_clean":"2023-10-08T07:01:09.876767+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:09.876767+0000","last_undegraded":"2023-10-08T07:01:09.876767+0000","last_fullsized":"2023-10-08T07:01:09.876767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:08.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886836+0000","last_change":"2023-10-08T07:01:09.882134+0000","last_active":"2023-10-08T07:01:09.886836+0000","last_peered":"2023-10-08T07:01:09.886836+0000","last_clean":"2023-10-08T07:01:09.886836+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:09.886836+0000","last_undegraded":"2023-10-08T07:01:09.886836+0000","last_fullsized":"2023-10-08T07:01:09.886836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876241+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:09.876241+0000","last_peered":"2023-10-08T07:01:09.876241+0000","last_clean":"2023-10-08T07:01:09.876241+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:09.876241+0000","last_undegraded":"2023-10-08T07:01:09.876241+0000","last_fullsized":"2023-10-08T07:01:09.876241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.341032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875903+0000","last_change":"2023-10-08T07:00:58.741788+0000","last_active":"2023-10-08T07:01:09.875903+0000","last_peered":"2023-10-08T07:01:09.875903+0000","last_clean":"2023-10-08T07:01:09.875903+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:09.875903+0000","last_undegraded":"2023-10-08T07:01:09.875903+0000","last_fullsized":"2023-10-08T07:01:09.875903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875853+0000","last_change":"2023-10-08T07:00:58.743309+0000","last_active":"2023-10-08T07:01:09.875853+0000","last_peered":"2023-10-08T07:01:09.875853+0000","last_clean":"2023-10-08T07:01:09.875853+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:09.875853+0000","last_undegraded":"2023-10-08T07:01:09.875853+0000","last_fullsized":"2023-10-08T07:01:09.875853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805710+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:09.805710+0000","last_peered":"2023-10-08T07:01:09.805710+0000","last_clean":"2023-10-08T07:01:09.805710+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:09.805710+0000","last_undegraded":"2023-10-08T07:01:09.805710+0000","last_fullsized":"2023-10-08T07:01:09.805710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:14.193056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879851+0000","last_change":"2023-10-08T07:00:58.757350+0000","last_active":"2023-10-08T07:01:09.879851+0000","last_peered":"2023-10-08T07:01:09.879851+0000","last_clean":"2023-10-08T07:01:09.879851+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:09.879851+0000","last_undegraded":"2023-10-08T07:01:09.879851+0000","last_fullsized":"2023-10-08T07:01:09.879851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:38.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876686+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:09.876686+0000","last_peered":"2023-10-08T07:01:09.876686+0000","last_clean":"2023-10-08T07:01:09.876686+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:09.876686+0000","last_undegraded":"2023-10-08T07:01:09.876686+0000","last_fullsized":"2023-10-08T07:01:09.876686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:11.748373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886800+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:09.886800+0000","last_peered":"2023-10-08T07:01:09.886800+0000","last_clean":"2023-10-08T07:01:09.886800+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:09.886800+0000","last_undegraded":"2023-10-08T07:01:09.886800+0000","last_fullsized":"2023-10-08T07:01:09.886800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:50.428711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.884162+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:09.884162+0000","last_peered":"2023-10-08T07:01:09.884162+0000","last_clean":"2023-10-08T07:01:09.884162+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:09.884162+0000","last_undegraded":"2023-10-08T07:01:09.884162+0000","last_fullsized":"2023-10-08T07:01:09.884162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876609+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:09.876609+0000","last_peered":"2023-10-08T07:01:09.876609+0000","last_clean":"2023-10-08T07:01:09.876609+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:09.876609+0000","last_undegraded":"2023-10-08T07:01:09.876609+0000","last_fullsized":"2023-10-08T07:01:09.876609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876291+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:09.876291+0000","last_peered":"2023-10-08T07:01:09.876291+0000","last_clean":"2023-10-08T07:01:09.876291+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:09.876291+0000","last_undegraded":"2023-10-08T07:01:09.876291+0000","last_fullsized":"2023-10-08T07:01:09.876291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875872+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:09.875872+0000","last_peered":"2023-10-08T07:01:09.875872+0000","last_clean":"2023-10-08T07:01:09.875872+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:09.875872+0000","last_undegraded":"2023-10-08T07:01:09.875872+0000","last_fullsized":"2023-10-08T07:01:09.875872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805445+0000","last_change":"2023-10-08T07:00:58.689994+0000","last_active":"2023-10-08T07:01:09.805445+0000","last_peered":"2023-10-08T07:01:09.805445+0000","last_clean":"2023-10-08T07:01:09.805445+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:09.805445+0000","last_undegraded":"2023-10-08T07:01:09.805445+0000","last_fullsized":"2023-10-08T07:01:09.805445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:38.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879888+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:09.879888+0000","last_peered":"2023-10-08T07:01:09.879888+0000","last_clean":"2023-10-08T07:01:09.879888+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:09.879888+0000","last_undegraded":"2023-10-08T07:01:09.879888+0000","last_fullsized":"2023-10-08T07:01:09.879888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:20.556448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805312+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:09.805312+0000","last_peered":"2023-10-08T07:01:09.805312+0000","last_clean":"2023-10-08T07:01:09.805312+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:09.805312+0000","last_undegraded":"2023-10-08T07:01:09.805312+0000","last_fullsized":"2023-10-08T07:01:09.805312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:57:56.486710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876667+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:09.876667+0000","last_peered":"2023-10-08T07:01:09.876667+0000","last_clean":"2023-10-08T07:01:09.876667+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:09.876667+0000","last_undegraded":"2023-10-08T07:01:09.876667+0000","last_fullsized":"2023-10-08T07:01:09.876667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:21.278271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876239+0000","last_change":"2023-10-08T07:00:58.743568+0000","last_active":"2023-10-08T07:01:09.876239+0000","last_peered":"2023-10-08T07:01:09.876239+0000","last_clean":"2023-10-08T07:01:09.876239+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:09.876239+0000","last_undegraded":"2023-10-08T07:01:09.876239+0000","last_fullsized":"2023-10-08T07:01:09.876239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:22.726402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886866+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:09.886866+0000","last_peered":"2023-10-08T07:01:09.886866+0000","last_clean":"2023-10-08T07:01:09.886866+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:09.886866+0000","last_undegraded":"2023-10-08T07:01:09.886866+0000","last_fullsized":"2023-10-08T07:01:09.886866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:30.912592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804896+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:09.804896+0000","last_peered":"2023-10-08T07:01:09.804896+0000","last_clean":"2023-10-08T07:01:09.804896+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:09.804896+0000","last_undegraded":"2023-10-08T07:01:09.804896+0000","last_fullsized":"2023-10-08T07:01:09.804896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:28.061195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878224+0000","last_change":"2023-10-08T07:00:58.757259+0000","last_active":"2023-10-08T07:01:09.878224+0000","last_peered":"2023-10-08T07:01:09.878224+0000","last_clean":"2023-10-08T07:01:09.878224+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:09.878224+0000","last_undegraded":"2023-10-08T07:01:09.878224+0000","last_fullsized":"2023-10-08T07:01:09.878224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:50.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880708+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:09.880708+0000","last_peered":"2023-10-08T07:01:09.880708+0000","last_clean":"2023-10-08T07:01:09.880708+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:09.880708+0000","last_undegraded":"2023-10-08T07:01:09.880708+0000","last_fullsized":"2023-10-08T07:01:09.880708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805824+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:09.805824+0000","last_peered":"2023-10-08T07:01:09.805824+0000","last_clean":"2023-10-08T07:01:09.805824+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:09.805824+0000","last_undegraded":"2023-10-08T07:01:09.805824+0000","last_fullsized":"2023-10-08T07:01:09.805824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:02:40.932995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876702+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:09.876702+0000","last_peered":"2023-10-08T07:01:09.876702+0000","last_clean":"2023-10-08T07:01:09.876702+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:09.876702+0000","last_undegraded":"2023-10-08T07:01:09.876702+0000","last_fullsized":"2023-10-08T07:01:09.876702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889382+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:09.889382+0000","last_peered":"2023-10-08T07:01:09.889382+0000","last_clean":"2023-10-08T07:01:09.889382+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889382+0000","last_undegraded":"2023-10-08T07:01:09.889382+0000","last_fullsized":"2023-10-08T07:01:09.889382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879867+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:09.879867+0000","last_peered":"2023-10-08T07:01:09.879867+0000","last_clean":"2023-10-08T07:01:09.879867+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:09.879867+0000","last_undegraded":"2023-10-08T07:01:09.879867+0000","last_fullsized":"2023-10-08T07:01:09.879867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804720+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:09.804720+0000","last_peered":"2023-10-08T07:01:09.804720+0000","last_clean":"2023-10-08T07:01:09.804720+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:09.804720+0000","last_undegraded":"2023-10-08T07:01:09.804720+0000","last_fullsized":"2023-10-08T07:01:09.804720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:18.521858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805896+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:09.805896+0000","last_peered":"2023-10-08T07:01:09.805896+0000","last_clean":"2023-10-08T07:01:09.805896+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:09.805896+0000","last_undegraded":"2023-10-08T07:01:09.805896+0000","last_fullsized":"2023-10-08T07:01:09.805896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:14:38.780240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804669+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:09.804669+0000","last_peered":"2023-10-08T07:01:09.804669+0000","last_clean":"2023-10-08T07:01:09.804669+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:09.804669+0000","last_undegraded":"2023-10-08T07:01:09.804669+0000","last_fullsized":"2023-10-08T07:01:09.804669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:42.865388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880661+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:09.880661+0000","last_peered":"2023-10-08T07:01:09.880661+0000","last_clean":"2023-10-08T07:01:09.880661+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:09.880661+0000","last_undegraded":"2023-10-08T07:01:09.880661+0000","last_fullsized":"2023-10-08T07:01:09.880661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805748+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:09.805748+0000","last_peered":"2023-10-08T07:01:09.805748+0000","last_clean":"2023-10-08T07:01:09.805748+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:09.805748+0000","last_undegraded":"2023-10-08T07:01:09.805748+0000","last_fullsized":"2023-10-08T07:01:09.805748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:05:28.271541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804563+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:09.804563+0000","last_peered":"2023-10-08T07:01:09.804563+0000","last_clean":"2023-10-08T07:01:09.804563+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:09.804563+0000","last_undegraded":"2023-10-08T07:01:09.804563+0000","last_fullsized":"2023-10-08T07:01:09.804563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:40.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876794+0000","last_change":"2023-10-08T07:00:58.742002+0000","last_active":"2023-10-08T07:01:09.876794+0000","last_peered":"2023-10-08T07:01:09.876794+0000","last_clean":"2023-10-08T07:01:09.876794+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:09.876794+0000","last_undegraded":"2023-10-08T07:01:09.876794+0000","last_fullsized":"2023-10-08T07:01:09.876794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:29.906921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805026+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:09.805026+0000","last_peered":"2023-10-08T07:01:09.805026+0000","last_clean":"2023-10-08T07:01:09.805026+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:09.805026+0000","last_undegraded":"2023-10-08T07:01:09.805026+0000","last_fullsized":"2023-10-08T07:01:09.805026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:26.532564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879366+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:09.879366+0000","last_peered":"2023-10-08T07:01:09.879366+0000","last_clean":"2023-10-08T07:01:09.879366+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:09.879366+0000","last_undegraded":"2023-10-08T07:01:09.879366+0000","last_fullsized":"2023-10-08T07:01:09.879366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804726+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:09.804726+0000","last_peered":"2023-10-08T07:01:09.804726+0000","last_clean":"2023-10-08T07:01:09.804726+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:09.804726+0000","last_undegraded":"2023-10-08T07:01:09.804726+0000","last_fullsized":"2023-10-08T07:01:09.804726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:54.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876664+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:09.876664+0000","last_peered":"2023-10-08T07:01:09.876664+0000","last_clean":"2023-10-08T07:01:09.876664+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:09.876664+0000","last_undegraded":"2023-10-08T07:01:09.876664+0000","last_fullsized":"2023-10-08T07:01:09.876664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876537+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:09.876537+0000","last_peered":"2023-10-08T07:01:09.876537+0000","last_clean":"2023-10-08T07:01:09.876537+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:09.876537+0000","last_undegraded":"2023-10-08T07:01:09.876537+0000","last_fullsized":"2023-10-08T07:01:09.876537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876642+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:09.876642+0000","last_peered":"2023-10-08T07:01:09.876642+0000","last_clean":"2023-10-08T07:01:09.876642+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:09.876642+0000","last_undegraded":"2023-10-08T07:01:09.876642+0000","last_fullsized":"2023-10-08T07:01:09.876642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:49.423040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886847+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:09.886847+0000","last_peered":"2023-10-08T07:01:09.886847+0000","last_clean":"2023-10-08T07:01:09.886847+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:09.886847+0000","last_undegraded":"2023-10-08T07:01:09.886847+0000","last_fullsized":"2023-10-08T07:01:09.886847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:53.793279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804844+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:09.804844+0000","last_peered":"2023-10-08T07:01:09.804844+0000","last_clean":"2023-10-08T07:01:09.804844+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:09.804844+0000","last_undegraded":"2023-10-08T07:01:09.804844+0000","last_fullsized":"2023-10-08T07:01:09.804844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:09.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886829+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:09.886829+0000","last_peered":"2023-10-08T07:01:09.886829+0000","last_clean":"2023-10-08T07:01:09.886829+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:09.886829+0000","last_undegraded":"2023-10-08T07:01:09.886829+0000","last_fullsized":"2023-10-08T07:01:09.886829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878197+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:09.878197+0000","last_peered":"2023-10-08T07:01:09.878197+0000","last_clean":"2023-10-08T07:01:09.878197+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:09.878197+0000","last_undegraded":"2023-10-08T07:01:09.878197+0000","last_fullsized":"2023-10-08T07:01:09.878197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805734+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:09.805734+0000","last_peered":"2023-10-08T07:01:09.805734+0000","last_clean":"2023-10-08T07:01:09.805734+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:09.805734+0000","last_undegraded":"2023-10-08T07:01:09.805734+0000","last_fullsized":"2023-10-08T07:01:09.805734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:48:19.319694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876264+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:09.876264+0000","last_peered":"2023-10-08T07:01:09.876264+0000","last_clean":"2023-10-08T07:01:09.876264+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:09.876264+0000","last_undegraded":"2023-10-08T07:01:09.876264+0000","last_fullsized":"2023-10-08T07:01:09.876264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805857+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:09.805857+0000","last_peered":"2023-10-08T07:01:09.805857+0000","last_clean":"2023-10-08T07:01:09.805857+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:09.805857+0000","last_undegraded":"2023-10-08T07:01:09.805857+0000","last_fullsized":"2023-10-08T07:01:09.805857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:38.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876985+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:09.876985+0000","last_peered":"2023-10-08T07:01:09.876985+0000","last_clean":"2023-10-08T07:01:09.876985+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:09.876985+0000","last_undegraded":"2023-10-08T07:01:09.876985+0000","last_fullsized":"2023-10-08T07:01:09.876985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877688+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:09.877688+0000","last_peered":"2023-10-08T07:01:09.877688+0000","last_clean":"2023-10-08T07:01:09.877688+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:09.877688+0000","last_undegraded":"2023-10-08T07:01:09.877688+0000","last_fullsized":"2023-10-08T07:01:09.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879744+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:09.879744+0000","last_peered":"2023-10-08T07:01:09.879744+0000","last_clean":"2023-10-08T07:01:09.879744+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:09.879744+0000","last_undegraded":"2023-10-08T07:01:09.879744+0000","last_fullsized":"2023-10-08T07:01:09.879744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878510+0000","last_change":"2023-10-08T07:00:58.742366+0000","last_active":"2023-10-08T07:01:09.878510+0000","last_peered":"2023-10-08T07:01:09.878510+0000","last_clean":"2023-10-08T07:01:09.878510+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:09.878510+0000","last_undegraded":"2023-10-08T07:01:09.878510+0000","last_fullsized":"2023-10-08T07:01:09.878510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.443197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876833+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:09.876833+0000","last_peered":"2023-10-08T07:01:09.876833+0000","last_clean":"2023-10-08T07:01:09.876833+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:09.876833+0000","last_undegraded":"2023-10-08T07:01:09.876833+0000","last_fullsized":"2023-10-08T07:01:09.876833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876500+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:09.876500+0000","last_peered":"2023-10-08T07:01:09.876500+0000","last_clean":"2023-10-08T07:01:09.876500+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:09.876500+0000","last_undegraded":"2023-10-08T07:01:09.876500+0000","last_fullsized":"2023-10-08T07:01:09.876500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:41.315551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876366+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:09.876366+0000","last_peered":"2023-10-08T07:01:09.876366+0000","last_clean":"2023-10-08T07:01:09.876366+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:09.876366+0000","last_undegraded":"2023-10-08T07:01:09.876366+0000","last_fullsized":"2023-10-08T07:01:09.876366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:52.787608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805457+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:09.805457+0000","last_peered":"2023-10-08T07:01:09.805457+0000","last_clean":"2023-10-08T07:01:09.805457+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:09.805457+0000","last_undegraded":"2023-10-08T07:01:09.805457+0000","last_fullsized":"2023-10-08T07:01:09.805457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:46.069356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805138+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:09.805138+0000","last_peered":"2023-10-08T07:01:09.805138+0000","last_clean":"2023-10-08T07:01:09.805138+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:09.805138+0000","last_undegraded":"2023-10-08T07:01:09.805138+0000","last_fullsized":"2023-10-08T07:01:09.805138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:30.717351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876373+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:09.876373+0000","last_peered":"2023-10-08T07:01:09.876373+0000","last_clean":"2023-10-08T07:01:09.876373+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:09.876373+0000","last_undegraded":"2023-10-08T07:01:09.876373+0000","last_fullsized":"2023-10-08T07:01:09.876373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875889+0000","last_change":"2023-10-08T07:00:58.741881+0000","last_active":"2023-10-08T07:01:09.875889+0000","last_peered":"2023-10-08T07:01:09.875889+0000","last_clean":"2023-10-08T07:01:09.875889+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:09.875889+0000","last_undegraded":"2023-10-08T07:01:09.875889+0000","last_fullsized":"2023-10-08T07:01:09.875889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:42.957083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877011+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:09.877011+0000","last_peered":"2023-10-08T07:01:09.877011+0000","last_clean":"2023-10-08T07:01:09.877011+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:09.877011+0000","last_undegraded":"2023-10-08T07:01:09.877011+0000","last_fullsized":"2023-10-08T07:01:09.877011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886762+0000","last_change":"2023-10-08T07:01:09.881913+0000","last_active":"2023-10-08T07:01:09.886762+0000","last_peered":"2023-10-08T07:01:09.886762+0000","last_clean":"2023-10-08T07:01:09.886762+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:09.886762+0000","last_undegraded":"2023-10-08T07:01:09.886762+0000","last_fullsized":"2023-10-08T07:01:09.886762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:43.187153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876894+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:09.876894+0000","last_peered":"2023-10-08T07:01:09.876894+0000","last_clean":"2023-10-08T07:01:09.876894+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:09.876894+0000","last_undegraded":"2023-10-08T07:01:09.876894+0000","last_fullsized":"2023-10-08T07:01:09.876894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878020+0000","last_change":"2023-10-08T07:00:58.757070+0000","last_active":"2023-10-08T07:01:09.878020+0000","last_peered":"2023-10-08T07:01:09.878020+0000","last_clean":"2023-10-08T07:01:09.878020+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:09.878020+0000","last_undegraded":"2023-10-08T07:01:09.878020+0000","last_fullsized":"2023-10-08T07:01:09.878020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:54.400652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805649+0000","last_change":"2023-10-08T07:00:58.690359+0000","last_active":"2023-10-08T07:01:09.805649+0000","last_peered":"2023-10-08T07:01:09.805649+0000","last_clean":"2023-10-08T07:01:09.805649+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:09.805649+0000","last_undegraded":"2023-10-08T07:01:09.805649+0000","last_fullsized":"2023-10-08T07:01:09.805649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:24.632619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805631+0000","last_change":"2023-10-08T07:00:58.689104+0000","last_active":"2023-10-08T07:01:09.805631+0000","last_peered":"2023-10-08T07:01:09.805631+0000","last_clean":"2023-10-08T07:01:09.805631+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:09.805631+0000","last_undegraded":"2023-10-08T07:01:09.805631+0000","last_fullsized":"2023-10-08T07:01:09.805631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:19.488445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876918+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:09.876918+0000","last_peered":"2023-10-08T07:01:09.876918+0000","last_clean":"2023-10-08T07:01:09.876918+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:09.876918+0000","last_undegraded":"2023-10-08T07:01:09.876918+0000","last_fullsized":"2023-10-08T07:01:09.876918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879374+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:09.879374+0000","last_peered":"2023-10-08T07:01:09.879374+0000","last_clean":"2023-10-08T07:01:09.879374+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:09.879374+0000","last_undegraded":"2023-10-08T07:01:09.879374+0000","last_fullsized":"2023-10-08T07:01:09.879374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876563+0000","last_change":"2023-10-08T07:00:58.741459+0000","last_active":"2023-10-08T07:01:09.876563+0000","last_peered":"2023-10-08T07:01:09.876563+0000","last_clean":"2023-10-08T07:01:09.876563+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:09.876563+0000","last_undegraded":"2023-10-08T07:01:09.876563+0000","last_fullsized":"2023-10-08T07:01:09.876563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:38.166894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876349+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:09.876349+0000","last_peered":"2023-10-08T07:01:09.876349+0000","last_clean":"2023-10-08T07:01:09.876349+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:09.876349+0000","last_undegraded":"2023-10-08T07:01:09.876349+0000","last_fullsized":"2023-10-08T07:01:09.876349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:42.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805368+0000","last_change":"2023-10-08T07:00:58.689101+0000","last_active":"2023-10-08T07:01:09.805368+0000","last_peered":"2023-10-08T07:01:09.805368+0000","last_clean":"2023-10-08T07:01:09.805368+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:09.805368+0000","last_undegraded":"2023-10-08T07:01:09.805368+0000","last_fullsized":"2023-10-08T07:01:09.805368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:57.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804920+0000","last_change":"2023-10-08T07:00:58.686855+0000","last_active":"2023-10-08T07:01:09.804920+0000","last_peered":"2023-10-08T07:01:09.804920+0000","last_clean":"2023-10-08T07:01:09.804920+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:09.804920+0000","last_undegraded":"2023-10-08T07:01:09.804920+0000","last_fullsized":"2023-10-08T07:01:09.804920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:30.932703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.883950+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:09.883950+0000","last_peered":"2023-10-08T07:01:09.883950+0000","last_clean":"2023-10-08T07:01:09.883950+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:09.883950+0000","last_undegraded":"2023-10-08T07:01:09.883950+0000","last_fullsized":"2023-10-08T07:01:09.883950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:05.703724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805796+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:09.805796+0000","last_peered":"2023-10-08T07:01:09.805796+0000","last_clean":"2023-10-08T07:01:09.805796+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:09.805796+0000","last_undegraded":"2023-10-08T07:01:09.805796+0000","last_fullsized":"2023-10-08T07:01:09.805796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:44.156143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876428+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:09.876428+0000","last_peered":"2023-10-08T07:01:09.876428+0000","last_clean":"2023-10-08T07:01:09.876428+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:09.876428+0000","last_undegraded":"2023-10-08T07:01:09.876428+0000","last_fullsized":"2023-10-08T07:01:09.876428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:23.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876001+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:09.876001+0000","last_peered":"2023-10-08T07:01:09.876001+0000","last_clean":"2023-10-08T07:01:09.876001+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:09.876001+0000","last_undegraded":"2023-10-08T07:01:09.876001+0000","last_fullsized":"2023-10-08T07:01:09.876001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805034+0000","last_change":"2023-10-08T07:00:58.687270+0000","last_active":"2023-10-08T07:01:09.805034+0000","last_peered":"2023-10-08T07:01:09.805034+0000","last_clean":"2023-10-08T07:01:09.805034+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:09.805034+0000","last_undegraded":"2023-10-08T07:01:09.805034+0000","last_fullsized":"2023-10-08T07:01:09.805034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:05.762019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877017+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:09.877017+0000","last_peered":"2023-10-08T07:01:09.877017+0000","last_clean":"2023-10-08T07:01:09.877017+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:09.877017+0000","last_undegraded":"2023-10-08T07:01:09.877017+0000","last_fullsized":"2023-10-08T07:01:09.877017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782468+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:11.782468+0000","last_peered":"2023-10-08T07:01:11.782468+0000","last_clean":"2023-10-08T07:01:11.782468+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:11.782468+0000","last_undegraded":"2023-10-08T07:01:11.782468+0000","last_fullsized":"2023-10-08T07:01:11.782468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804656+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:09.804656+0000","last_peered":"2023-10-08T07:01:09.804656+0000","last_clean":"2023-10-08T07:01:09.804656+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:09.804656+0000","last_undegraded":"2023-10-08T07:01:09.804656+0000","last_fullsized":"2023-10-08T07:01:09.804656+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:30.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886744+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:09.886744+0000","last_peered":"2023-10-08T07:01:09.886744+0000","last_clean":"2023-10-08T07:01:09.886744+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:09.886744+0000","last_undegraded":"2023-10-08T07:01:09.886744+0000","last_fullsized":"2023-10-08T07:01:09.886744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:29.167059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889407+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:09.889407+0000","last_peered":"2023-10-08T07:01:09.889407+0000","last_clean":"2023-10-08T07:01:09.889407+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889407+0000","last_undegraded":"2023-10-08T07:01:09.889407+0000","last_fullsized":"2023-10-08T07:01:09.889407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:37.936824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805266+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:09.805266+0000","last_peered":"2023-10-08T07:01:09.805266+0000","last_clean":"2023-10-08T07:01:09.805266+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:09.805266+0000","last_undegraded":"2023-10-08T07:01:09.805266+0000","last_fullsized":"2023-10-08T07:01:09.805266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:32.928459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878330+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:09.878330+0000","last_peered":"2023-10-08T07:01:09.878330+0000","last_clean":"2023-10-08T07:01:09.878330+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:09.878330+0000","last_undegraded":"2023-10-08T07:01:09.878330+0000","last_fullsized":"2023-10-08T07:01:09.878330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805556+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:09.805556+0000","last_peered":"2023-10-08T07:01:09.805556+0000","last_clean":"2023-10-08T07:01:09.805556+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:09.805556+0000","last_undegraded":"2023-10-08T07:01:09.805556+0000","last_fullsized":"2023-10-08T07:01:09.805556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:30.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805342+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:09.805342+0000","last_peered":"2023-10-08T07:01:09.805342+0000","last_clean":"2023-10-08T07:01:09.805342+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:09.805342+0000","last_undegraded":"2023-10-08T07:01:09.805342+0000","last_fullsized":"2023-10-08T07:01:09.805342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:03.680449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804573+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:09.804573+0000","last_peered":"2023-10-08T07:01:09.804573+0000","last_clean":"2023-10-08T07:01:09.804573+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:09.804573+0000","last_undegraded":"2023-10-08T07:01:09.804573+0000","last_fullsized":"2023-10-08T07:01:09.804573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:55.749420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877044+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:09.877044+0000","last_peered":"2023-10-08T07:01:09.877044+0000","last_clean":"2023-10-08T07:01:09.877044+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:09.877044+0000","last_undegraded":"2023-10-08T07:01:09.877044+0000","last_fullsized":"2023-10-08T07:01:09.877044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805626+0000","last_change":"2023-10-08T07:00:58.672669+0000","last_active":"2023-10-08T07:01:09.805626+0000","last_peered":"2023-10-08T07:01:09.805626+0000","last_clean":"2023-10-08T07:01:09.805626+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:09.805626+0000","last_undegraded":"2023-10-08T07:01:09.805626+0000","last_fullsized":"2023-10-08T07:01:09.805626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:24.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879021+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:09.879021+0000","last_peered":"2023-10-08T07:01:09.879021+0000","last_clean":"2023-10-08T07:01:09.879021+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:09.879021+0000","last_undegraded":"2023-10-08T07:01:09.879021+0000","last_fullsized":"2023-10-08T07:01:09.879021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878395+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:09.878395+0000","last_peered":"2023-10-08T07:01:09.878395+0000","last_clean":"2023-10-08T07:01:09.878395+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:09.878395+0000","last_undegraded":"2023-10-08T07:01:09.878395+0000","last_fullsized":"2023-10-08T07:01:09.878395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879534+0000","last_change":"2023-10-08T07:00:58.756916+0000","last_active":"2023-10-08T07:01:09.879534+0000","last_peered":"2023-10-08T07:01:09.879534+0000","last_clean":"2023-10-08T07:01:09.879534+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:09.879534+0000","last_undegraded":"2023-10-08T07:01:09.879534+0000","last_fullsized":"2023-10-08T07:01:09.879534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:45.871560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876541+0000","last_change":"2023-10-08T07:00:58.741378+0000","last_active":"2023-10-08T07:01:09.876541+0000","last_peered":"2023-10-08T07:01:09.876541+0000","last_clean":"2023-10-08T07:01:09.876541+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:09.876541+0000","last_undegraded":"2023-10-08T07:01:09.876541+0000","last_fullsized":"2023-10-08T07:01:09.876541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:34.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876257+0000","last_change":"2023-10-08T07:00:58.743707+0000","last_active":"2023-10-08T07:01:09.876257+0000","last_peered":"2023-10-08T07:01:09.876257+0000","last_clean":"2023-10-08T07:01:09.876257+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:09.876257+0000","last_undegraded":"2023-10-08T07:01:09.876257+0000","last_fullsized":"2023-10-08T07:01:09.876257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:10:58.417067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879563+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:09.879563+0000","last_peered":"2023-10-08T07:01:09.879563+0000","last_clean":"2023-10-08T07:01:09.879563+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:09.879563+0000","last_undegraded":"2023-10-08T07:01:09.879563+0000","last_fullsized":"2023-10-08T07:01:09.879563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876387+0000","last_change":"2023-10-08T07:00:58.743219+0000","last_active":"2023-10-08T07:01:09.876387+0000","last_peered":"2023-10-08T07:01:09.876387+0000","last_clean":"2023-10-08T07:01:09.876387+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:09.876387+0000","last_undegraded":"2023-10-08T07:01:09.876387+0000","last_fullsized":"2023-10-08T07:01:09.876387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:11.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805505+0000","last_change":"2023-10-08T07:00:58.689299+0000","last_active":"2023-10-08T07:01:09.805505+0000","last_peered":"2023-10-08T07:01:09.805505+0000","last_clean":"2023-10-08T07:01:09.805505+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:09.805505+0000","last_undegraded":"2023-10-08T07:01:09.805505+0000","last_fullsized":"2023-10-08T07:01:09.805505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:03.194361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878607+0000","last_change":"2023-10-08T07:00:58.742191+0000","last_active":"2023-10-08T07:01:09.878607+0000","last_peered":"2023-10-08T07:01:09.878607+0000","last_clean":"2023-10-08T07:01:09.878607+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:09.878607+0000","last_undegraded":"2023-10-08T07:01:09.878607+0000","last_fullsized":"2023-10-08T07:01:09.878607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.860327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805580+0000","last_change":"2023-10-08T07:00:58.672323+0000","last_active":"2023-10-08T07:01:09.805580+0000","last_peered":"2023-10-08T07:01:09.805580+0000","last_clean":"2023-10-08T07:01:09.805580+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:09.805580+0000","last_undegraded":"2023-10-08T07:01:09.805580+0000","last_fullsized":"2023-10-08T07:01:09.805580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:46.142346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876259+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:09.876259+0000","last_peered":"2023-10-08T07:01:09.876259+0000","last_clean":"2023-10-08T07:01:09.876259+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:09.876259+0000","last_undegraded":"2023-10-08T07:01:09.876259+0000","last_fullsized":"2023-10-08T07:01:09.876259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:27.988825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876116+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:09.876116+0000","last_peered":"2023-10-08T07:01:09.876116+0000","last_clean":"2023-10-08T07:01:09.876116+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:09.876116+0000","last_undegraded":"2023-10-08T07:01:09.876116+0000","last_fullsized":"2023-10-08T07:01:09.876116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:32.031015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805004+0000","last_change":"2023-10-08T07:00:58.687458+0000","last_active":"2023-10-08T07:01:09.805004+0000","last_peered":"2023-10-08T07:01:09.805004+0000","last_clean":"2023-10-08T07:01:09.805004+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:09.805004+0000","last_undegraded":"2023-10-08T07:01:09.805004+0000","last_fullsized":"2023-10-08T07:01:09.805004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:25:42.651522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886785+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:09.886785+0000","last_peered":"2023-10-08T07:01:09.886785+0000","last_clean":"2023-10-08T07:01:09.886785+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:09.886785+0000","last_undegraded":"2023-10-08T07:01:09.886785+0000","last_fullsized":"2023-10-08T07:01:09.886785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:35.339502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805622+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:09.805622+0000","last_peered":"2023-10-08T07:01:09.805622+0000","last_clean":"2023-10-08T07:01:09.805622+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:09.805622+0000","last_undegraded":"2023-10-08T07:01:09.805622+0000","last_fullsized":"2023-10-08T07:01:09.805622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:53.864366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879648+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:09.879648+0000","last_peered":"2023-10-08T07:01:09.879648+0000","last_clean":"2023-10-08T07:01:09.879648+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:09.879648+0000","last_undegraded":"2023-10-08T07:01:09.879648+0000","last_fullsized":"2023-10-08T07:01:09.879648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612613,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47200,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324640,"statfs":{"total":96636764160,"available":96588431360,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325040,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046800,"statfs":{"total":96636764160,"available":96303923200,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54200000000000004,"5min":1.998,"15min":1.998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.443}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306988,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064852,"statfs":{"total":96636764160,"available":96322408448,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:01:15.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:01:15.748 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:01:15.760 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2023-10-08T07:01:15.007648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679228,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436292,"statfs":{"total":289910292480,"available":289214763008,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135536"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889369+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:09.889369+0000","last_peered":"2023-10-08T07:01:09.889369+0000","last_clean":"2023-10-08T07:01:09.889369+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:09.889369+0000","last_undegraded":"2023-10-08T07:01:09.889369+0000","last_fullsized":"2023-10-08T07:01:09.889369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879623+0000","last_change":"2023-10-08T07:00:58.757022+0000","last_active":"2023-10-08T07:01:09.879623+0000","last_peered":"2023-10-08T07:01:09.879623+0000","last_clean":"2023-10-08T07:01:09.879623+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:09.879623+0000","last_undegraded":"2023-10-08T07:01:09.879623+0000","last_fullsized":"2023-10-08T07:01:09.879623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:57.715272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876818+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:09.876818+0000","last_peered":"2023-10-08T07:01:09.876818+0000","last_clean":"2023-10-08T07:01:09.876818+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:09.876818+0000","last_undegraded":"2023-10-08T07:01:09.876818+0000","last_fullsized":"2023-10-08T07:01:09.876818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876767+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:09.876767+0000","last_peered":"2023-10-08T07:01:09.876767+0000","last_clean":"2023-10-08T07:01:09.876767+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:09.876767+0000","last_undegraded":"2023-10-08T07:01:09.876767+0000","last_fullsized":"2023-10-08T07:01:09.876767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:08.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886836+0000","last_change":"2023-10-08T07:01:09.882134+0000","last_active":"2023-10-08T07:01:09.886836+0000","last_peered":"2023-10-08T07:01:09.886836+0000","last_clean":"2023-10-08T07:01:09.886836+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:09.886836+0000","last_undegraded":"2023-10-08T07:01:09.886836+0000","last_fullsized":"2023-10-08T07:01:09.886836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876241+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:09.876241+0000","last_peered":"2023-10-08T07:01:09.876241+0000","last_clean":"2023-10-08T07:01:09.876241+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:09.876241+0000","last_undegraded":"2023-10-08T07:01:09.876241+0000","last_fullsized":"2023-10-08T07:01:09.876241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.341032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875903+0000","last_change":"2023-10-08T07:00:58.741788+0000","last_active":"2023-10-08T07:01:09.875903+0000","last_peered":"2023-10-08T07:01:09.875903+0000","last_clean":"2023-10-08T07:01:09.875903+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:09.875903+0000","last_undegraded":"2023-10-08T07:01:09.875903+0000","last_fullsized":"2023-10-08T07:01:09.875903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875853+0000","last_change":"2023-10-08T07:00:58.743309+0000","last_active":"2023-10-08T07:01:09.875853+0000","last_peered":"2023-10-08T07:01:09.875853+0000","last_clean":"2023-10-08T07:01:09.875853+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:09.875853+0000","last_undegraded":"2023-10-08T07:01:09.875853+0000","last_fullsized":"2023-10-08T07:01:09.875853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805710+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:09.805710+0000","last_peered":"2023-10-08T07:01:09.805710+0000","last_clean":"2023-10-08T07:01:09.805710+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:09.805710+0000","last_undegraded":"2023-10-08T07:01:09.805710+0000","last_fullsized":"2023-10-08T07:01:09.805710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:14.193056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879851+0000","last_change":"2023-10-08T07:00:58.757350+0000","last_active":"2023-10-08T07:01:09.879851+0000","last_peered":"2023-10-08T07:01:09.879851+0000","last_clean":"2023-10-08T07:01:09.879851+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:09.879851+0000","last_undegraded":"2023-10-08T07:01:09.879851+0000","last_fullsized":"2023-10-08T07:01:09.879851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:38.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876686+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:09.876686+0000","last_peered":"2023-10-08T07:01:09.876686+0000","last_clean":"2023-10-08T07:01:09.876686+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:09.876686+0000","last_undegraded":"2023-10-08T07:01:09.876686+0000","last_fullsized":"2023-10-08T07:01:09.876686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:11.748373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886800+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:09.886800+0000","last_peered":"2023-10-08T07:01:09.886800+0000","last_clean":"2023-10-08T07:01:09.886800+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:09.886800+0000","last_undegraded":"2023-10-08T07:01:09.886800+0000","last_fullsized":"2023-10-08T07:01:09.886800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:50.428711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.884162+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:09.884162+0000","last_peered":"2023-10-08T07:01:09.884162+0000","last_clean":"2023-10-08T07:01:09.884162+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:09.884162+0000","last_undegraded":"2023-10-08T07:01:09.884162+0000","last_fullsized":"2023-10-08T07:01:09.884162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876609+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:09.876609+0000","last_peered":"2023-10-08T07:01:09.876609+0000","last_clean":"2023-10-08T07:01:09.876609+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:09.876609+0000","last_undegraded":"2023-10-08T07:01:09.876609+0000","last_fullsized":"2023-10-08T07:01:09.876609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876291+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:09.876291+0000","last_peered":"2023-10-08T07:01:09.876291+0000","last_clean":"2023-10-08T07:01:09.876291+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:09.876291+0000","last_undegraded":"2023-10-08T07:01:09.876291+0000","last_fullsized":"2023-10-08T07:01:09.876291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875872+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:09.875872+0000","last_peered":"2023-10-08T07:01:09.875872+0000","last_clean":"2023-10-08T07:01:09.875872+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:09.875872+0000","last_undegraded":"2023-10-08T07:01:09.875872+0000","last_fullsized":"2023-10-08T07:01:09.875872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805445+0000","last_change":"2023-10-08T07:00:58.689994+0000","last_active":"2023-10-08T07:01:09.805445+0000","last_peered":"2023-10-08T07:01:09.805445+0000","last_clean":"2023-10-08T07:01:09.805445+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:09.805445+0000","last_undegraded":"2023-10-08T07:01:09.805445+0000","last_fullsized":"2023-10-08T07:01:09.805445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:38.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879888+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:09.879888+0000","last_peered":"2023-10-08T07:01:09.879888+0000","last_clean":"2023-10-08T07:01:09.879888+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:09.879888+0000","last_undegraded":"2023-10-08T07:01:09.879888+0000","last_fullsized":"2023-10-08T07:01:09.879888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:20.556448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805312+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:09.805312+0000","last_peered":"2023-10-08T07:01:09.805312+0000","last_clean":"2023-10-08T07:01:09.805312+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:09.805312+0000","last_undegraded":"2023-10-08T07:01:09.805312+0000","last_fullsized":"2023-10-08T07:01:09.805312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:57:56.486710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876667+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:09.876667+0000","last_peered":"2023-10-08T07:01:09.876667+0000","last_clean":"2023-10-08T07:01:09.876667+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:09.876667+0000","last_undegraded":"2023-10-08T07:01:09.876667+0000","last_fullsized":"2023-10-08T07:01:09.876667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:21.278271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876239+0000","last_change":"2023-10-08T07:00:58.743568+0000","last_active":"2023-10-08T07:01:09.876239+0000","last_peered":"2023-10-08T07:01:09.876239+0000","last_clean":"2023-10-08T07:01:09.876239+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:09.876239+0000","last_undegraded":"2023-10-08T07:01:09.876239+0000","last_fullsized":"2023-10-08T07:01:09.876239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:22.726402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886866+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:09.886866+0000","last_peered":"2023-10-08T07:01:09.886866+0000","last_clean":"2023-10-08T07:01:09.886866+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:09.886866+0000","last_undegraded":"2023-10-08T07:01:09.886866+0000","last_fullsized":"2023-10-08T07:01:09.886866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:30.912592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804896+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:09.804896+0000","last_peered":"2023-10-08T07:01:09.804896+0000","last_clean":"2023-10-08T07:01:09.804896+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:09.804896+0000","last_undegraded":"2023-10-08T07:01:09.804896+0000","last_fullsized":"2023-10-08T07:01:09.804896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:28.061195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878224+0000","last_change":"2023-10-08T07:00:58.757259+0000","last_active":"2023-10-08T07:01:09.878224+0000","last_peered":"2023-10-08T07:01:09.878224+0000","last_clean":"2023-10-08T07:01:09.878224+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:09.878224+0000","last_undegraded":"2023-10-08T07:01:09.878224+0000","last_fullsized":"2023-10-08T07:01:09.878224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:50.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880708+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:09.880708+0000","last_peered":"2023-10-08T07:01:09.880708+0000","last_clean":"2023-10-08T07:01:09.880708+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:09.880708+0000","last_undegraded":"2023-10-08T07:01:09.880708+0000","last_fullsized":"2023-10-08T07:01:09.880708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805824+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:09.805824+0000","last_peered":"2023-10-08T07:01:09.805824+0000","last_clean":"2023-10-08T07:01:09.805824+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:09.805824+0000","last_undegraded":"2023-10-08T07:01:09.805824+0000","last_fullsized":"2023-10-08T07:01:09.805824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:02:40.932995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876702+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:09.876702+0000","last_peered":"2023-10-08T07:01:09.876702+0000","last_clean":"2023-10-08T07:01:09.876702+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:09.876702+0000","last_undegraded":"2023-10-08T07:01:09.876702+0000","last_fullsized":"2023-10-08T07:01:09.876702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889382+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:09.889382+0000","last_peered":"2023-10-08T07:01:09.889382+0000","last_clean":"2023-10-08T07:01:09.889382+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889382+0000","last_undegraded":"2023-10-08T07:01:09.889382+0000","last_fullsized":"2023-10-08T07:01:09.889382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879867+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:09.879867+0000","last_peered":"2023-10-08T07:01:09.879867+0000","last_clean":"2023-10-08T07:01:09.879867+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:09.879867+0000","last_undegraded":"2023-10-08T07:01:09.879867+0000","last_fullsized":"2023-10-08T07:01:09.879867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804720+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:09.804720+0000","last_peered":"2023-10-08T07:01:09.804720+0000","last_clean":"2023-10-08T07:01:09.804720+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:09.804720+0000","last_undegraded":"2023-10-08T07:01:09.804720+0000","last_fullsized":"2023-10-08T07:01:09.804720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:18.521858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805896+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:09.805896+0000","last_peered":"2023-10-08T07:01:09.805896+0000","last_clean":"2023-10-08T07:01:09.805896+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:09.805896+0000","last_undegraded":"2023-10-08T07:01:09.805896+0000","last_fullsized":"2023-10-08T07:01:09.805896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:14:38.780240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804669+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:09.804669+0000","last_peered":"2023-10-08T07:01:09.804669+0000","last_clean":"2023-10-08T07:01:09.804669+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:09.804669+0000","last_undegraded":"2023-10-08T07:01:09.804669+0000","last_fullsized":"2023-10-08T07:01:09.804669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:42.865388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880661+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:09.880661+0000","last_peered":"2023-10-08T07:01:09.880661+0000","last_clean":"2023-10-08T07:01:09.880661+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:09.880661+0000","last_undegraded":"2023-10-08T07:01:09.880661+0000","last_fullsized":"2023-10-08T07:01:09.880661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805748+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:09.805748+0000","last_peered":"2023-10-08T07:01:09.805748+0000","last_clean":"2023-10-08T07:01:09.805748+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:09.805748+0000","last_undegraded":"2023-10-08T07:01:09.805748+0000","last_fullsized":"2023-10-08T07:01:09.805748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:05:28.271541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804563+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:09.804563+0000","last_peered":"2023-10-08T07:01:09.804563+0000","last_clean":"2023-10-08T07:01:09.804563+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:09.804563+0000","last_undegraded":"2023-10-08T07:01:09.804563+0000","last_fullsized":"2023-10-08T07:01:09.804563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:40.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876794+0000","last_change":"2023-10-08T07:00:58.742002+0000","last_active":"2023-10-08T07:01:09.876794+0000","last_peered":"2023-10-08T07:01:09.876794+0000","last_clean":"2023-10-08T07:01:09.876794+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:09.876794+0000","last_undegraded":"2023-10-08T07:01:09.876794+0000","last_fullsized":"2023-10-08T07:01:09.876794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:29.906921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805026+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:09.805026+0000","last_peered":"2023-10-08T07:01:09.805026+0000","last_clean":"2023-10-08T07:01:09.805026+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:09.805026+0000","last_undegraded":"2023-10-08T07:01:09.805026+0000","last_fullsized":"2023-10-08T07:01:09.805026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:26.532564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879366+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:09.879366+0000","last_peered":"2023-10-08T07:01:09.879366+0000","last_clean":"2023-10-08T07:01:09.879366+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:09.879366+0000","last_undegraded":"2023-10-08T07:01:09.879366+0000","last_fullsized":"2023-10-08T07:01:09.879366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804726+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:09.804726+0000","last_peered":"2023-10-08T07:01:09.804726+0000","last_clean":"2023-10-08T07:01:09.804726+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:09.804726+0000","last_undegraded":"2023-10-08T07:01:09.804726+0000","last_fullsized":"2023-10-08T07:01:09.804726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:54.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876664+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:09.876664+0000","last_peered":"2023-10-08T07:01:09.876664+0000","last_clean":"2023-10-08T07:01:09.876664+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:09.876664+0000","last_undegraded":"2023-10-08T07:01:09.876664+0000","last_fullsized":"2023-10-08T07:01:09.876664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876537+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:09.876537+0000","last_peered":"2023-10-08T07:01:09.876537+0000","last_clean":"2023-10-08T07:01:09.876537+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:09.876537+0000","last_undegraded":"2023-10-08T07:01:09.876537+0000","last_fullsized":"2023-10-08T07:01:09.876537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876642+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:09.876642+0000","last_peered":"2023-10-08T07:01:09.876642+0000","last_clean":"2023-10-08T07:01:09.876642+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:09.876642+0000","last_undegraded":"2023-10-08T07:01:09.876642+0000","last_fullsized":"2023-10-08T07:01:09.876642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:49.423040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886847+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:09.886847+0000","last_peered":"2023-10-08T07:01:09.886847+0000","last_clean":"2023-10-08T07:01:09.886847+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:09.886847+0000","last_undegraded":"2023-10-08T07:01:09.886847+0000","last_fullsized":"2023-10-08T07:01:09.886847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:53.793279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804844+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:09.804844+0000","last_peered":"2023-10-08T07:01:09.804844+0000","last_clean":"2023-10-08T07:01:09.804844+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:09.804844+0000","last_undegraded":"2023-10-08T07:01:09.804844+0000","last_fullsized":"2023-10-08T07:01:09.804844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:09.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886829+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:09.886829+0000","last_peered":"2023-10-08T07:01:09.886829+0000","last_clean":"2023-10-08T07:01:09.886829+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:09.886829+0000","last_undegraded":"2023-10-08T07:01:09.886829+0000","last_fullsized":"2023-10-08T07:01:09.886829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878197+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:09.878197+0000","last_peered":"2023-10-08T07:01:09.878197+0000","last_clean":"2023-10-08T07:01:09.878197+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:09.878197+0000","last_undegraded":"2023-10-08T07:01:09.878197+0000","last_fullsized":"2023-10-08T07:01:09.878197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805734+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:09.805734+0000","last_peered":"2023-10-08T07:01:09.805734+0000","last_clean":"2023-10-08T07:01:09.805734+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:09.805734+0000","last_undegraded":"2023-10-08T07:01:09.805734+0000","last_fullsized":"2023-10-08T07:01:09.805734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:48:19.319694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876264+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:09.876264+0000","last_peered":"2023-10-08T07:01:09.876264+0000","last_clean":"2023-10-08T07:01:09.876264+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:09.876264+0000","last_undegraded":"2023-10-08T07:01:09.876264+0000","last_fullsized":"2023-10-08T07:01:09.876264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805857+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:09.805857+0000","last_peered":"2023-10-08T07:01:09.805857+0000","last_clean":"2023-10-08T07:01:09.805857+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:09.805857+0000","last_undegraded":"2023-10-08T07:01:09.805857+0000","last_fullsized":"2023-10-08T07:01:09.805857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:38.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876985+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:09.876985+0000","last_peered":"2023-10-08T07:01:09.876985+0000","last_clean":"2023-10-08T07:01:09.876985+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:09.876985+0000","last_undegraded":"2023-10-08T07:01:09.876985+0000","last_fullsized":"2023-10-08T07:01:09.876985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877688+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:09.877688+0000","last_peered":"2023-10-08T07:01:09.877688+0000","last_clean":"2023-10-08T07:01:09.877688+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:09.877688+0000","last_undegraded":"2023-10-08T07:01:09.877688+0000","last_fullsized":"2023-10-08T07:01:09.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879744+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:09.879744+0000","last_peered":"2023-10-08T07:01:09.879744+0000","last_clean":"2023-10-08T07:01:09.879744+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:09.879744+0000","last_undegraded":"2023-10-08T07:01:09.879744+0000","last_fullsized":"2023-10-08T07:01:09.879744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878510+0000","last_change":"2023-10-08T07:00:58.742366+0000","last_active":"2023-10-08T07:01:09.878510+0000","last_peered":"2023-10-08T07:01:09.878510+0000","last_clean":"2023-10-08T07:01:09.878510+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:09.878510+0000","last_undegraded":"2023-10-08T07:01:09.878510+0000","last_fullsized":"2023-10-08T07:01:09.878510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.443197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876833+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:09.876833+0000","last_peered":"2023-10-08T07:01:09.876833+0000","last_clean":"2023-10-08T07:01:09.876833+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:09.876833+0000","last_undegraded":"2023-10-08T07:01:09.876833+0000","last_fullsized":"2023-10-08T07:01:09.876833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876500+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:09.876500+0000","last_peered":"2023-10-08T07:01:09.876500+0000","last_clean":"2023-10-08T07:01:09.876500+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:09.876500+0000","last_undegraded":"2023-10-08T07:01:09.876500+0000","last_fullsized":"2023-10-08T07:01:09.876500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:41.315551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876366+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:09.876366+0000","last_peered":"2023-10-08T07:01:09.876366+0000","last_clean":"2023-10-08T07:01:09.876366+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:09.876366+0000","last_undegraded":"2023-10-08T07:01:09.876366+0000","last_fullsized":"2023-10-08T07:01:09.876366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:52.787608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805457+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:09.805457+0000","last_peered":"2023-10-08T07:01:09.805457+0000","last_clean":"2023-10-08T07:01:09.805457+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:09.805457+0000","last_undegraded":"2023-10-08T07:01:09.805457+0000","last_fullsized":"2023-10-08T07:01:09.805457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:46.069356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805138+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:09.805138+0000","last_peered":"2023-10-08T07:01:09.805138+0000","last_clean":"2023-10-08T07:01:09.805138+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:09.805138+0000","last_undegraded":"2023-10-08T07:01:09.805138+0000","last_fullsized":"2023-10-08T07:01:09.805138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:30.717351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876373+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:09.876373+0000","last_peered":"2023-10-08T07:01:09.876373+0000","last_clean":"2023-10-08T07:01:09.876373+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:09.876373+0000","last_undegraded":"2023-10-08T07:01:09.876373+0000","last_fullsized":"2023-10-08T07:01:09.876373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875889+0000","last_change":"2023-10-08T07:00:58.741881+0000","last_active":"2023-10-08T07:01:09.875889+0000","last_peered":"2023-10-08T07:01:09.875889+0000","last_clean":"2023-10-08T07:01:09.875889+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:09.875889+0000","last_undegraded":"2023-10-08T07:01:09.875889+0000","last_fullsized":"2023-10-08T07:01:09.875889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:42.957083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877011+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:09.877011+0000","last_peered":"2023-10-08T07:01:09.877011+0000","last_clean":"2023-10-08T07:01:09.877011+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:09.877011+0000","last_undegraded":"2023-10-08T07:01:09.877011+0000","last_fullsized":"2023-10-08T07:01:09.877011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886762+0000","last_change":"2023-10-08T07:01:09.881913+0000","last_active":"2023-10-08T07:01:09.886762+0000","last_peered":"2023-10-08T07:01:09.886762+0000","last_clean":"2023-10-08T07:01:09.886762+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:09.886762+0000","last_undegraded":"2023-10-08T07:01:09.886762+0000","last_fullsized":"2023-10-08T07:01:09.886762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:43.187153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876894+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:09.876894+0000","last_peered":"2023-10-08T07:01:09.876894+0000","last_clean":"2023-10-08T07:01:09.876894+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:09.876894+0000","last_undegraded":"2023-10-08T07:01:09.876894+0000","last_fullsized":"2023-10-08T07:01:09.876894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878020+0000","last_change":"2023-10-08T07:00:58.757070+0000","last_active":"2023-10-08T07:01:09.878020+0000","last_peered":"2023-10-08T07:01:09.878020+0000","last_clean":"2023-10-08T07:01:09.878020+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:09.878020+0000","last_undegraded":"2023-10-08T07:01:09.878020+0000","last_fullsized":"2023-10-08T07:01:09.878020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:54.400652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805649+0000","last_change":"2023-10-08T07:00:58.690359+0000","last_active":"2023-10-08T07:01:09.805649+0000","last_peered":"2023-10-08T07:01:09.805649+0000","last_clean":"2023-10-08T07:01:09.805649+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:09.805649+0000","last_undegraded":"2023-10-08T07:01:09.805649+0000","last_fullsized":"2023-10-08T07:01:09.805649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:24.632619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805631+0000","last_change":"2023-10-08T07:00:58.689104+0000","last_active":"2023-10-08T07:01:09.805631+0000","last_peered":"2023-10-08T07:01:09.805631+0000","last_clean":"2023-10-08T07:01:09.805631+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:09.805631+0000","last_undegraded":"2023-10-08T07:01:09.805631+0000","last_fullsized":"2023-10-08T07:01:09.805631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:19.488445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876918+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:09.876918+0000","last_peered":"2023-10-08T07:01:09.876918+0000","last_clean":"2023-10-08T07:01:09.876918+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:09.876918+0000","last_undegraded":"2023-10-08T07:01:09.876918+0000","last_fullsized":"2023-10-08T07:01:09.876918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879374+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:09.879374+0000","last_peered":"2023-10-08T07:01:09.879374+0000","last_clean":"2023-10-08T07:01:09.879374+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:09.879374+0000","last_undegraded":"2023-10-08T07:01:09.879374+0000","last_fullsized":"2023-10-08T07:01:09.879374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876563+0000","last_change":"2023-10-08T07:00:58.741459+0000","last_active":"2023-10-08T07:01:09.876563+0000","last_peered":"2023-10-08T07:01:09.876563+0000","last_clean":"2023-10-08T07:01:09.876563+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:09.876563+0000","last_undegraded":"2023-10-08T07:01:09.876563+0000","last_fullsized":"2023-10-08T07:01:09.876563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:38.166894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876349+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:09.876349+0000","last_peered":"2023-10-08T07:01:09.876349+0000","last_clean":"2023-10-08T07:01:09.876349+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:09.876349+0000","last_undegraded":"2023-10-08T07:01:09.876349+0000","last_fullsized":"2023-10-08T07:01:09.876349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:42.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805368+0000","last_change":"2023-10-08T07:00:58.689101+0000","last_active":"2023-10-08T07:01:09.805368+0000","last_peered":"2023-10-08T07:01:09.805368+0000","last_clean":"2023-10-08T07:01:09.805368+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:09.805368+0000","last_undegraded":"2023-10-08T07:01:09.805368+0000","last_fullsized":"2023-10-08T07:01:09.805368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:57.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804920+0000","last_change":"2023-10-08T07:00:58.686855+0000","last_active":"2023-10-08T07:01:09.804920+0000","last_peered":"2023-10-08T07:01:09.804920+0000","last_clean":"2023-10-08T07:01:09.804920+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:09.804920+0000","last_undegraded":"2023-10-08T07:01:09.804920+0000","last_fullsized":"2023-10-08T07:01:09.804920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:30.932703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.883950+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:09.883950+0000","last_peered":"2023-10-08T07:01:09.883950+0000","last_clean":"2023-10-08T07:01:09.883950+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:09.883950+0000","last_undegraded":"2023-10-08T07:01:09.883950+0000","last_fullsized":"2023-10-08T07:01:09.883950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:05.703724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805796+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:09.805796+0000","last_peered":"2023-10-08T07:01:09.805796+0000","last_clean":"2023-10-08T07:01:09.805796+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:09.805796+0000","last_undegraded":"2023-10-08T07:01:09.805796+0000","last_fullsized":"2023-10-08T07:01:09.805796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:44.156143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876428+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:09.876428+0000","last_peered":"2023-10-08T07:01:09.876428+0000","last_clean":"2023-10-08T07:01:09.876428+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:09.876428+0000","last_undegraded":"2023-10-08T07:01:09.876428+0000","last_fullsized":"2023-10-08T07:01:09.876428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:23.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876001+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:09.876001+0000","last_peered":"2023-10-08T07:01:09.876001+0000","last_clean":"2023-10-08T07:01:09.876001+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:09.876001+0000","last_undegraded":"2023-10-08T07:01:09.876001+0000","last_fullsized":"2023-10-08T07:01:09.876001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805034+0000","last_change":"2023-10-08T07:00:58.687270+0000","last_active":"2023-10-08T07:01:09.805034+0000","last_peered":"2023-10-08T07:01:09.805034+0000","last_clean":"2023-10-08T07:01:09.805034+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:09.805034+0000","last_undegraded":"2023-10-08T07:01:09.805034+0000","last_fullsized":"2023-10-08T07:01:09.805034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:05.762019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877017+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:09.877017+0000","last_peered":"2023-10-08T07:01:09.877017+0000","last_clean":"2023-10-08T07:01:09.877017+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:09.877017+0000","last_undegraded":"2023-10-08T07:01:09.877017+0000","last_fullsized":"2023-10-08T07:01:09.877017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782468+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:11.782468+0000","last_peered":"2023-10-08T07:01:11.782468+0000","last_clean":"2023-10-08T07:01:11.782468+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:11.782468+0000","last_undegraded":"2023-10-08T07:01:11.782468+0000","last_fullsized":"2023-10-08T07:01:11.782468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804656+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:09.804656+0000","last_peered":"2023-10-08T07:01:09.804656+0000","last_clean":"2023-10-08T07:01:09.804656+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:09.804656+0000","last_undegraded":"2023-10-08T07:01:09.804656+0000","last_fullsized":"2023-10-08T07:01:09.804656+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:30.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886744+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:09.886744+0000","last_peered":"2023-10-08T07:01:09.886744+0000","last_clean":"2023-10-08T07:01:09.886744+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:09.886744+0000","last_undegraded":"2023-10-08T07:01:09.886744+0000","last_fullsized":"2023-10-08T07:01:09.886744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:29.167059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889407+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:09.889407+0000","last_peered":"2023-10-08T07:01:09.889407+0000","last_clean":"2023-10-08T07:01:09.889407+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889407+0000","last_undegraded":"2023-10-08T07:01:09.889407+0000","last_fullsized":"2023-10-08T07:01:09.889407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:37.936824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805266+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:09.805266+0000","last_peered":"2023-10-08T07:01:09.805266+0000","last_clean":"2023-10-08T07:01:09.805266+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:09.805266+0000","last_undegraded":"2023-10-08T07:01:09.805266+0000","last_fullsized":"2023-10-08T07:01:09.805266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:32.928459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878330+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:09.878330+0000","last_peered":"2023-10-08T07:01:09.878330+0000","last_clean":"2023-10-08T07:01:09.878330+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:09.878330+0000","last_undegraded":"2023-10-08T07:01:09.878330+0000","last_fullsized":"2023-10-08T07:01:09.878330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805556+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:09.805556+0000","last_peered":"2023-10-08T07:01:09.805556+0000","last_clean":"2023-10-08T07:01:09.805556+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:09.805556+0000","last_undegraded":"2023-10-08T07:01:09.805556+0000","last_fullsized":"2023-10-08T07:01:09.805556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:30.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805342+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:09.805342+0000","last_peered":"2023-10-08T07:01:09.805342+0000","last_clean":"2023-10-08T07:01:09.805342+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:09.805342+0000","last_undegraded":"2023-10-08T07:01:09.805342+0000","last_fullsized":"2023-10-08T07:01:09.805342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:03.680449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804573+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:09.804573+0000","last_peered":"2023-10-08T07:01:09.804573+0000","last_clean":"2023-10-08T07:01:09.804573+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:09.804573+0000","last_undegraded":"2023-10-08T07:01:09.804573+0000","last_fullsized":"2023-10-08T07:01:09.804573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:55.749420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877044+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:09.877044+0000","last_peered":"2023-10-08T07:01:09.877044+0000","last_clean":"2023-10-08T07:01:09.877044+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:09.877044+0000","last_undegraded":"2023-10-08T07:01:09.877044+0000","last_fullsized":"2023-10-08T07:01:09.877044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805626+0000","last_change":"2023-10-08T07:00:58.672669+0000","last_active":"2023-10-08T07:01:09.805626+0000","last_peered":"2023-10-08T07:01:09.805626+0000","last_clean":"2023-10-08T07:01:09.805626+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:09.805626+0000","last_undegraded":"2023-10-08T07:01:09.805626+0000","last_fullsized":"2023-10-08T07:01:09.805626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:24.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879021+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:09.879021+0000","last_peered":"2023-10-08T07:01:09.879021+0000","last_clean":"2023-10-08T07:01:09.879021+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:09.879021+0000","last_undegraded":"2023-10-08T07:01:09.879021+0000","last_fullsized":"2023-10-08T07:01:09.879021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878395+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:09.878395+0000","last_peered":"2023-10-08T07:01:09.878395+0000","last_clean":"2023-10-08T07:01:09.878395+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:09.878395+0000","last_undegraded":"2023-10-08T07:01:09.878395+0000","last_fullsized":"2023-10-08T07:01:09.878395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879534+0000","last_change":"2023-10-08T07:00:58.756916+0000","last_active":"2023-10-08T07:01:09.879534+0000","last_peered":"2023-10-08T07:01:09.879534+0000","last_clean":"2023-10-08T07:01:09.879534+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:09.879534+0000","last_undegraded":"2023-10-08T07:01:09.879534+0000","last_fullsized":"2023-10-08T07:01:09.879534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:45.871560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876541+0000","last_change":"2023-10-08T07:00:58.741378+0000","last_active":"2023-10-08T07:01:09.876541+0000","last_peered":"2023-10-08T07:01:09.876541+0000","last_clean":"2023-10-08T07:01:09.876541+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:09.876541+0000","last_undegraded":"2023-10-08T07:01:09.876541+0000","last_fullsized":"2023-10-08T07:01:09.876541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:34.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876257+0000","last_change":"2023-10-08T07:00:58.743707+0000","last_active":"2023-10-08T07:01:09.876257+0000","last_peered":"2023-10-08T07:01:09.876257+0000","last_clean":"2023-10-08T07:01:09.876257+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:09.876257+0000","last_undegraded":"2023-10-08T07:01:09.876257+0000","last_fullsized":"2023-10-08T07:01:09.876257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:10:58.417067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879563+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:09.879563+0000","last_peered":"2023-10-08T07:01:09.879563+0000","last_clean":"2023-10-08T07:01:09.879563+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:09.879563+0000","last_undegraded":"2023-10-08T07:01:09.879563+0000","last_fullsized":"2023-10-08T07:01:09.879563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876387+0000","last_change":"2023-10-08T07:00:58.743219+0000","last_active":"2023-10-08T07:01:09.876387+0000","last_peered":"2023-10-08T07:01:09.876387+0000","last_clean":"2023-10-08T07:01:09.876387+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:09.876387+0000","last_undegraded":"2023-10-08T07:01:09.876387+0000","last_fullsized":"2023-10-08T07:01:09.876387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:11.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805505+0000","last_change":"2023-10-08T07:00:58.689299+0000","last_active":"2023-10-08T07:01:09.805505+0000","last_peered":"2023-10-08T07:01:09.805505+0000","last_clean":"2023-10-08T07:01:09.805505+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:09.805505+0000","last_undegraded":"2023-10-08T07:01:09.805505+0000","last_fullsized":"2023-10-08T07:01:09.805505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:03.194361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878607+0000","last_change":"2023-10-08T07:00:58.742191+0000","last_active":"2023-10-08T07:01:09.878607+0000","last_peered":"2023-10-08T07:01:09.878607+0000","last_clean":"2023-10-08T07:01:09.878607+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:09.878607+0000","last_undegraded":"2023-10-08T07:01:09.878607+0000","last_fullsized":"2023-10-08T07:01:09.878607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.860327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805580+0000","last_change":"2023-10-08T07:00:58.672323+0000","last_active":"2023-10-08T07:01:09.805580+0000","last_peered":"2023-10-08T07:01:09.805580+0000","last_clean":"2023-10-08T07:01:09.805580+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:09.805580+0000","last_undegraded":"2023-10-08T07:01:09.805580+0000","last_fullsized":"2023-10-08T07:01:09.805580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:46.142346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876259+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:09.876259+0000","last_peered":"2023-10-08T07:01:09.876259+0000","last_clean":"2023-10-08T07:01:09.876259+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:09.876259+0000","last_undegraded":"2023-10-08T07:01:09.876259+0000","last_fullsized":"2023-10-08T07:01:09.876259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:27.988825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876116+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:09.876116+0000","last_peered":"2023-10-08T07:01:09.876116+0000","last_clean":"2023-10-08T07:01:09.876116+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:09.876116+0000","last_undegraded":"2023-10-08T07:01:09.876116+0000","last_fullsized":"2023-10-08T07:01:09.876116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:32.031015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805004+0000","last_change":"2023-10-08T07:00:58.687458+0000","last_active":"2023-10-08T07:01:09.805004+0000","last_peered":"2023-10-08T07:01:09.805004+0000","last_clean":"2023-10-08T07:01:09.805004+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:09.805004+0000","last_undegraded":"2023-10-08T07:01:09.805004+0000","last_fullsized":"2023-10-08T07:01:09.805004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:25:42.651522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886785+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:09.886785+0000","last_peered":"2023-10-08T07:01:09.886785+0000","last_clean":"2023-10-08T07:01:09.886785+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:09.886785+0000","last_undegraded":"2023-10-08T07:01:09.886785+0000","last_fullsized":"2023-10-08T07:01:09.886785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:35.339502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805622+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:09.805622+0000","last_peered":"2023-10-08T07:01:09.805622+0000","last_clean":"2023-10-08T07:01:09.805622+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:09.805622+0000","last_undegraded":"2023-10-08T07:01:09.805622+0000","last_fullsized":"2023-10-08T07:01:09.805622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:53.864366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879648+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:09.879648+0000","last_peered":"2023-10-08T07:01:09.879648+0000","last_clean":"2023-10-08T07:01:09.879648+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:09.879648+0000","last_undegraded":"2023-10-08T07:01:09.879648+0000","last_fullsized":"2023-10-08T07:01:09.879648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612613,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47200,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324640,"statfs":{"total":96636764160,"available":96588431360,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325040,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046800,"statfs":{"total":96636764160,"available":96303923200,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54200000000000004,"5min":1.998,"15min":1.998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.443}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306988,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064852,"statfs":{"total":96636764160,"available":96322408448,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:01:15.767 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-10-08T07:01:15.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2023-10-08T07:01:16.156 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T07:01:16.166 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T07:01:16.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:01:16.508 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:01:16.521 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2023-10-08T07:01:15.007648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679228,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436292,"statfs":{"total":289910292480,"available":289214763008,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135536"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889369+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:09.889369+0000","last_peered":"2023-10-08T07:01:09.889369+0000","last_clean":"2023-10-08T07:01:09.889369+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:09.889369+0000","last_undegraded":"2023-10-08T07:01:09.889369+0000","last_fullsized":"2023-10-08T07:01:09.889369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879623+0000","last_change":"2023-10-08T07:00:58.757022+0000","last_active":"2023-10-08T07:01:09.879623+0000","last_peered":"2023-10-08T07:01:09.879623+0000","last_clean":"2023-10-08T07:01:09.879623+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:09.879623+0000","last_undegraded":"2023-10-08T07:01:09.879623+0000","last_fullsized":"2023-10-08T07:01:09.879623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:57.715272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876818+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:09.876818+0000","last_peered":"2023-10-08T07:01:09.876818+0000","last_clean":"2023-10-08T07:01:09.876818+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:09.876818+0000","last_undegraded":"2023-10-08T07:01:09.876818+0000","last_fullsized":"2023-10-08T07:01:09.876818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876767+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:09.876767+0000","last_peered":"2023-10-08T07:01:09.876767+0000","last_clean":"2023-10-08T07:01:09.876767+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:09.876767+0000","last_undegraded":"2023-10-08T07:01:09.876767+0000","last_fullsized":"2023-10-08T07:01:09.876767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:08.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886836+0000","last_change":"2023-10-08T07:01:09.882134+0000","last_active":"2023-10-08T07:01:09.886836+0000","last_peered":"2023-10-08T07:01:09.886836+0000","last_clean":"2023-10-08T07:01:09.886836+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:09.886836+0000","last_undegraded":"2023-10-08T07:01:09.886836+0000","last_fullsized":"2023-10-08T07:01:09.886836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876241+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:09.876241+0000","last_peered":"2023-10-08T07:01:09.876241+0000","last_clean":"2023-10-08T07:01:09.876241+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:09.876241+0000","last_undegraded":"2023-10-08T07:01:09.876241+0000","last_fullsized":"2023-10-08T07:01:09.876241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.341032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875903+0000","last_change":"2023-10-08T07:00:58.741788+0000","last_active":"2023-10-08T07:01:09.875903+0000","last_peered":"2023-10-08T07:01:09.875903+0000","last_clean":"2023-10-08T07:01:09.875903+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:09.875903+0000","last_undegraded":"2023-10-08T07:01:09.875903+0000","last_fullsized":"2023-10-08T07:01:09.875903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875853+0000","last_change":"2023-10-08T07:00:58.743309+0000","last_active":"2023-10-08T07:01:09.875853+0000","last_peered":"2023-10-08T07:01:09.875853+0000","last_clean":"2023-10-08T07:01:09.875853+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:09.875853+0000","last_undegraded":"2023-10-08T07:01:09.875853+0000","last_fullsized":"2023-10-08T07:01:09.875853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805710+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:09.805710+0000","last_peered":"2023-10-08T07:01:09.805710+0000","last_clean":"2023-10-08T07:01:09.805710+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:09.805710+0000","last_undegraded":"2023-10-08T07:01:09.805710+0000","last_fullsized":"2023-10-08T07:01:09.805710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:14.193056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879851+0000","last_change":"2023-10-08T07:00:58.757350+0000","last_active":"2023-10-08T07:01:09.879851+0000","last_peered":"2023-10-08T07:01:09.879851+0000","last_clean":"2023-10-08T07:01:09.879851+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:09.879851+0000","last_undegraded":"2023-10-08T07:01:09.879851+0000","last_fullsized":"2023-10-08T07:01:09.879851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:38.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876686+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:09.876686+0000","last_peered":"2023-10-08T07:01:09.876686+0000","last_clean":"2023-10-08T07:01:09.876686+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:09.876686+0000","last_undegraded":"2023-10-08T07:01:09.876686+0000","last_fullsized":"2023-10-08T07:01:09.876686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:11.748373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886800+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:09.886800+0000","last_peered":"2023-10-08T07:01:09.886800+0000","last_clean":"2023-10-08T07:01:09.886800+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:09.886800+0000","last_undegraded":"2023-10-08T07:01:09.886800+0000","last_fullsized":"2023-10-08T07:01:09.886800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:50.428711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.884162+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:09.884162+0000","last_peered":"2023-10-08T07:01:09.884162+0000","last_clean":"2023-10-08T07:01:09.884162+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:09.884162+0000","last_undegraded":"2023-10-08T07:01:09.884162+0000","last_fullsized":"2023-10-08T07:01:09.884162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876609+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:09.876609+0000","last_peered":"2023-10-08T07:01:09.876609+0000","last_clean":"2023-10-08T07:01:09.876609+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:09.876609+0000","last_undegraded":"2023-10-08T07:01:09.876609+0000","last_fullsized":"2023-10-08T07:01:09.876609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876291+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:09.876291+0000","last_peered":"2023-10-08T07:01:09.876291+0000","last_clean":"2023-10-08T07:01:09.876291+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:09.876291+0000","last_undegraded":"2023-10-08T07:01:09.876291+0000","last_fullsized":"2023-10-08T07:01:09.876291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875872+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:09.875872+0000","last_peered":"2023-10-08T07:01:09.875872+0000","last_clean":"2023-10-08T07:01:09.875872+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:09.875872+0000","last_undegraded":"2023-10-08T07:01:09.875872+0000","last_fullsized":"2023-10-08T07:01:09.875872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805445+0000","last_change":"2023-10-08T07:00:58.689994+0000","last_active":"2023-10-08T07:01:09.805445+0000","last_peered":"2023-10-08T07:01:09.805445+0000","last_clean":"2023-10-08T07:01:09.805445+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:09.805445+0000","last_undegraded":"2023-10-08T07:01:09.805445+0000","last_fullsized":"2023-10-08T07:01:09.805445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:38.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879888+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:09.879888+0000","last_peered":"2023-10-08T07:01:09.879888+0000","last_clean":"2023-10-08T07:01:09.879888+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:09.879888+0000","last_undegraded":"2023-10-08T07:01:09.879888+0000","last_fullsized":"2023-10-08T07:01:09.879888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:20.556448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805312+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:09.805312+0000","last_peered":"2023-10-08T07:01:09.805312+0000","last_clean":"2023-10-08T07:01:09.805312+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:09.805312+0000","last_undegraded":"2023-10-08T07:01:09.805312+0000","last_fullsized":"2023-10-08T07:01:09.805312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:57:56.486710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876667+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:09.876667+0000","last_peered":"2023-10-08T07:01:09.876667+0000","last_clean":"2023-10-08T07:01:09.876667+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:09.876667+0000","last_undegraded":"2023-10-08T07:01:09.876667+0000","last_fullsized":"2023-10-08T07:01:09.876667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:21.278271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876239+0000","last_change":"2023-10-08T07:00:58.743568+0000","last_active":"2023-10-08T07:01:09.876239+0000","last_peered":"2023-10-08T07:01:09.876239+0000","last_clean":"2023-10-08T07:01:09.876239+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:09.876239+0000","last_undegraded":"2023-10-08T07:01:09.876239+0000","last_fullsized":"2023-10-08T07:01:09.876239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:22.726402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886866+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:09.886866+0000","last_peered":"2023-10-08T07:01:09.886866+0000","last_clean":"2023-10-08T07:01:09.886866+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:09.886866+0000","last_undegraded":"2023-10-08T07:01:09.886866+0000","last_fullsized":"2023-10-08T07:01:09.886866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:30.912592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804896+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:09.804896+0000","last_peered":"2023-10-08T07:01:09.804896+0000","last_clean":"2023-10-08T07:01:09.804896+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:09.804896+0000","last_undegraded":"2023-10-08T07:01:09.804896+0000","last_fullsized":"2023-10-08T07:01:09.804896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:28.061195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878224+0000","last_change":"2023-10-08T07:00:58.757259+0000","last_active":"2023-10-08T07:01:09.878224+0000","last_peered":"2023-10-08T07:01:09.878224+0000","last_clean":"2023-10-08T07:01:09.878224+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:09.878224+0000","last_undegraded":"2023-10-08T07:01:09.878224+0000","last_fullsized":"2023-10-08T07:01:09.878224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:50.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880708+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:09.880708+0000","last_peered":"2023-10-08T07:01:09.880708+0000","last_clean":"2023-10-08T07:01:09.880708+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:09.880708+0000","last_undegraded":"2023-10-08T07:01:09.880708+0000","last_fullsized":"2023-10-08T07:01:09.880708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805824+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:09.805824+0000","last_peered":"2023-10-08T07:01:09.805824+0000","last_clean":"2023-10-08T07:01:09.805824+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:09.805824+0000","last_undegraded":"2023-10-08T07:01:09.805824+0000","last_fullsized":"2023-10-08T07:01:09.805824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:02:40.932995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876702+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:09.876702+0000","last_peered":"2023-10-08T07:01:09.876702+0000","last_clean":"2023-10-08T07:01:09.876702+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:09.876702+0000","last_undegraded":"2023-10-08T07:01:09.876702+0000","last_fullsized":"2023-10-08T07:01:09.876702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889382+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:09.889382+0000","last_peered":"2023-10-08T07:01:09.889382+0000","last_clean":"2023-10-08T07:01:09.889382+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889382+0000","last_undegraded":"2023-10-08T07:01:09.889382+0000","last_fullsized":"2023-10-08T07:01:09.889382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879867+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:09.879867+0000","last_peered":"2023-10-08T07:01:09.879867+0000","last_clean":"2023-10-08T07:01:09.879867+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:09.879867+0000","last_undegraded":"2023-10-08T07:01:09.879867+0000","last_fullsized":"2023-10-08T07:01:09.879867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804720+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:09.804720+0000","last_peered":"2023-10-08T07:01:09.804720+0000","last_clean":"2023-10-08T07:01:09.804720+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:09.804720+0000","last_undegraded":"2023-10-08T07:01:09.804720+0000","last_fullsized":"2023-10-08T07:01:09.804720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:18.521858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805896+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:09.805896+0000","last_peered":"2023-10-08T07:01:09.805896+0000","last_clean":"2023-10-08T07:01:09.805896+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:09.805896+0000","last_undegraded":"2023-10-08T07:01:09.805896+0000","last_fullsized":"2023-10-08T07:01:09.805896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:14:38.780240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804669+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:09.804669+0000","last_peered":"2023-10-08T07:01:09.804669+0000","last_clean":"2023-10-08T07:01:09.804669+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:09.804669+0000","last_undegraded":"2023-10-08T07:01:09.804669+0000","last_fullsized":"2023-10-08T07:01:09.804669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:42.865388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880661+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:09.880661+0000","last_peered":"2023-10-08T07:01:09.880661+0000","last_clean":"2023-10-08T07:01:09.880661+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:09.880661+0000","last_undegraded":"2023-10-08T07:01:09.880661+0000","last_fullsized":"2023-10-08T07:01:09.880661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805748+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:09.805748+0000","last_peered":"2023-10-08T07:01:09.805748+0000","last_clean":"2023-10-08T07:01:09.805748+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:09.805748+0000","last_undegraded":"2023-10-08T07:01:09.805748+0000","last_fullsized":"2023-10-08T07:01:09.805748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:05:28.271541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804563+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:09.804563+0000","last_peered":"2023-10-08T07:01:09.804563+0000","last_clean":"2023-10-08T07:01:09.804563+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:09.804563+0000","last_undegraded":"2023-10-08T07:01:09.804563+0000","last_fullsized":"2023-10-08T07:01:09.804563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:40.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876794+0000","last_change":"2023-10-08T07:00:58.742002+0000","last_active":"2023-10-08T07:01:09.876794+0000","last_peered":"2023-10-08T07:01:09.876794+0000","last_clean":"2023-10-08T07:01:09.876794+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:09.876794+0000","last_undegraded":"2023-10-08T07:01:09.876794+0000","last_fullsized":"2023-10-08T07:01:09.876794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:29.906921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805026+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:09.805026+0000","last_peered":"2023-10-08T07:01:09.805026+0000","last_clean":"2023-10-08T07:01:09.805026+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:09.805026+0000","last_undegraded":"2023-10-08T07:01:09.805026+0000","last_fullsized":"2023-10-08T07:01:09.805026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:26.532564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879366+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:09.879366+0000","last_peered":"2023-10-08T07:01:09.879366+0000","last_clean":"2023-10-08T07:01:09.879366+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:09.879366+0000","last_undegraded":"2023-10-08T07:01:09.879366+0000","last_fullsized":"2023-10-08T07:01:09.879366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804726+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:09.804726+0000","last_peered":"2023-10-08T07:01:09.804726+0000","last_clean":"2023-10-08T07:01:09.804726+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:09.804726+0000","last_undegraded":"2023-10-08T07:01:09.804726+0000","last_fullsized":"2023-10-08T07:01:09.804726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:54.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876664+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:09.876664+0000","last_peered":"2023-10-08T07:01:09.876664+0000","last_clean":"2023-10-08T07:01:09.876664+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:09.876664+0000","last_undegraded":"2023-10-08T07:01:09.876664+0000","last_fullsized":"2023-10-08T07:01:09.876664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876537+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:09.876537+0000","last_peered":"2023-10-08T07:01:09.876537+0000","last_clean":"2023-10-08T07:01:09.876537+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:09.876537+0000","last_undegraded":"2023-10-08T07:01:09.876537+0000","last_fullsized":"2023-10-08T07:01:09.876537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876642+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:09.876642+0000","last_peered":"2023-10-08T07:01:09.876642+0000","last_clean":"2023-10-08T07:01:09.876642+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:09.876642+0000","last_undegraded":"2023-10-08T07:01:09.876642+0000","last_fullsized":"2023-10-08T07:01:09.876642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:49.423040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886847+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:09.886847+0000","last_peered":"2023-10-08T07:01:09.886847+0000","last_clean":"2023-10-08T07:01:09.886847+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:09.886847+0000","last_undegraded":"2023-10-08T07:01:09.886847+0000","last_fullsized":"2023-10-08T07:01:09.886847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:53.793279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804844+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:09.804844+0000","last_peered":"2023-10-08T07:01:09.804844+0000","last_clean":"2023-10-08T07:01:09.804844+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:09.804844+0000","last_undegraded":"2023-10-08T07:01:09.804844+0000","last_fullsized":"2023-10-08T07:01:09.804844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:09.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886829+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:09.886829+0000","last_peered":"2023-10-08T07:01:09.886829+0000","last_clean":"2023-10-08T07:01:09.886829+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:09.886829+0000","last_undegraded":"2023-10-08T07:01:09.886829+0000","last_fullsized":"2023-10-08T07:01:09.886829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878197+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:09.878197+0000","last_peered":"2023-10-08T07:01:09.878197+0000","last_clean":"2023-10-08T07:01:09.878197+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:09.878197+0000","last_undegraded":"2023-10-08T07:01:09.878197+0000","last_fullsized":"2023-10-08T07:01:09.878197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805734+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:09.805734+0000","last_peered":"2023-10-08T07:01:09.805734+0000","last_clean":"2023-10-08T07:01:09.805734+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:09.805734+0000","last_undegraded":"2023-10-08T07:01:09.805734+0000","last_fullsized":"2023-10-08T07:01:09.805734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:48:19.319694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876264+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:09.876264+0000","last_peered":"2023-10-08T07:01:09.876264+0000","last_clean":"2023-10-08T07:01:09.876264+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:09.876264+0000","last_undegraded":"2023-10-08T07:01:09.876264+0000","last_fullsized":"2023-10-08T07:01:09.876264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805857+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:09.805857+0000","last_peered":"2023-10-08T07:01:09.805857+0000","last_clean":"2023-10-08T07:01:09.805857+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:09.805857+0000","last_undegraded":"2023-10-08T07:01:09.805857+0000","last_fullsized":"2023-10-08T07:01:09.805857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:38.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876985+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:09.876985+0000","last_peered":"2023-10-08T07:01:09.876985+0000","last_clean":"2023-10-08T07:01:09.876985+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:09.876985+0000","last_undegraded":"2023-10-08T07:01:09.876985+0000","last_fullsized":"2023-10-08T07:01:09.876985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877688+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:09.877688+0000","last_peered":"2023-10-08T07:01:09.877688+0000","last_clean":"2023-10-08T07:01:09.877688+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:09.877688+0000","last_undegraded":"2023-10-08T07:01:09.877688+0000","last_fullsized":"2023-10-08T07:01:09.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879744+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:09.879744+0000","last_peered":"2023-10-08T07:01:09.879744+0000","last_clean":"2023-10-08T07:01:09.879744+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:09.879744+0000","last_undegraded":"2023-10-08T07:01:09.879744+0000","last_fullsized":"2023-10-08T07:01:09.879744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878510+0000","last_change":"2023-10-08T07:00:58.742366+0000","last_active":"2023-10-08T07:01:09.878510+0000","last_peered":"2023-10-08T07:01:09.878510+0000","last_clean":"2023-10-08T07:01:09.878510+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:09.878510+0000","last_undegraded":"2023-10-08T07:01:09.878510+0000","last_fullsized":"2023-10-08T07:01:09.878510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.443197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876833+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:09.876833+0000","last_peered":"2023-10-08T07:01:09.876833+0000","last_clean":"2023-10-08T07:01:09.876833+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:09.876833+0000","last_undegraded":"2023-10-08T07:01:09.876833+0000","last_fullsized":"2023-10-08T07:01:09.876833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876500+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:09.876500+0000","last_peered":"2023-10-08T07:01:09.876500+0000","last_clean":"2023-10-08T07:01:09.876500+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:09.876500+0000","last_undegraded":"2023-10-08T07:01:09.876500+0000","last_fullsized":"2023-10-08T07:01:09.876500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:41.315551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876366+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:09.876366+0000","last_peered":"2023-10-08T07:01:09.876366+0000","last_clean":"2023-10-08T07:01:09.876366+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:09.876366+0000","last_undegraded":"2023-10-08T07:01:09.876366+0000","last_fullsized":"2023-10-08T07:01:09.876366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:52.787608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805457+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:09.805457+0000","last_peered":"2023-10-08T07:01:09.805457+0000","last_clean":"2023-10-08T07:01:09.805457+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:09.805457+0000","last_undegraded":"2023-10-08T07:01:09.805457+0000","last_fullsized":"2023-10-08T07:01:09.805457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:46.069356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805138+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:09.805138+0000","last_peered":"2023-10-08T07:01:09.805138+0000","last_clean":"2023-10-08T07:01:09.805138+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:09.805138+0000","last_undegraded":"2023-10-08T07:01:09.805138+0000","last_fullsized":"2023-10-08T07:01:09.805138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:30.717351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876373+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:09.876373+0000","last_peered":"2023-10-08T07:01:09.876373+0000","last_clean":"2023-10-08T07:01:09.876373+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:09.876373+0000","last_undegraded":"2023-10-08T07:01:09.876373+0000","last_fullsized":"2023-10-08T07:01:09.876373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875889+0000","last_change":"2023-10-08T07:00:58.741881+0000","last_active":"2023-10-08T07:01:09.875889+0000","last_peered":"2023-10-08T07:01:09.875889+0000","last_clean":"2023-10-08T07:01:09.875889+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:09.875889+0000","last_undegraded":"2023-10-08T07:01:09.875889+0000","last_fullsized":"2023-10-08T07:01:09.875889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:42.957083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877011+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:09.877011+0000","last_peered":"2023-10-08T07:01:09.877011+0000","last_clean":"2023-10-08T07:01:09.877011+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:09.877011+0000","last_undegraded":"2023-10-08T07:01:09.877011+0000","last_fullsized":"2023-10-08T07:01:09.877011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886762+0000","last_change":"2023-10-08T07:01:09.881913+0000","last_active":"2023-10-08T07:01:09.886762+0000","last_peered":"2023-10-08T07:01:09.886762+0000","last_clean":"2023-10-08T07:01:09.886762+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:09.886762+0000","last_undegraded":"2023-10-08T07:01:09.886762+0000","last_fullsized":"2023-10-08T07:01:09.886762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:43.187153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876894+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:09.876894+0000","last_peered":"2023-10-08T07:01:09.876894+0000","last_clean":"2023-10-08T07:01:09.876894+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:09.876894+0000","last_undegraded":"2023-10-08T07:01:09.876894+0000","last_fullsized":"2023-10-08T07:01:09.876894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878020+0000","last_change":"2023-10-08T07:00:58.757070+0000","last_active":"2023-10-08T07:01:09.878020+0000","last_peered":"2023-10-08T07:01:09.878020+0000","last_clean":"2023-10-08T07:01:09.878020+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:09.878020+0000","last_undegraded":"2023-10-08T07:01:09.878020+0000","last_fullsized":"2023-10-08T07:01:09.878020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:54.400652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805649+0000","last_change":"2023-10-08T07:00:58.690359+0000","last_active":"2023-10-08T07:01:09.805649+0000","last_peered":"2023-10-08T07:01:09.805649+0000","last_clean":"2023-10-08T07:01:09.805649+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:09.805649+0000","last_undegraded":"2023-10-08T07:01:09.805649+0000","last_fullsized":"2023-10-08T07:01:09.805649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:24.632619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805631+0000","last_change":"2023-10-08T07:00:58.689104+0000","last_active":"2023-10-08T07:01:09.805631+0000","last_peered":"2023-10-08T07:01:09.805631+0000","last_clean":"2023-10-08T07:01:09.805631+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:09.805631+0000","last_undegraded":"2023-10-08T07:01:09.805631+0000","last_fullsized":"2023-10-08T07:01:09.805631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:19.488445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876918+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:09.876918+0000","last_peered":"2023-10-08T07:01:09.876918+0000","last_clean":"2023-10-08T07:01:09.876918+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:09.876918+0000","last_undegraded":"2023-10-08T07:01:09.876918+0000","last_fullsized":"2023-10-08T07:01:09.876918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879374+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:09.879374+0000","last_peered":"2023-10-08T07:01:09.879374+0000","last_clean":"2023-10-08T07:01:09.879374+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:09.879374+0000","last_undegraded":"2023-10-08T07:01:09.879374+0000","last_fullsized":"2023-10-08T07:01:09.879374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876563+0000","last_change":"2023-10-08T07:00:58.741459+0000","last_active":"2023-10-08T07:01:09.876563+0000","last_peered":"2023-10-08T07:01:09.876563+0000","last_clean":"2023-10-08T07:01:09.876563+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:09.876563+0000","last_undegraded":"2023-10-08T07:01:09.876563+0000","last_fullsized":"2023-10-08T07:01:09.876563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:38.166894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876349+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:09.876349+0000","last_peered":"2023-10-08T07:01:09.876349+0000","last_clean":"2023-10-08T07:01:09.876349+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:09.876349+0000","last_undegraded":"2023-10-08T07:01:09.876349+0000","last_fullsized":"2023-10-08T07:01:09.876349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:42.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805368+0000","last_change":"2023-10-08T07:00:58.689101+0000","last_active":"2023-10-08T07:01:09.805368+0000","last_peered":"2023-10-08T07:01:09.805368+0000","last_clean":"2023-10-08T07:01:09.805368+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:09.805368+0000","last_undegraded":"2023-10-08T07:01:09.805368+0000","last_fullsized":"2023-10-08T07:01:09.805368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:57.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804920+0000","last_change":"2023-10-08T07:00:58.686855+0000","last_active":"2023-10-08T07:01:09.804920+0000","last_peered":"2023-10-08T07:01:09.804920+0000","last_clean":"2023-10-08T07:01:09.804920+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:09.804920+0000","last_undegraded":"2023-10-08T07:01:09.804920+0000","last_fullsized":"2023-10-08T07:01:09.804920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:30.932703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.883950+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:09.883950+0000","last_peered":"2023-10-08T07:01:09.883950+0000","last_clean":"2023-10-08T07:01:09.883950+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:09.883950+0000","last_undegraded":"2023-10-08T07:01:09.883950+0000","last_fullsized":"2023-10-08T07:01:09.883950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:05.703724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805796+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:09.805796+0000","last_peered":"2023-10-08T07:01:09.805796+0000","last_clean":"2023-10-08T07:01:09.805796+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:09.805796+0000","last_undegraded":"2023-10-08T07:01:09.805796+0000","last_fullsized":"2023-10-08T07:01:09.805796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:44.156143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876428+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:09.876428+0000","last_peered":"2023-10-08T07:01:09.876428+0000","last_clean":"2023-10-08T07:01:09.876428+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:09.876428+0000","last_undegraded":"2023-10-08T07:01:09.876428+0000","last_fullsized":"2023-10-08T07:01:09.876428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:23.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876001+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:09.876001+0000","last_peered":"2023-10-08T07:01:09.876001+0000","last_clean":"2023-10-08T07:01:09.876001+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:09.876001+0000","last_undegraded":"2023-10-08T07:01:09.876001+0000","last_fullsized":"2023-10-08T07:01:09.876001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805034+0000","last_change":"2023-10-08T07:00:58.687270+0000","last_active":"2023-10-08T07:01:09.805034+0000","last_peered":"2023-10-08T07:01:09.805034+0000","last_clean":"2023-10-08T07:01:09.805034+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:09.805034+0000","last_undegraded":"2023-10-08T07:01:09.805034+0000","last_fullsized":"2023-10-08T07:01:09.805034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:05.762019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877017+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:09.877017+0000","last_peered":"2023-10-08T07:01:09.877017+0000","last_clean":"2023-10-08T07:01:09.877017+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:09.877017+0000","last_undegraded":"2023-10-08T07:01:09.877017+0000","last_fullsized":"2023-10-08T07:01:09.877017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782468+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:11.782468+0000","last_peered":"2023-10-08T07:01:11.782468+0000","last_clean":"2023-10-08T07:01:11.782468+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:11.782468+0000","last_undegraded":"2023-10-08T07:01:11.782468+0000","last_fullsized":"2023-10-08T07:01:11.782468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804656+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:09.804656+0000","last_peered":"2023-10-08T07:01:09.804656+0000","last_clean":"2023-10-08T07:01:09.804656+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:09.804656+0000","last_undegraded":"2023-10-08T07:01:09.804656+0000","last_fullsized":"2023-10-08T07:01:09.804656+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:30.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886744+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:09.886744+0000","last_peered":"2023-10-08T07:01:09.886744+0000","last_clean":"2023-10-08T07:01:09.886744+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:09.886744+0000","last_undegraded":"2023-10-08T07:01:09.886744+0000","last_fullsized":"2023-10-08T07:01:09.886744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:29.167059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889407+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:09.889407+0000","last_peered":"2023-10-08T07:01:09.889407+0000","last_clean":"2023-10-08T07:01:09.889407+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889407+0000","last_undegraded":"2023-10-08T07:01:09.889407+0000","last_fullsized":"2023-10-08T07:01:09.889407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:37.936824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805266+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:09.805266+0000","last_peered":"2023-10-08T07:01:09.805266+0000","last_clean":"2023-10-08T07:01:09.805266+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:09.805266+0000","last_undegraded":"2023-10-08T07:01:09.805266+0000","last_fullsized":"2023-10-08T07:01:09.805266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:32.928459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878330+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:09.878330+0000","last_peered":"2023-10-08T07:01:09.878330+0000","last_clean":"2023-10-08T07:01:09.878330+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:09.878330+0000","last_undegraded":"2023-10-08T07:01:09.878330+0000","last_fullsized":"2023-10-08T07:01:09.878330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805556+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:09.805556+0000","last_peered":"2023-10-08T07:01:09.805556+0000","last_clean":"2023-10-08T07:01:09.805556+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:09.805556+0000","last_undegraded":"2023-10-08T07:01:09.805556+0000","last_fullsized":"2023-10-08T07:01:09.805556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:30.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805342+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:09.805342+0000","last_peered":"2023-10-08T07:01:09.805342+0000","last_clean":"2023-10-08T07:01:09.805342+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:09.805342+0000","last_undegraded":"2023-10-08T07:01:09.805342+0000","last_fullsized":"2023-10-08T07:01:09.805342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:03.680449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804573+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:09.804573+0000","last_peered":"2023-10-08T07:01:09.804573+0000","last_clean":"2023-10-08T07:01:09.804573+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:09.804573+0000","last_undegraded":"2023-10-08T07:01:09.804573+0000","last_fullsized":"2023-10-08T07:01:09.804573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:55.749420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877044+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:09.877044+0000","last_peered":"2023-10-08T07:01:09.877044+0000","last_clean":"2023-10-08T07:01:09.877044+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:09.877044+0000","last_undegraded":"2023-10-08T07:01:09.877044+0000","last_fullsized":"2023-10-08T07:01:09.877044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805626+0000","last_change":"2023-10-08T07:00:58.672669+0000","last_active":"2023-10-08T07:01:09.805626+0000","last_peered":"2023-10-08T07:01:09.805626+0000","last_clean":"2023-10-08T07:01:09.805626+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:09.805626+0000","last_undegraded":"2023-10-08T07:01:09.805626+0000","last_fullsized":"2023-10-08T07:01:09.805626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:24.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879021+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:09.879021+0000","last_peered":"2023-10-08T07:01:09.879021+0000","last_clean":"2023-10-08T07:01:09.879021+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:09.879021+0000","last_undegraded":"2023-10-08T07:01:09.879021+0000","last_fullsized":"2023-10-08T07:01:09.879021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878395+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:09.878395+0000","last_peered":"2023-10-08T07:01:09.878395+0000","last_clean":"2023-10-08T07:01:09.878395+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:09.878395+0000","last_undegraded":"2023-10-08T07:01:09.878395+0000","last_fullsized":"2023-10-08T07:01:09.878395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879534+0000","last_change":"2023-10-08T07:00:58.756916+0000","last_active":"2023-10-08T07:01:09.879534+0000","last_peered":"2023-10-08T07:01:09.879534+0000","last_clean":"2023-10-08T07:01:09.879534+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:09.879534+0000","last_undegraded":"2023-10-08T07:01:09.879534+0000","last_fullsized":"2023-10-08T07:01:09.879534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:45.871560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876541+0000","last_change":"2023-10-08T07:00:58.741378+0000","last_active":"2023-10-08T07:01:09.876541+0000","last_peered":"2023-10-08T07:01:09.876541+0000","last_clean":"2023-10-08T07:01:09.876541+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:09.876541+0000","last_undegraded":"2023-10-08T07:01:09.876541+0000","last_fullsized":"2023-10-08T07:01:09.876541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:34.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876257+0000","last_change":"2023-10-08T07:00:58.743707+0000","last_active":"2023-10-08T07:01:09.876257+0000","last_peered":"2023-10-08T07:01:09.876257+0000","last_clean":"2023-10-08T07:01:09.876257+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:09.876257+0000","last_undegraded":"2023-10-08T07:01:09.876257+0000","last_fullsized":"2023-10-08T07:01:09.876257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:10:58.417067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879563+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:09.879563+0000","last_peered":"2023-10-08T07:01:09.879563+0000","last_clean":"2023-10-08T07:01:09.879563+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:09.879563+0000","last_undegraded":"2023-10-08T07:01:09.879563+0000","last_fullsized":"2023-10-08T07:01:09.879563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876387+0000","last_change":"2023-10-08T07:00:58.743219+0000","last_active":"2023-10-08T07:01:09.876387+0000","last_peered":"2023-10-08T07:01:09.876387+0000","last_clean":"2023-10-08T07:01:09.876387+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:09.876387+0000","last_undegraded":"2023-10-08T07:01:09.876387+0000","last_fullsized":"2023-10-08T07:01:09.876387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:11.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805505+0000","last_change":"2023-10-08T07:00:58.689299+0000","last_active":"2023-10-08T07:01:09.805505+0000","last_peered":"2023-10-08T07:01:09.805505+0000","last_clean":"2023-10-08T07:01:09.805505+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:09.805505+0000","last_undegraded":"2023-10-08T07:01:09.805505+0000","last_fullsized":"2023-10-08T07:01:09.805505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:03.194361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878607+0000","last_change":"2023-10-08T07:00:58.742191+0000","last_active":"2023-10-08T07:01:09.878607+0000","last_peered":"2023-10-08T07:01:09.878607+0000","last_clean":"2023-10-08T07:01:09.878607+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:09.878607+0000","last_undegraded":"2023-10-08T07:01:09.878607+0000","last_fullsized":"2023-10-08T07:01:09.878607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.860327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805580+0000","last_change":"2023-10-08T07:00:58.672323+0000","last_active":"2023-10-08T07:01:09.805580+0000","last_peered":"2023-10-08T07:01:09.805580+0000","last_clean":"2023-10-08T07:01:09.805580+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:09.805580+0000","last_undegraded":"2023-10-08T07:01:09.805580+0000","last_fullsized":"2023-10-08T07:01:09.805580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:46.142346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876259+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:09.876259+0000","last_peered":"2023-10-08T07:01:09.876259+0000","last_clean":"2023-10-08T07:01:09.876259+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:09.876259+0000","last_undegraded":"2023-10-08T07:01:09.876259+0000","last_fullsized":"2023-10-08T07:01:09.876259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:27.988825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876116+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:09.876116+0000","last_peered":"2023-10-08T07:01:09.876116+0000","last_clean":"2023-10-08T07:01:09.876116+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:09.876116+0000","last_undegraded":"2023-10-08T07:01:09.876116+0000","last_fullsized":"2023-10-08T07:01:09.876116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:32.031015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805004+0000","last_change":"2023-10-08T07:00:58.687458+0000","last_active":"2023-10-08T07:01:09.805004+0000","last_peered":"2023-10-08T07:01:09.805004+0000","last_clean":"2023-10-08T07:01:09.805004+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:09.805004+0000","last_undegraded":"2023-10-08T07:01:09.805004+0000","last_fullsized":"2023-10-08T07:01:09.805004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:25:42.651522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886785+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:09.886785+0000","last_peered":"2023-10-08T07:01:09.886785+0000","last_clean":"2023-10-08T07:01:09.886785+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:09.886785+0000","last_undegraded":"2023-10-08T07:01:09.886785+0000","last_fullsized":"2023-10-08T07:01:09.886785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:35.339502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805622+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:09.805622+0000","last_peered":"2023-10-08T07:01:09.805622+0000","last_clean":"2023-10-08T07:01:09.805622+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:09.805622+0000","last_undegraded":"2023-10-08T07:01:09.805622+0000","last_fullsized":"2023-10-08T07:01:09.805622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:53.864366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879648+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:09.879648+0000","last_peered":"2023-10-08T07:01:09.879648+0000","last_clean":"2023-10-08T07:01:09.879648+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:09.879648+0000","last_undegraded":"2023-10-08T07:01:09.879648+0000","last_fullsized":"2023-10-08T07:01:09.879648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612613,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47200,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324640,"statfs":{"total":96636764160,"available":96588431360,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325040,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046800,"statfs":{"total":96636764160,"available":96303923200,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54200000000000004,"5min":1.998,"15min":1.998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.443}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306988,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064852,"statfs":{"total":96636764160,"available":96322408448,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:01:16.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:01:16.899 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:01:16.911 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2023-10-08T07:01:15.007648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679228,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436292,"statfs":{"total":289910292480,"available":289214763008,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135536"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889369+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:09.889369+0000","last_peered":"2023-10-08T07:01:09.889369+0000","last_clean":"2023-10-08T07:01:09.889369+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:09.889369+0000","last_undegraded":"2023-10-08T07:01:09.889369+0000","last_fullsized":"2023-10-08T07:01:09.889369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879623+0000","last_change":"2023-10-08T07:00:58.757022+0000","last_active":"2023-10-08T07:01:09.879623+0000","last_peered":"2023-10-08T07:01:09.879623+0000","last_clean":"2023-10-08T07:01:09.879623+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:09.879623+0000","last_undegraded":"2023-10-08T07:01:09.879623+0000","last_fullsized":"2023-10-08T07:01:09.879623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:57.715272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876818+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:09.876818+0000","last_peered":"2023-10-08T07:01:09.876818+0000","last_clean":"2023-10-08T07:01:09.876818+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:09.876818+0000","last_undegraded":"2023-10-08T07:01:09.876818+0000","last_fullsized":"2023-10-08T07:01:09.876818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876767+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:09.876767+0000","last_peered":"2023-10-08T07:01:09.876767+0000","last_clean":"2023-10-08T07:01:09.876767+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:09.876767+0000","last_undegraded":"2023-10-08T07:01:09.876767+0000","last_fullsized":"2023-10-08T07:01:09.876767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:08.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886836+0000","last_change":"2023-10-08T07:01:09.882134+0000","last_active":"2023-10-08T07:01:09.886836+0000","last_peered":"2023-10-08T07:01:09.886836+0000","last_clean":"2023-10-08T07:01:09.886836+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:09.886836+0000","last_undegraded":"2023-10-08T07:01:09.886836+0000","last_fullsized":"2023-10-08T07:01:09.886836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876241+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:09.876241+0000","last_peered":"2023-10-08T07:01:09.876241+0000","last_clean":"2023-10-08T07:01:09.876241+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:09.876241+0000","last_undegraded":"2023-10-08T07:01:09.876241+0000","last_fullsized":"2023-10-08T07:01:09.876241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.341032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875903+0000","last_change":"2023-10-08T07:00:58.741788+0000","last_active":"2023-10-08T07:01:09.875903+0000","last_peered":"2023-10-08T07:01:09.875903+0000","last_clean":"2023-10-08T07:01:09.875903+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:09.875903+0000","last_undegraded":"2023-10-08T07:01:09.875903+0000","last_fullsized":"2023-10-08T07:01:09.875903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875853+0000","last_change":"2023-10-08T07:00:58.743309+0000","last_active":"2023-10-08T07:01:09.875853+0000","last_peered":"2023-10-08T07:01:09.875853+0000","last_clean":"2023-10-08T07:01:09.875853+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:09.875853+0000","last_undegraded":"2023-10-08T07:01:09.875853+0000","last_fullsized":"2023-10-08T07:01:09.875853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805710+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:09.805710+0000","last_peered":"2023-10-08T07:01:09.805710+0000","last_clean":"2023-10-08T07:01:09.805710+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:09.805710+0000","last_undegraded":"2023-10-08T07:01:09.805710+0000","last_fullsized":"2023-10-08T07:01:09.805710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:14.193056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879851+0000","last_change":"2023-10-08T07:00:58.757350+0000","last_active":"2023-10-08T07:01:09.879851+0000","last_peered":"2023-10-08T07:01:09.879851+0000","last_clean":"2023-10-08T07:01:09.879851+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:09.879851+0000","last_undegraded":"2023-10-08T07:01:09.879851+0000","last_fullsized":"2023-10-08T07:01:09.879851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:38.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876686+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:09.876686+0000","last_peered":"2023-10-08T07:01:09.876686+0000","last_clean":"2023-10-08T07:01:09.876686+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:09.876686+0000","last_undegraded":"2023-10-08T07:01:09.876686+0000","last_fullsized":"2023-10-08T07:01:09.876686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:11.748373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886800+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:09.886800+0000","last_peered":"2023-10-08T07:01:09.886800+0000","last_clean":"2023-10-08T07:01:09.886800+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:09.886800+0000","last_undegraded":"2023-10-08T07:01:09.886800+0000","last_fullsized":"2023-10-08T07:01:09.886800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:50.428711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.884162+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:09.884162+0000","last_peered":"2023-10-08T07:01:09.884162+0000","last_clean":"2023-10-08T07:01:09.884162+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:09.884162+0000","last_undegraded":"2023-10-08T07:01:09.884162+0000","last_fullsized":"2023-10-08T07:01:09.884162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876609+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:09.876609+0000","last_peered":"2023-10-08T07:01:09.876609+0000","last_clean":"2023-10-08T07:01:09.876609+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:09.876609+0000","last_undegraded":"2023-10-08T07:01:09.876609+0000","last_fullsized":"2023-10-08T07:01:09.876609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876291+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:09.876291+0000","last_peered":"2023-10-08T07:01:09.876291+0000","last_clean":"2023-10-08T07:01:09.876291+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:09.876291+0000","last_undegraded":"2023-10-08T07:01:09.876291+0000","last_fullsized":"2023-10-08T07:01:09.876291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875872+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:09.875872+0000","last_peered":"2023-10-08T07:01:09.875872+0000","last_clean":"2023-10-08T07:01:09.875872+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:09.875872+0000","last_undegraded":"2023-10-08T07:01:09.875872+0000","last_fullsized":"2023-10-08T07:01:09.875872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805445+0000","last_change":"2023-10-08T07:00:58.689994+0000","last_active":"2023-10-08T07:01:09.805445+0000","last_peered":"2023-10-08T07:01:09.805445+0000","last_clean":"2023-10-08T07:01:09.805445+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:09.805445+0000","last_undegraded":"2023-10-08T07:01:09.805445+0000","last_fullsized":"2023-10-08T07:01:09.805445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:38.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879888+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:09.879888+0000","last_peered":"2023-10-08T07:01:09.879888+0000","last_clean":"2023-10-08T07:01:09.879888+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:09.879888+0000","last_undegraded":"2023-10-08T07:01:09.879888+0000","last_fullsized":"2023-10-08T07:01:09.879888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:20.556448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805312+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:09.805312+0000","last_peered":"2023-10-08T07:01:09.805312+0000","last_clean":"2023-10-08T07:01:09.805312+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:09.805312+0000","last_undegraded":"2023-10-08T07:01:09.805312+0000","last_fullsized":"2023-10-08T07:01:09.805312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:57:56.486710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876667+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:09.876667+0000","last_peered":"2023-10-08T07:01:09.876667+0000","last_clean":"2023-10-08T07:01:09.876667+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:09.876667+0000","last_undegraded":"2023-10-08T07:01:09.876667+0000","last_fullsized":"2023-10-08T07:01:09.876667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:21.278271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876239+0000","last_change":"2023-10-08T07:00:58.743568+0000","last_active":"2023-10-08T07:01:09.876239+0000","last_peered":"2023-10-08T07:01:09.876239+0000","last_clean":"2023-10-08T07:01:09.876239+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:09.876239+0000","last_undegraded":"2023-10-08T07:01:09.876239+0000","last_fullsized":"2023-10-08T07:01:09.876239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:22.726402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886866+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:09.886866+0000","last_peered":"2023-10-08T07:01:09.886866+0000","last_clean":"2023-10-08T07:01:09.886866+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:09.886866+0000","last_undegraded":"2023-10-08T07:01:09.886866+0000","last_fullsized":"2023-10-08T07:01:09.886866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:30.912592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804896+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:09.804896+0000","last_peered":"2023-10-08T07:01:09.804896+0000","last_clean":"2023-10-08T07:01:09.804896+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:09.804896+0000","last_undegraded":"2023-10-08T07:01:09.804896+0000","last_fullsized":"2023-10-08T07:01:09.804896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:28.061195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878224+0000","last_change":"2023-10-08T07:00:58.757259+0000","last_active":"2023-10-08T07:01:09.878224+0000","last_peered":"2023-10-08T07:01:09.878224+0000","last_clean":"2023-10-08T07:01:09.878224+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:09.878224+0000","last_undegraded":"2023-10-08T07:01:09.878224+0000","last_fullsized":"2023-10-08T07:01:09.878224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:50.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880708+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:09.880708+0000","last_peered":"2023-10-08T07:01:09.880708+0000","last_clean":"2023-10-08T07:01:09.880708+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:09.880708+0000","last_undegraded":"2023-10-08T07:01:09.880708+0000","last_fullsized":"2023-10-08T07:01:09.880708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805824+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:09.805824+0000","last_peered":"2023-10-08T07:01:09.805824+0000","last_clean":"2023-10-08T07:01:09.805824+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:09.805824+0000","last_undegraded":"2023-10-08T07:01:09.805824+0000","last_fullsized":"2023-10-08T07:01:09.805824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:02:40.932995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876702+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:09.876702+0000","last_peered":"2023-10-08T07:01:09.876702+0000","last_clean":"2023-10-08T07:01:09.876702+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:09.876702+0000","last_undegraded":"2023-10-08T07:01:09.876702+0000","last_fullsized":"2023-10-08T07:01:09.876702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889382+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:09.889382+0000","last_peered":"2023-10-08T07:01:09.889382+0000","last_clean":"2023-10-08T07:01:09.889382+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889382+0000","last_undegraded":"2023-10-08T07:01:09.889382+0000","last_fullsized":"2023-10-08T07:01:09.889382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879867+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:09.879867+0000","last_peered":"2023-10-08T07:01:09.879867+0000","last_clean":"2023-10-08T07:01:09.879867+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:09.879867+0000","last_undegraded":"2023-10-08T07:01:09.879867+0000","last_fullsized":"2023-10-08T07:01:09.879867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804720+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:09.804720+0000","last_peered":"2023-10-08T07:01:09.804720+0000","last_clean":"2023-10-08T07:01:09.804720+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:09.804720+0000","last_undegraded":"2023-10-08T07:01:09.804720+0000","last_fullsized":"2023-10-08T07:01:09.804720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:18.521858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805896+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:09.805896+0000","last_peered":"2023-10-08T07:01:09.805896+0000","last_clean":"2023-10-08T07:01:09.805896+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:09.805896+0000","last_undegraded":"2023-10-08T07:01:09.805896+0000","last_fullsized":"2023-10-08T07:01:09.805896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:14:38.780240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804669+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:09.804669+0000","last_peered":"2023-10-08T07:01:09.804669+0000","last_clean":"2023-10-08T07:01:09.804669+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:09.804669+0000","last_undegraded":"2023-10-08T07:01:09.804669+0000","last_fullsized":"2023-10-08T07:01:09.804669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:42.865388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880661+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:09.880661+0000","last_peered":"2023-10-08T07:01:09.880661+0000","last_clean":"2023-10-08T07:01:09.880661+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:09.880661+0000","last_undegraded":"2023-10-08T07:01:09.880661+0000","last_fullsized":"2023-10-08T07:01:09.880661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805748+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:09.805748+0000","last_peered":"2023-10-08T07:01:09.805748+0000","last_clean":"2023-10-08T07:01:09.805748+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:09.805748+0000","last_undegraded":"2023-10-08T07:01:09.805748+0000","last_fullsized":"2023-10-08T07:01:09.805748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:05:28.271541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804563+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:09.804563+0000","last_peered":"2023-10-08T07:01:09.804563+0000","last_clean":"2023-10-08T07:01:09.804563+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:09.804563+0000","last_undegraded":"2023-10-08T07:01:09.804563+0000","last_fullsized":"2023-10-08T07:01:09.804563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:40.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876794+0000","last_change":"2023-10-08T07:00:58.742002+0000","last_active":"2023-10-08T07:01:09.876794+0000","last_peered":"2023-10-08T07:01:09.876794+0000","last_clean":"2023-10-08T07:01:09.876794+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:09.876794+0000","last_undegraded":"2023-10-08T07:01:09.876794+0000","last_fullsized":"2023-10-08T07:01:09.876794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:29.906921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805026+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:09.805026+0000","last_peered":"2023-10-08T07:01:09.805026+0000","last_clean":"2023-10-08T07:01:09.805026+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:09.805026+0000","last_undegraded":"2023-10-08T07:01:09.805026+0000","last_fullsized":"2023-10-08T07:01:09.805026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:26.532564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879366+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:09.879366+0000","last_peered":"2023-10-08T07:01:09.879366+0000","last_clean":"2023-10-08T07:01:09.879366+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:09.879366+0000","last_undegraded":"2023-10-08T07:01:09.879366+0000","last_fullsized":"2023-10-08T07:01:09.879366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804726+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:09.804726+0000","last_peered":"2023-10-08T07:01:09.804726+0000","last_clean":"2023-10-08T07:01:09.804726+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:09.804726+0000","last_undegraded":"2023-10-08T07:01:09.804726+0000","last_fullsized":"2023-10-08T07:01:09.804726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:54.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876664+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:09.876664+0000","last_peered":"2023-10-08T07:01:09.876664+0000","last_clean":"2023-10-08T07:01:09.876664+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:09.876664+0000","last_undegraded":"2023-10-08T07:01:09.876664+0000","last_fullsized":"2023-10-08T07:01:09.876664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876537+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:09.876537+0000","last_peered":"2023-10-08T07:01:09.876537+0000","last_clean":"2023-10-08T07:01:09.876537+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:09.876537+0000","last_undegraded":"2023-10-08T07:01:09.876537+0000","last_fullsized":"2023-10-08T07:01:09.876537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876642+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:09.876642+0000","last_peered":"2023-10-08T07:01:09.876642+0000","last_clean":"2023-10-08T07:01:09.876642+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:09.876642+0000","last_undegraded":"2023-10-08T07:01:09.876642+0000","last_fullsized":"2023-10-08T07:01:09.876642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:49.423040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886847+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:09.886847+0000","last_peered":"2023-10-08T07:01:09.886847+0000","last_clean":"2023-10-08T07:01:09.886847+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:09.886847+0000","last_undegraded":"2023-10-08T07:01:09.886847+0000","last_fullsized":"2023-10-08T07:01:09.886847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:53.793279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804844+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:09.804844+0000","last_peered":"2023-10-08T07:01:09.804844+0000","last_clean":"2023-10-08T07:01:09.804844+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:09.804844+0000","last_undegraded":"2023-10-08T07:01:09.804844+0000","last_fullsized":"2023-10-08T07:01:09.804844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:09.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886829+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:09.886829+0000","last_peered":"2023-10-08T07:01:09.886829+0000","last_clean":"2023-10-08T07:01:09.886829+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:09.886829+0000","last_undegraded":"2023-10-08T07:01:09.886829+0000","last_fullsized":"2023-10-08T07:01:09.886829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878197+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:09.878197+0000","last_peered":"2023-10-08T07:01:09.878197+0000","last_clean":"2023-10-08T07:01:09.878197+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:09.878197+0000","last_undegraded":"2023-10-08T07:01:09.878197+0000","last_fullsized":"2023-10-08T07:01:09.878197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805734+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:09.805734+0000","last_peered":"2023-10-08T07:01:09.805734+0000","last_clean":"2023-10-08T07:01:09.805734+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:09.805734+0000","last_undegraded":"2023-10-08T07:01:09.805734+0000","last_fullsized":"2023-10-08T07:01:09.805734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:48:19.319694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876264+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:09.876264+0000","last_peered":"2023-10-08T07:01:09.876264+0000","last_clean":"2023-10-08T07:01:09.876264+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:09.876264+0000","last_undegraded":"2023-10-08T07:01:09.876264+0000","last_fullsized":"2023-10-08T07:01:09.876264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805857+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:09.805857+0000","last_peered":"2023-10-08T07:01:09.805857+0000","last_clean":"2023-10-08T07:01:09.805857+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:09.805857+0000","last_undegraded":"2023-10-08T07:01:09.805857+0000","last_fullsized":"2023-10-08T07:01:09.805857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:38.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876985+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:09.876985+0000","last_peered":"2023-10-08T07:01:09.876985+0000","last_clean":"2023-10-08T07:01:09.876985+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:09.876985+0000","last_undegraded":"2023-10-08T07:01:09.876985+0000","last_fullsized":"2023-10-08T07:01:09.876985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877688+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:09.877688+0000","last_peered":"2023-10-08T07:01:09.877688+0000","last_clean":"2023-10-08T07:01:09.877688+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:09.877688+0000","last_undegraded":"2023-10-08T07:01:09.877688+0000","last_fullsized":"2023-10-08T07:01:09.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879744+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:09.879744+0000","last_peered":"2023-10-08T07:01:09.879744+0000","last_clean":"2023-10-08T07:01:09.879744+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:09.879744+0000","last_undegraded":"2023-10-08T07:01:09.879744+0000","last_fullsized":"2023-10-08T07:01:09.879744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878510+0000","last_change":"2023-10-08T07:00:58.742366+0000","last_active":"2023-10-08T07:01:09.878510+0000","last_peered":"2023-10-08T07:01:09.878510+0000","last_clean":"2023-10-08T07:01:09.878510+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:09.878510+0000","last_undegraded":"2023-10-08T07:01:09.878510+0000","last_fullsized":"2023-10-08T07:01:09.878510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.443197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876833+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:09.876833+0000","last_peered":"2023-10-08T07:01:09.876833+0000","last_clean":"2023-10-08T07:01:09.876833+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:09.876833+0000","last_undegraded":"2023-10-08T07:01:09.876833+0000","last_fullsized":"2023-10-08T07:01:09.876833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876500+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:09.876500+0000","last_peered":"2023-10-08T07:01:09.876500+0000","last_clean":"2023-10-08T07:01:09.876500+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:09.876500+0000","last_undegraded":"2023-10-08T07:01:09.876500+0000","last_fullsized":"2023-10-08T07:01:09.876500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:41.315551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876366+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:09.876366+0000","last_peered":"2023-10-08T07:01:09.876366+0000","last_clean":"2023-10-08T07:01:09.876366+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:09.876366+0000","last_undegraded":"2023-10-08T07:01:09.876366+0000","last_fullsized":"2023-10-08T07:01:09.876366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:52.787608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805457+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:09.805457+0000","last_peered":"2023-10-08T07:01:09.805457+0000","last_clean":"2023-10-08T07:01:09.805457+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:09.805457+0000","last_undegraded":"2023-10-08T07:01:09.805457+0000","last_fullsized":"2023-10-08T07:01:09.805457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:46.069356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805138+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:09.805138+0000","last_peered":"2023-10-08T07:01:09.805138+0000","last_clean":"2023-10-08T07:01:09.805138+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:09.805138+0000","last_undegraded":"2023-10-08T07:01:09.805138+0000","last_fullsized":"2023-10-08T07:01:09.805138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:30.717351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876373+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:09.876373+0000","last_peered":"2023-10-08T07:01:09.876373+0000","last_clean":"2023-10-08T07:01:09.876373+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:09.876373+0000","last_undegraded":"2023-10-08T07:01:09.876373+0000","last_fullsized":"2023-10-08T07:01:09.876373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875889+0000","last_change":"2023-10-08T07:00:58.741881+0000","last_active":"2023-10-08T07:01:09.875889+0000","last_peered":"2023-10-08T07:01:09.875889+0000","last_clean":"2023-10-08T07:01:09.875889+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:09.875889+0000","last_undegraded":"2023-10-08T07:01:09.875889+0000","last_fullsized":"2023-10-08T07:01:09.875889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:42.957083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877011+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:09.877011+0000","last_peered":"2023-10-08T07:01:09.877011+0000","last_clean":"2023-10-08T07:01:09.877011+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:09.877011+0000","last_undegraded":"2023-10-08T07:01:09.877011+0000","last_fullsized":"2023-10-08T07:01:09.877011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886762+0000","last_change":"2023-10-08T07:01:09.881913+0000","last_active":"2023-10-08T07:01:09.886762+0000","last_peered":"2023-10-08T07:01:09.886762+0000","last_clean":"2023-10-08T07:01:09.886762+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:09.886762+0000","last_undegraded":"2023-10-08T07:01:09.886762+0000","last_fullsized":"2023-10-08T07:01:09.886762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:43.187153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876894+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:09.876894+0000","last_peered":"2023-10-08T07:01:09.876894+0000","last_clean":"2023-10-08T07:01:09.876894+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:09.876894+0000","last_undegraded":"2023-10-08T07:01:09.876894+0000","last_fullsized":"2023-10-08T07:01:09.876894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878020+0000","last_change":"2023-10-08T07:00:58.757070+0000","last_active":"2023-10-08T07:01:09.878020+0000","last_peered":"2023-10-08T07:01:09.878020+0000","last_clean":"2023-10-08T07:01:09.878020+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:09.878020+0000","last_undegraded":"2023-10-08T07:01:09.878020+0000","last_fullsized":"2023-10-08T07:01:09.878020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:54.400652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805649+0000","last_change":"2023-10-08T07:00:58.690359+0000","last_active":"2023-10-08T07:01:09.805649+0000","last_peered":"2023-10-08T07:01:09.805649+0000","last_clean":"2023-10-08T07:01:09.805649+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:09.805649+0000","last_undegraded":"2023-10-08T07:01:09.805649+0000","last_fullsized":"2023-10-08T07:01:09.805649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:24.632619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805631+0000","last_change":"2023-10-08T07:00:58.689104+0000","last_active":"2023-10-08T07:01:09.805631+0000","last_peered":"2023-10-08T07:01:09.805631+0000","last_clean":"2023-10-08T07:01:09.805631+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:09.805631+0000","last_undegraded":"2023-10-08T07:01:09.805631+0000","last_fullsized":"2023-10-08T07:01:09.805631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:19.488445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876918+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:09.876918+0000","last_peered":"2023-10-08T07:01:09.876918+0000","last_clean":"2023-10-08T07:01:09.876918+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:09.876918+0000","last_undegraded":"2023-10-08T07:01:09.876918+0000","last_fullsized":"2023-10-08T07:01:09.876918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879374+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:09.879374+0000","last_peered":"2023-10-08T07:01:09.879374+0000","last_clean":"2023-10-08T07:01:09.879374+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:09.879374+0000","last_undegraded":"2023-10-08T07:01:09.879374+0000","last_fullsized":"2023-10-08T07:01:09.879374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876563+0000","last_change":"2023-10-08T07:00:58.741459+0000","last_active":"2023-10-08T07:01:09.876563+0000","last_peered":"2023-10-08T07:01:09.876563+0000","last_clean":"2023-10-08T07:01:09.876563+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:09.876563+0000","last_undegraded":"2023-10-08T07:01:09.876563+0000","last_fullsized":"2023-10-08T07:01:09.876563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:38.166894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876349+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:09.876349+0000","last_peered":"2023-10-08T07:01:09.876349+0000","last_clean":"2023-10-08T07:01:09.876349+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:09.876349+0000","last_undegraded":"2023-10-08T07:01:09.876349+0000","last_fullsized":"2023-10-08T07:01:09.876349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:42.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805368+0000","last_change":"2023-10-08T07:00:58.689101+0000","last_active":"2023-10-08T07:01:09.805368+0000","last_peered":"2023-10-08T07:01:09.805368+0000","last_clean":"2023-10-08T07:01:09.805368+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:09.805368+0000","last_undegraded":"2023-10-08T07:01:09.805368+0000","last_fullsized":"2023-10-08T07:01:09.805368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:57.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804920+0000","last_change":"2023-10-08T07:00:58.686855+0000","last_active":"2023-10-08T07:01:09.804920+0000","last_peered":"2023-10-08T07:01:09.804920+0000","last_clean":"2023-10-08T07:01:09.804920+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:09.804920+0000","last_undegraded":"2023-10-08T07:01:09.804920+0000","last_fullsized":"2023-10-08T07:01:09.804920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:30.932703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.883950+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:09.883950+0000","last_peered":"2023-10-08T07:01:09.883950+0000","last_clean":"2023-10-08T07:01:09.883950+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:09.883950+0000","last_undegraded":"2023-10-08T07:01:09.883950+0000","last_fullsized":"2023-10-08T07:01:09.883950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:05.703724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805796+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:09.805796+0000","last_peered":"2023-10-08T07:01:09.805796+0000","last_clean":"2023-10-08T07:01:09.805796+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:09.805796+0000","last_undegraded":"2023-10-08T07:01:09.805796+0000","last_fullsized":"2023-10-08T07:01:09.805796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:44.156143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876428+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:09.876428+0000","last_peered":"2023-10-08T07:01:09.876428+0000","last_clean":"2023-10-08T07:01:09.876428+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:09.876428+0000","last_undegraded":"2023-10-08T07:01:09.876428+0000","last_fullsized":"2023-10-08T07:01:09.876428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:23.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876001+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:09.876001+0000","last_peered":"2023-10-08T07:01:09.876001+0000","last_clean":"2023-10-08T07:01:09.876001+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:09.876001+0000","last_undegraded":"2023-10-08T07:01:09.876001+0000","last_fullsized":"2023-10-08T07:01:09.876001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805034+0000","last_change":"2023-10-08T07:00:58.687270+0000","last_active":"2023-10-08T07:01:09.805034+0000","last_peered":"2023-10-08T07:01:09.805034+0000","last_clean":"2023-10-08T07:01:09.805034+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:09.805034+0000","last_undegraded":"2023-10-08T07:01:09.805034+0000","last_fullsized":"2023-10-08T07:01:09.805034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:05.762019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877017+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:09.877017+0000","last_peered":"2023-10-08T07:01:09.877017+0000","last_clean":"2023-10-08T07:01:09.877017+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:09.877017+0000","last_undegraded":"2023-10-08T07:01:09.877017+0000","last_fullsized":"2023-10-08T07:01:09.877017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782468+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:11.782468+0000","last_peered":"2023-10-08T07:01:11.782468+0000","last_clean":"2023-10-08T07:01:11.782468+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:11.782468+0000","last_undegraded":"2023-10-08T07:01:11.782468+0000","last_fullsized":"2023-10-08T07:01:11.782468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804656+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:09.804656+0000","last_peered":"2023-10-08T07:01:09.804656+0000","last_clean":"2023-10-08T07:01:09.804656+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:09.804656+0000","last_undegraded":"2023-10-08T07:01:09.804656+0000","last_fullsized":"2023-10-08T07:01:09.804656+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:30.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886744+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:09.886744+0000","last_peered":"2023-10-08T07:01:09.886744+0000","last_clean":"2023-10-08T07:01:09.886744+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:09.886744+0000","last_undegraded":"2023-10-08T07:01:09.886744+0000","last_fullsized":"2023-10-08T07:01:09.886744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:29.167059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889407+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:09.889407+0000","last_peered":"2023-10-08T07:01:09.889407+0000","last_clean":"2023-10-08T07:01:09.889407+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889407+0000","last_undegraded":"2023-10-08T07:01:09.889407+0000","last_fullsized":"2023-10-08T07:01:09.889407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:37.936824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805266+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:09.805266+0000","last_peered":"2023-10-08T07:01:09.805266+0000","last_clean":"2023-10-08T07:01:09.805266+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:09.805266+0000","last_undegraded":"2023-10-08T07:01:09.805266+0000","last_fullsized":"2023-10-08T07:01:09.805266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:32.928459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878330+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:09.878330+0000","last_peered":"2023-10-08T07:01:09.878330+0000","last_clean":"2023-10-08T07:01:09.878330+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:09.878330+0000","last_undegraded":"2023-10-08T07:01:09.878330+0000","last_fullsized":"2023-10-08T07:01:09.878330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805556+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:09.805556+0000","last_peered":"2023-10-08T07:01:09.805556+0000","last_clean":"2023-10-08T07:01:09.805556+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:09.805556+0000","last_undegraded":"2023-10-08T07:01:09.805556+0000","last_fullsized":"2023-10-08T07:01:09.805556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:30.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805342+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:09.805342+0000","last_peered":"2023-10-08T07:01:09.805342+0000","last_clean":"2023-10-08T07:01:09.805342+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:09.805342+0000","last_undegraded":"2023-10-08T07:01:09.805342+0000","last_fullsized":"2023-10-08T07:01:09.805342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:03.680449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804573+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:09.804573+0000","last_peered":"2023-10-08T07:01:09.804573+0000","last_clean":"2023-10-08T07:01:09.804573+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:09.804573+0000","last_undegraded":"2023-10-08T07:01:09.804573+0000","last_fullsized":"2023-10-08T07:01:09.804573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:55.749420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877044+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:09.877044+0000","last_peered":"2023-10-08T07:01:09.877044+0000","last_clean":"2023-10-08T07:01:09.877044+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:09.877044+0000","last_undegraded":"2023-10-08T07:01:09.877044+0000","last_fullsized":"2023-10-08T07:01:09.877044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805626+0000","last_change":"2023-10-08T07:00:58.672669+0000","last_active":"2023-10-08T07:01:09.805626+0000","last_peered":"2023-10-08T07:01:09.805626+0000","last_clean":"2023-10-08T07:01:09.805626+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:09.805626+0000","last_undegraded":"2023-10-08T07:01:09.805626+0000","last_fullsized":"2023-10-08T07:01:09.805626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:24.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879021+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:09.879021+0000","last_peered":"2023-10-08T07:01:09.879021+0000","last_clean":"2023-10-08T07:01:09.879021+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:09.879021+0000","last_undegraded":"2023-10-08T07:01:09.879021+0000","last_fullsized":"2023-10-08T07:01:09.879021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878395+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:09.878395+0000","last_peered":"2023-10-08T07:01:09.878395+0000","last_clean":"2023-10-08T07:01:09.878395+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:09.878395+0000","last_undegraded":"2023-10-08T07:01:09.878395+0000","last_fullsized":"2023-10-08T07:01:09.878395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879534+0000","last_change":"2023-10-08T07:00:58.756916+0000","last_active":"2023-10-08T07:01:09.879534+0000","last_peered":"2023-10-08T07:01:09.879534+0000","last_clean":"2023-10-08T07:01:09.879534+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:09.879534+0000","last_undegraded":"2023-10-08T07:01:09.879534+0000","last_fullsized":"2023-10-08T07:01:09.879534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:45.871560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876541+0000","last_change":"2023-10-08T07:00:58.741378+0000","last_active":"2023-10-08T07:01:09.876541+0000","last_peered":"2023-10-08T07:01:09.876541+0000","last_clean":"2023-10-08T07:01:09.876541+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:09.876541+0000","last_undegraded":"2023-10-08T07:01:09.876541+0000","last_fullsized":"2023-10-08T07:01:09.876541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:34.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876257+0000","last_change":"2023-10-08T07:00:58.743707+0000","last_active":"2023-10-08T07:01:09.876257+0000","last_peered":"2023-10-08T07:01:09.876257+0000","last_clean":"2023-10-08T07:01:09.876257+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:09.876257+0000","last_undegraded":"2023-10-08T07:01:09.876257+0000","last_fullsized":"2023-10-08T07:01:09.876257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:10:58.417067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879563+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:09.879563+0000","last_peered":"2023-10-08T07:01:09.879563+0000","last_clean":"2023-10-08T07:01:09.879563+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:09.879563+0000","last_undegraded":"2023-10-08T07:01:09.879563+0000","last_fullsized":"2023-10-08T07:01:09.879563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876387+0000","last_change":"2023-10-08T07:00:58.743219+0000","last_active":"2023-10-08T07:01:09.876387+0000","last_peered":"2023-10-08T07:01:09.876387+0000","last_clean":"2023-10-08T07:01:09.876387+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:09.876387+0000","last_undegraded":"2023-10-08T07:01:09.876387+0000","last_fullsized":"2023-10-08T07:01:09.876387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:11.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805505+0000","last_change":"2023-10-08T07:00:58.689299+0000","last_active":"2023-10-08T07:01:09.805505+0000","last_peered":"2023-10-08T07:01:09.805505+0000","last_clean":"2023-10-08T07:01:09.805505+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:09.805505+0000","last_undegraded":"2023-10-08T07:01:09.805505+0000","last_fullsized":"2023-10-08T07:01:09.805505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:03.194361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878607+0000","last_change":"2023-10-08T07:00:58.742191+0000","last_active":"2023-10-08T07:01:09.878607+0000","last_peered":"2023-10-08T07:01:09.878607+0000","last_clean":"2023-10-08T07:01:09.878607+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:09.878607+0000","last_undegraded":"2023-10-08T07:01:09.878607+0000","last_fullsized":"2023-10-08T07:01:09.878607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.860327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805580+0000","last_change":"2023-10-08T07:00:58.672323+0000","last_active":"2023-10-08T07:01:09.805580+0000","last_peered":"2023-10-08T07:01:09.805580+0000","last_clean":"2023-10-08T07:01:09.805580+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:09.805580+0000","last_undegraded":"2023-10-08T07:01:09.805580+0000","last_fullsized":"2023-10-08T07:01:09.805580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:46.142346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876259+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:09.876259+0000","last_peered":"2023-10-08T07:01:09.876259+0000","last_clean":"2023-10-08T07:01:09.876259+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:09.876259+0000","last_undegraded":"2023-10-08T07:01:09.876259+0000","last_fullsized":"2023-10-08T07:01:09.876259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:27.988825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876116+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:09.876116+0000","last_peered":"2023-10-08T07:01:09.876116+0000","last_clean":"2023-10-08T07:01:09.876116+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:09.876116+0000","last_undegraded":"2023-10-08T07:01:09.876116+0000","last_fullsized":"2023-10-08T07:01:09.876116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:32.031015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805004+0000","last_change":"2023-10-08T07:00:58.687458+0000","last_active":"2023-10-08T07:01:09.805004+0000","last_peered":"2023-10-08T07:01:09.805004+0000","last_clean":"2023-10-08T07:01:09.805004+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:09.805004+0000","last_undegraded":"2023-10-08T07:01:09.805004+0000","last_fullsized":"2023-10-08T07:01:09.805004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:25:42.651522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886785+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:09.886785+0000","last_peered":"2023-10-08T07:01:09.886785+0000","last_clean":"2023-10-08T07:01:09.886785+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:09.886785+0000","last_undegraded":"2023-10-08T07:01:09.886785+0000","last_fullsized":"2023-10-08T07:01:09.886785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:35.339502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805622+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:09.805622+0000","last_peered":"2023-10-08T07:01:09.805622+0000","last_clean":"2023-10-08T07:01:09.805622+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:09.805622+0000","last_undegraded":"2023-10-08T07:01:09.805622+0000","last_fullsized":"2023-10-08T07:01:09.805622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:53.864366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879648+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:09.879648+0000","last_peered":"2023-10-08T07:01:09.879648+0000","last_clean":"2023-10-08T07:01:09.879648+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:09.879648+0000","last_undegraded":"2023-10-08T07:01:09.879648+0000","last_fullsized":"2023-10-08T07:01:09.879648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612613,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47200,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324640,"statfs":{"total":96636764160,"available":96588431360,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325040,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046800,"statfs":{"total":96636764160,"available":96303923200,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54200000000000004,"5min":1.998,"15min":1.998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.443}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306988,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064852,"statfs":{"total":96636764160,"available":96322408448,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:01:16.918 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T07:01:16.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:01:17.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:17.292 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:01:17.302 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2023-10-08T07:01:17.008302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679228,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436292,"statfs":{"total":289910292480,"available":289214763008,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002022"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889369+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:09.889369+0000","last_peered":"2023-10-08T07:01:09.889369+0000","last_clean":"2023-10-08T07:01:09.889369+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:09.889369+0000","last_undegraded":"2023-10-08T07:01:09.889369+0000","last_fullsized":"2023-10-08T07:01:09.889369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879623+0000","last_change":"2023-10-08T07:00:58.757022+0000","last_active":"2023-10-08T07:01:09.879623+0000","last_peered":"2023-10-08T07:01:09.879623+0000","last_clean":"2023-10-08T07:01:09.879623+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:09.879623+0000","last_undegraded":"2023-10-08T07:01:09.879623+0000","last_fullsized":"2023-10-08T07:01:09.879623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:57.715272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876818+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:09.876818+0000","last_peered":"2023-10-08T07:01:09.876818+0000","last_clean":"2023-10-08T07:01:09.876818+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:09.876818+0000","last_undegraded":"2023-10-08T07:01:09.876818+0000","last_fullsized":"2023-10-08T07:01:09.876818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876767+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:09.876767+0000","last_peered":"2023-10-08T07:01:09.876767+0000","last_clean":"2023-10-08T07:01:09.876767+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:09.876767+0000","last_undegraded":"2023-10-08T07:01:09.876767+0000","last_fullsized":"2023-10-08T07:01:09.876767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:08.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886836+0000","last_change":"2023-10-08T07:01:09.882134+0000","last_active":"2023-10-08T07:01:09.886836+0000","last_peered":"2023-10-08T07:01:09.886836+0000","last_clean":"2023-10-08T07:01:09.886836+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:09.886836+0000","last_undegraded":"2023-10-08T07:01:09.886836+0000","last_fullsized":"2023-10-08T07:01:09.886836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876241+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:09.876241+0000","last_peered":"2023-10-08T07:01:09.876241+0000","last_clean":"2023-10-08T07:01:09.876241+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:09.876241+0000","last_undegraded":"2023-10-08T07:01:09.876241+0000","last_fullsized":"2023-10-08T07:01:09.876241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.341032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875903+0000","last_change":"2023-10-08T07:00:58.741788+0000","last_active":"2023-10-08T07:01:09.875903+0000","last_peered":"2023-10-08T07:01:09.875903+0000","last_clean":"2023-10-08T07:01:09.875903+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:09.875903+0000","last_undegraded":"2023-10-08T07:01:09.875903+0000","last_fullsized":"2023-10-08T07:01:09.875903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875853+0000","last_change":"2023-10-08T07:00:58.743309+0000","last_active":"2023-10-08T07:01:09.875853+0000","last_peered":"2023-10-08T07:01:09.875853+0000","last_clean":"2023-10-08T07:01:09.875853+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:09.875853+0000","last_undegraded":"2023-10-08T07:01:09.875853+0000","last_fullsized":"2023-10-08T07:01:09.875853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805710+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:09.805710+0000","last_peered":"2023-10-08T07:01:09.805710+0000","last_clean":"2023-10-08T07:01:09.805710+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:09.805710+0000","last_undegraded":"2023-10-08T07:01:09.805710+0000","last_fullsized":"2023-10-08T07:01:09.805710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:14.193056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879851+0000","last_change":"2023-10-08T07:00:58.757350+0000","last_active":"2023-10-08T07:01:09.879851+0000","last_peered":"2023-10-08T07:01:09.879851+0000","last_clean":"2023-10-08T07:01:09.879851+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:09.879851+0000","last_undegraded":"2023-10-08T07:01:09.879851+0000","last_fullsized":"2023-10-08T07:01:09.879851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:38.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876686+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:09.876686+0000","last_peered":"2023-10-08T07:01:09.876686+0000","last_clean":"2023-10-08T07:01:09.876686+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:09.876686+0000","last_undegraded":"2023-10-08T07:01:09.876686+0000","last_fullsized":"2023-10-08T07:01:09.876686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:11.748373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886800+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:09.886800+0000","last_peered":"2023-10-08T07:01:09.886800+0000","last_clean":"2023-10-08T07:01:09.886800+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:09.886800+0000","last_undegraded":"2023-10-08T07:01:09.886800+0000","last_fullsized":"2023-10-08T07:01:09.886800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:50.428711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.884162+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:09.884162+0000","last_peered":"2023-10-08T07:01:09.884162+0000","last_clean":"2023-10-08T07:01:09.884162+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:09.884162+0000","last_undegraded":"2023-10-08T07:01:09.884162+0000","last_fullsized":"2023-10-08T07:01:09.884162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876609+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:09.876609+0000","last_peered":"2023-10-08T07:01:09.876609+0000","last_clean":"2023-10-08T07:01:09.876609+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:09.876609+0000","last_undegraded":"2023-10-08T07:01:09.876609+0000","last_fullsized":"2023-10-08T07:01:09.876609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876291+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:09.876291+0000","last_peered":"2023-10-08T07:01:09.876291+0000","last_clean":"2023-10-08T07:01:09.876291+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:09.876291+0000","last_undegraded":"2023-10-08T07:01:09.876291+0000","last_fullsized":"2023-10-08T07:01:09.876291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875872+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:09.875872+0000","last_peered":"2023-10-08T07:01:09.875872+0000","last_clean":"2023-10-08T07:01:09.875872+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:09.875872+0000","last_undegraded":"2023-10-08T07:01:09.875872+0000","last_fullsized":"2023-10-08T07:01:09.875872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805445+0000","last_change":"2023-10-08T07:00:58.689994+0000","last_active":"2023-10-08T07:01:09.805445+0000","last_peered":"2023-10-08T07:01:09.805445+0000","last_clean":"2023-10-08T07:01:09.805445+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:09.805445+0000","last_undegraded":"2023-10-08T07:01:09.805445+0000","last_fullsized":"2023-10-08T07:01:09.805445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:38.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879888+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:09.879888+0000","last_peered":"2023-10-08T07:01:09.879888+0000","last_clean":"2023-10-08T07:01:09.879888+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:09.879888+0000","last_undegraded":"2023-10-08T07:01:09.879888+0000","last_fullsized":"2023-10-08T07:01:09.879888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:20.556448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805312+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:09.805312+0000","last_peered":"2023-10-08T07:01:09.805312+0000","last_clean":"2023-10-08T07:01:09.805312+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:09.805312+0000","last_undegraded":"2023-10-08T07:01:09.805312+0000","last_fullsized":"2023-10-08T07:01:09.805312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:57:56.486710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876667+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:09.876667+0000","last_peered":"2023-10-08T07:01:09.876667+0000","last_clean":"2023-10-08T07:01:09.876667+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:09.876667+0000","last_undegraded":"2023-10-08T07:01:09.876667+0000","last_fullsized":"2023-10-08T07:01:09.876667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:21.278271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876239+0000","last_change":"2023-10-08T07:00:58.743568+0000","last_active":"2023-10-08T07:01:09.876239+0000","last_peered":"2023-10-08T07:01:09.876239+0000","last_clean":"2023-10-08T07:01:09.876239+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:09.876239+0000","last_undegraded":"2023-10-08T07:01:09.876239+0000","last_fullsized":"2023-10-08T07:01:09.876239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:22.726402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886866+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:09.886866+0000","last_peered":"2023-10-08T07:01:09.886866+0000","last_clean":"2023-10-08T07:01:09.886866+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:09.886866+0000","last_undegraded":"2023-10-08T07:01:09.886866+0000","last_fullsized":"2023-10-08T07:01:09.886866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:30.912592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804896+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:09.804896+0000","last_peered":"2023-10-08T07:01:09.804896+0000","last_clean":"2023-10-08T07:01:09.804896+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:09.804896+0000","last_undegraded":"2023-10-08T07:01:09.804896+0000","last_fullsized":"2023-10-08T07:01:09.804896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:28.061195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878224+0000","last_change":"2023-10-08T07:00:58.757259+0000","last_active":"2023-10-08T07:01:09.878224+0000","last_peered":"2023-10-08T07:01:09.878224+0000","last_clean":"2023-10-08T07:01:09.878224+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:09.878224+0000","last_undegraded":"2023-10-08T07:01:09.878224+0000","last_fullsized":"2023-10-08T07:01:09.878224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:50.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880708+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:09.880708+0000","last_peered":"2023-10-08T07:01:09.880708+0000","last_clean":"2023-10-08T07:01:09.880708+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:09.880708+0000","last_undegraded":"2023-10-08T07:01:09.880708+0000","last_fullsized":"2023-10-08T07:01:09.880708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805824+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:09.805824+0000","last_peered":"2023-10-08T07:01:09.805824+0000","last_clean":"2023-10-08T07:01:09.805824+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:09.805824+0000","last_undegraded":"2023-10-08T07:01:09.805824+0000","last_fullsized":"2023-10-08T07:01:09.805824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:02:40.932995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876702+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:09.876702+0000","last_peered":"2023-10-08T07:01:09.876702+0000","last_clean":"2023-10-08T07:01:09.876702+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:09.876702+0000","last_undegraded":"2023-10-08T07:01:09.876702+0000","last_fullsized":"2023-10-08T07:01:09.876702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889382+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:09.889382+0000","last_peered":"2023-10-08T07:01:09.889382+0000","last_clean":"2023-10-08T07:01:09.889382+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889382+0000","last_undegraded":"2023-10-08T07:01:09.889382+0000","last_fullsized":"2023-10-08T07:01:09.889382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879867+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:09.879867+0000","last_peered":"2023-10-08T07:01:09.879867+0000","last_clean":"2023-10-08T07:01:09.879867+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:09.879867+0000","last_undegraded":"2023-10-08T07:01:09.879867+0000","last_fullsized":"2023-10-08T07:01:09.879867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804720+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:09.804720+0000","last_peered":"2023-10-08T07:01:09.804720+0000","last_clean":"2023-10-08T07:01:09.804720+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:09.804720+0000","last_undegraded":"2023-10-08T07:01:09.804720+0000","last_fullsized":"2023-10-08T07:01:09.804720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:18.521858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805896+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:09.805896+0000","last_peered":"2023-10-08T07:01:09.805896+0000","last_clean":"2023-10-08T07:01:09.805896+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:09.805896+0000","last_undegraded":"2023-10-08T07:01:09.805896+0000","last_fullsized":"2023-10-08T07:01:09.805896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:14:38.780240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804669+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:09.804669+0000","last_peered":"2023-10-08T07:01:09.804669+0000","last_clean":"2023-10-08T07:01:09.804669+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:09.804669+0000","last_undegraded":"2023-10-08T07:01:09.804669+0000","last_fullsized":"2023-10-08T07:01:09.804669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:42.865388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880661+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:09.880661+0000","last_peered":"2023-10-08T07:01:09.880661+0000","last_clean":"2023-10-08T07:01:09.880661+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:09.880661+0000","last_undegraded":"2023-10-08T07:01:09.880661+0000","last_fullsized":"2023-10-08T07:01:09.880661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805748+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:09.805748+0000","last_peered":"2023-10-08T07:01:09.805748+0000","last_clean":"2023-10-08T07:01:09.805748+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:09.805748+0000","last_undegraded":"2023-10-08T07:01:09.805748+0000","last_fullsized":"2023-10-08T07:01:09.805748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:05:28.271541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804563+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:09.804563+0000","last_peered":"2023-10-08T07:01:09.804563+0000","last_clean":"2023-10-08T07:01:09.804563+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:09.804563+0000","last_undegraded":"2023-10-08T07:01:09.804563+0000","last_fullsized":"2023-10-08T07:01:09.804563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:40.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876794+0000","last_change":"2023-10-08T07:00:58.742002+0000","last_active":"2023-10-08T07:01:09.876794+0000","last_peered":"2023-10-08T07:01:09.876794+0000","last_clean":"2023-10-08T07:01:09.876794+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:09.876794+0000","last_undegraded":"2023-10-08T07:01:09.876794+0000","last_fullsized":"2023-10-08T07:01:09.876794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:29.906921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805026+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:09.805026+0000","last_peered":"2023-10-08T07:01:09.805026+0000","last_clean":"2023-10-08T07:01:09.805026+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:09.805026+0000","last_undegraded":"2023-10-08T07:01:09.805026+0000","last_fullsized":"2023-10-08T07:01:09.805026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:26.532564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879366+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:09.879366+0000","last_peered":"2023-10-08T07:01:09.879366+0000","last_clean":"2023-10-08T07:01:09.879366+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:09.879366+0000","last_undegraded":"2023-10-08T07:01:09.879366+0000","last_fullsized":"2023-10-08T07:01:09.879366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804726+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:09.804726+0000","last_peered":"2023-10-08T07:01:09.804726+0000","last_clean":"2023-10-08T07:01:09.804726+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:09.804726+0000","last_undegraded":"2023-10-08T07:01:09.804726+0000","last_fullsized":"2023-10-08T07:01:09.804726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:54.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876664+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:09.876664+0000","last_peered":"2023-10-08T07:01:09.876664+0000","last_clean":"2023-10-08T07:01:09.876664+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:09.876664+0000","last_undegraded":"2023-10-08T07:01:09.876664+0000","last_fullsized":"2023-10-08T07:01:09.876664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876537+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:09.876537+0000","last_peered":"2023-10-08T07:01:09.876537+0000","last_clean":"2023-10-08T07:01:09.876537+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:09.876537+0000","last_undegraded":"2023-10-08T07:01:09.876537+0000","last_fullsized":"2023-10-08T07:01:09.876537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876642+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:09.876642+0000","last_peered":"2023-10-08T07:01:09.876642+0000","last_clean":"2023-10-08T07:01:09.876642+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:09.876642+0000","last_undegraded":"2023-10-08T07:01:09.876642+0000","last_fullsized":"2023-10-08T07:01:09.876642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:49.423040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886847+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:09.886847+0000","last_peered":"2023-10-08T07:01:09.886847+0000","last_clean":"2023-10-08T07:01:09.886847+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:09.886847+0000","last_undegraded":"2023-10-08T07:01:09.886847+0000","last_fullsized":"2023-10-08T07:01:09.886847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:53.793279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804844+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:09.804844+0000","last_peered":"2023-10-08T07:01:09.804844+0000","last_clean":"2023-10-08T07:01:09.804844+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:09.804844+0000","last_undegraded":"2023-10-08T07:01:09.804844+0000","last_fullsized":"2023-10-08T07:01:09.804844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:09.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886829+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:09.886829+0000","last_peered":"2023-10-08T07:01:09.886829+0000","last_clean":"2023-10-08T07:01:09.886829+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:09.886829+0000","last_undegraded":"2023-10-08T07:01:09.886829+0000","last_fullsized":"2023-10-08T07:01:09.886829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878197+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:09.878197+0000","last_peered":"2023-10-08T07:01:09.878197+0000","last_clean":"2023-10-08T07:01:09.878197+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:09.878197+0000","last_undegraded":"2023-10-08T07:01:09.878197+0000","last_fullsized":"2023-10-08T07:01:09.878197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805734+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:09.805734+0000","last_peered":"2023-10-08T07:01:09.805734+0000","last_clean":"2023-10-08T07:01:09.805734+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:09.805734+0000","last_undegraded":"2023-10-08T07:01:09.805734+0000","last_fullsized":"2023-10-08T07:01:09.805734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:48:19.319694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876264+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:09.876264+0000","last_peered":"2023-10-08T07:01:09.876264+0000","last_clean":"2023-10-08T07:01:09.876264+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:09.876264+0000","last_undegraded":"2023-10-08T07:01:09.876264+0000","last_fullsized":"2023-10-08T07:01:09.876264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805857+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:09.805857+0000","last_peered":"2023-10-08T07:01:09.805857+0000","last_clean":"2023-10-08T07:01:09.805857+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:09.805857+0000","last_undegraded":"2023-10-08T07:01:09.805857+0000","last_fullsized":"2023-10-08T07:01:09.805857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:38.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876985+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:09.876985+0000","last_peered":"2023-10-08T07:01:09.876985+0000","last_clean":"2023-10-08T07:01:09.876985+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:09.876985+0000","last_undegraded":"2023-10-08T07:01:09.876985+0000","last_fullsized":"2023-10-08T07:01:09.876985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877688+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:09.877688+0000","last_peered":"2023-10-08T07:01:09.877688+0000","last_clean":"2023-10-08T07:01:09.877688+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:09.877688+0000","last_undegraded":"2023-10-08T07:01:09.877688+0000","last_fullsized":"2023-10-08T07:01:09.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879744+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:09.879744+0000","last_peered":"2023-10-08T07:01:09.879744+0000","last_clean":"2023-10-08T07:01:09.879744+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:09.879744+0000","last_undegraded":"2023-10-08T07:01:09.879744+0000","last_fullsized":"2023-10-08T07:01:09.879744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878510+0000","last_change":"2023-10-08T07:00:58.742366+0000","last_active":"2023-10-08T07:01:09.878510+0000","last_peered":"2023-10-08T07:01:09.878510+0000","last_clean":"2023-10-08T07:01:09.878510+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:09.878510+0000","last_undegraded":"2023-10-08T07:01:09.878510+0000","last_fullsized":"2023-10-08T07:01:09.878510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.443197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876833+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:09.876833+0000","last_peered":"2023-10-08T07:01:09.876833+0000","last_clean":"2023-10-08T07:01:09.876833+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:09.876833+0000","last_undegraded":"2023-10-08T07:01:09.876833+0000","last_fullsized":"2023-10-08T07:01:09.876833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876500+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:09.876500+0000","last_peered":"2023-10-08T07:01:09.876500+0000","last_clean":"2023-10-08T07:01:09.876500+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:09.876500+0000","last_undegraded":"2023-10-08T07:01:09.876500+0000","last_fullsized":"2023-10-08T07:01:09.876500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:41.315551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876366+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:09.876366+0000","last_peered":"2023-10-08T07:01:09.876366+0000","last_clean":"2023-10-08T07:01:09.876366+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:09.876366+0000","last_undegraded":"2023-10-08T07:01:09.876366+0000","last_fullsized":"2023-10-08T07:01:09.876366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:52.787608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805457+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:09.805457+0000","last_peered":"2023-10-08T07:01:09.805457+0000","last_clean":"2023-10-08T07:01:09.805457+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:09.805457+0000","last_undegraded":"2023-10-08T07:01:09.805457+0000","last_fullsized":"2023-10-08T07:01:09.805457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:46.069356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805138+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:09.805138+0000","last_peered":"2023-10-08T07:01:09.805138+0000","last_clean":"2023-10-08T07:01:09.805138+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:09.805138+0000","last_undegraded":"2023-10-08T07:01:09.805138+0000","last_fullsized":"2023-10-08T07:01:09.805138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:30.717351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876373+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:09.876373+0000","last_peered":"2023-10-08T07:01:09.876373+0000","last_clean":"2023-10-08T07:01:09.876373+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:09.876373+0000","last_undegraded":"2023-10-08T07:01:09.876373+0000","last_fullsized":"2023-10-08T07:01:09.876373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875889+0000","last_change":"2023-10-08T07:00:58.741881+0000","last_active":"2023-10-08T07:01:09.875889+0000","last_peered":"2023-10-08T07:01:09.875889+0000","last_clean":"2023-10-08T07:01:09.875889+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:09.875889+0000","last_undegraded":"2023-10-08T07:01:09.875889+0000","last_fullsized":"2023-10-08T07:01:09.875889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:42.957083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877011+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:09.877011+0000","last_peered":"2023-10-08T07:01:09.877011+0000","last_clean":"2023-10-08T07:01:09.877011+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:09.877011+0000","last_undegraded":"2023-10-08T07:01:09.877011+0000","last_fullsized":"2023-10-08T07:01:09.877011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886762+0000","last_change":"2023-10-08T07:01:09.881913+0000","last_active":"2023-10-08T07:01:09.886762+0000","last_peered":"2023-10-08T07:01:09.886762+0000","last_clean":"2023-10-08T07:01:09.886762+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:09.886762+0000","last_undegraded":"2023-10-08T07:01:09.886762+0000","last_fullsized":"2023-10-08T07:01:09.886762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:43.187153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876894+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:09.876894+0000","last_peered":"2023-10-08T07:01:09.876894+0000","last_clean":"2023-10-08T07:01:09.876894+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:09.876894+0000","last_undegraded":"2023-10-08T07:01:09.876894+0000","last_fullsized":"2023-10-08T07:01:09.876894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878020+0000","last_change":"2023-10-08T07:00:58.757070+0000","last_active":"2023-10-08T07:01:09.878020+0000","last_peered":"2023-10-08T07:01:09.878020+0000","last_clean":"2023-10-08T07:01:09.878020+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:09.878020+0000","last_undegraded":"2023-10-08T07:01:09.878020+0000","last_fullsized":"2023-10-08T07:01:09.878020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:54.400652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805649+0000","last_change":"2023-10-08T07:00:58.690359+0000","last_active":"2023-10-08T07:01:09.805649+0000","last_peered":"2023-10-08T07:01:09.805649+0000","last_clean":"2023-10-08T07:01:09.805649+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:09.805649+0000","last_undegraded":"2023-10-08T07:01:09.805649+0000","last_fullsized":"2023-10-08T07:01:09.805649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:24.632619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805631+0000","last_change":"2023-10-08T07:00:58.689104+0000","last_active":"2023-10-08T07:01:09.805631+0000","last_peered":"2023-10-08T07:01:09.805631+0000","last_clean":"2023-10-08T07:01:09.805631+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:09.805631+0000","last_undegraded":"2023-10-08T07:01:09.805631+0000","last_fullsized":"2023-10-08T07:01:09.805631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:19.488445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876918+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:09.876918+0000","last_peered":"2023-10-08T07:01:09.876918+0000","last_clean":"2023-10-08T07:01:09.876918+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:09.876918+0000","last_undegraded":"2023-10-08T07:01:09.876918+0000","last_fullsized":"2023-10-08T07:01:09.876918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879374+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:09.879374+0000","last_peered":"2023-10-08T07:01:09.879374+0000","last_clean":"2023-10-08T07:01:09.879374+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:09.879374+0000","last_undegraded":"2023-10-08T07:01:09.879374+0000","last_fullsized":"2023-10-08T07:01:09.879374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876563+0000","last_change":"2023-10-08T07:00:58.741459+0000","last_active":"2023-10-08T07:01:09.876563+0000","last_peered":"2023-10-08T07:01:09.876563+0000","last_clean":"2023-10-08T07:01:09.876563+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:09.876563+0000","last_undegraded":"2023-10-08T07:01:09.876563+0000","last_fullsized":"2023-10-08T07:01:09.876563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:38.166894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876349+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:09.876349+0000","last_peered":"2023-10-08T07:01:09.876349+0000","last_clean":"2023-10-08T07:01:09.876349+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:09.876349+0000","last_undegraded":"2023-10-08T07:01:09.876349+0000","last_fullsized":"2023-10-08T07:01:09.876349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:42.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805368+0000","last_change":"2023-10-08T07:00:58.689101+0000","last_active":"2023-10-08T07:01:09.805368+0000","last_peered":"2023-10-08T07:01:09.805368+0000","last_clean":"2023-10-08T07:01:09.805368+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:09.805368+0000","last_undegraded":"2023-10-08T07:01:09.805368+0000","last_fullsized":"2023-10-08T07:01:09.805368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:57.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804920+0000","last_change":"2023-10-08T07:00:58.686855+0000","last_active":"2023-10-08T07:01:09.804920+0000","last_peered":"2023-10-08T07:01:09.804920+0000","last_clean":"2023-10-08T07:01:09.804920+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:09.804920+0000","last_undegraded":"2023-10-08T07:01:09.804920+0000","last_fullsized":"2023-10-08T07:01:09.804920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:30.932703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.883950+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:09.883950+0000","last_peered":"2023-10-08T07:01:09.883950+0000","last_clean":"2023-10-08T07:01:09.883950+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:09.883950+0000","last_undegraded":"2023-10-08T07:01:09.883950+0000","last_fullsized":"2023-10-08T07:01:09.883950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:05.703724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805796+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:09.805796+0000","last_peered":"2023-10-08T07:01:09.805796+0000","last_clean":"2023-10-08T07:01:09.805796+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:09.805796+0000","last_undegraded":"2023-10-08T07:01:09.805796+0000","last_fullsized":"2023-10-08T07:01:09.805796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:44.156143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876428+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:09.876428+0000","last_peered":"2023-10-08T07:01:09.876428+0000","last_clean":"2023-10-08T07:01:09.876428+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:09.876428+0000","last_undegraded":"2023-10-08T07:01:09.876428+0000","last_fullsized":"2023-10-08T07:01:09.876428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:23.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876001+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:09.876001+0000","last_peered":"2023-10-08T07:01:09.876001+0000","last_clean":"2023-10-08T07:01:09.876001+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:09.876001+0000","last_undegraded":"2023-10-08T07:01:09.876001+0000","last_fullsized":"2023-10-08T07:01:09.876001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805034+0000","last_change":"2023-10-08T07:00:58.687270+0000","last_active":"2023-10-08T07:01:09.805034+0000","last_peered":"2023-10-08T07:01:09.805034+0000","last_clean":"2023-10-08T07:01:09.805034+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:09.805034+0000","last_undegraded":"2023-10-08T07:01:09.805034+0000","last_fullsized":"2023-10-08T07:01:09.805034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:05.762019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877017+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:09.877017+0000","last_peered":"2023-10-08T07:01:09.877017+0000","last_clean":"2023-10-08T07:01:09.877017+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:09.877017+0000","last_undegraded":"2023-10-08T07:01:09.877017+0000","last_fullsized":"2023-10-08T07:01:09.877017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782468+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:11.782468+0000","last_peered":"2023-10-08T07:01:11.782468+0000","last_clean":"2023-10-08T07:01:11.782468+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:11.782468+0000","last_undegraded":"2023-10-08T07:01:11.782468+0000","last_fullsized":"2023-10-08T07:01:11.782468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804656+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:09.804656+0000","last_peered":"2023-10-08T07:01:09.804656+0000","last_clean":"2023-10-08T07:01:09.804656+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:09.804656+0000","last_undegraded":"2023-10-08T07:01:09.804656+0000","last_fullsized":"2023-10-08T07:01:09.804656+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:30.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886744+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:09.886744+0000","last_peered":"2023-10-08T07:01:09.886744+0000","last_clean":"2023-10-08T07:01:09.886744+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:09.886744+0000","last_undegraded":"2023-10-08T07:01:09.886744+0000","last_fullsized":"2023-10-08T07:01:09.886744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:29.167059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889407+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:09.889407+0000","last_peered":"2023-10-08T07:01:09.889407+0000","last_clean":"2023-10-08T07:01:09.889407+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889407+0000","last_undegraded":"2023-10-08T07:01:09.889407+0000","last_fullsized":"2023-10-08T07:01:09.889407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:37.936824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805266+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:09.805266+0000","last_peered":"2023-10-08T07:01:09.805266+0000","last_clean":"2023-10-08T07:01:09.805266+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:09.805266+0000","last_undegraded":"2023-10-08T07:01:09.805266+0000","last_fullsized":"2023-10-08T07:01:09.805266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:32.928459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878330+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:09.878330+0000","last_peered":"2023-10-08T07:01:09.878330+0000","last_clean":"2023-10-08T07:01:09.878330+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:09.878330+0000","last_undegraded":"2023-10-08T07:01:09.878330+0000","last_fullsized":"2023-10-08T07:01:09.878330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805556+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:09.805556+0000","last_peered":"2023-10-08T07:01:09.805556+0000","last_clean":"2023-10-08T07:01:09.805556+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:09.805556+0000","last_undegraded":"2023-10-08T07:01:09.805556+0000","last_fullsized":"2023-10-08T07:01:09.805556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:30.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805342+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:09.805342+0000","last_peered":"2023-10-08T07:01:09.805342+0000","last_clean":"2023-10-08T07:01:09.805342+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:09.805342+0000","last_undegraded":"2023-10-08T07:01:09.805342+0000","last_fullsized":"2023-10-08T07:01:09.805342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:03.680449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804573+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:09.804573+0000","last_peered":"2023-10-08T07:01:09.804573+0000","last_clean":"2023-10-08T07:01:09.804573+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:09.804573+0000","last_undegraded":"2023-10-08T07:01:09.804573+0000","last_fullsized":"2023-10-08T07:01:09.804573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:55.749420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877044+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:09.877044+0000","last_peered":"2023-10-08T07:01:09.877044+0000","last_clean":"2023-10-08T07:01:09.877044+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:09.877044+0000","last_undegraded":"2023-10-08T07:01:09.877044+0000","last_fullsized":"2023-10-08T07:01:09.877044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805626+0000","last_change":"2023-10-08T07:00:58.672669+0000","last_active":"2023-10-08T07:01:09.805626+0000","last_peered":"2023-10-08T07:01:09.805626+0000","last_clean":"2023-10-08T07:01:09.805626+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:09.805626+0000","last_undegraded":"2023-10-08T07:01:09.805626+0000","last_fullsized":"2023-10-08T07:01:09.805626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:24.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879021+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:09.879021+0000","last_peered":"2023-10-08T07:01:09.879021+0000","last_clean":"2023-10-08T07:01:09.879021+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:09.879021+0000","last_undegraded":"2023-10-08T07:01:09.879021+0000","last_fullsized":"2023-10-08T07:01:09.879021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878395+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:09.878395+0000","last_peered":"2023-10-08T07:01:09.878395+0000","last_clean":"2023-10-08T07:01:09.878395+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:09.878395+0000","last_undegraded":"2023-10-08T07:01:09.878395+0000","last_fullsized":"2023-10-08T07:01:09.878395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879534+0000","last_change":"2023-10-08T07:00:58.756916+0000","last_active":"2023-10-08T07:01:09.879534+0000","last_peered":"2023-10-08T07:01:09.879534+0000","last_clean":"2023-10-08T07:01:09.879534+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:09.879534+0000","last_undegraded":"2023-10-08T07:01:09.879534+0000","last_fullsized":"2023-10-08T07:01:09.879534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:45.871560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876541+0000","last_change":"2023-10-08T07:00:58.741378+0000","last_active":"2023-10-08T07:01:09.876541+0000","last_peered":"2023-10-08T07:01:09.876541+0000","last_clean":"2023-10-08T07:01:09.876541+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:09.876541+0000","last_undegraded":"2023-10-08T07:01:09.876541+0000","last_fullsized":"2023-10-08T07:01:09.876541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:34.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876257+0000","last_change":"2023-10-08T07:00:58.743707+0000","last_active":"2023-10-08T07:01:09.876257+0000","last_peered":"2023-10-08T07:01:09.876257+0000","last_clean":"2023-10-08T07:01:09.876257+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:09.876257+0000","last_undegraded":"2023-10-08T07:01:09.876257+0000","last_fullsized":"2023-10-08T07:01:09.876257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:10:58.417067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879563+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:09.879563+0000","last_peered":"2023-10-08T07:01:09.879563+0000","last_clean":"2023-10-08T07:01:09.879563+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:09.879563+0000","last_undegraded":"2023-10-08T07:01:09.879563+0000","last_fullsized":"2023-10-08T07:01:09.879563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876387+0000","last_change":"2023-10-08T07:00:58.743219+0000","last_active":"2023-10-08T07:01:09.876387+0000","last_peered":"2023-10-08T07:01:09.876387+0000","last_clean":"2023-10-08T07:01:09.876387+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:09.876387+0000","last_undegraded":"2023-10-08T07:01:09.876387+0000","last_fullsized":"2023-10-08T07:01:09.876387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:11.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805505+0000","last_change":"2023-10-08T07:00:58.689299+0000","last_active":"2023-10-08T07:01:09.805505+0000","last_peered":"2023-10-08T07:01:09.805505+0000","last_clean":"2023-10-08T07:01:09.805505+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:09.805505+0000","last_undegraded":"2023-10-08T07:01:09.805505+0000","last_fullsized":"2023-10-08T07:01:09.805505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:03.194361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878607+0000","last_change":"2023-10-08T07:00:58.742191+0000","last_active":"2023-10-08T07:01:09.878607+0000","last_peered":"2023-10-08T07:01:09.878607+0000","last_clean":"2023-10-08T07:01:09.878607+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:09.878607+0000","last_undegraded":"2023-10-08T07:01:09.878607+0000","last_fullsized":"2023-10-08T07:01:09.878607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.860327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805580+0000","last_change":"2023-10-08T07:00:58.672323+0000","last_active":"2023-10-08T07:01:09.805580+0000","last_peered":"2023-10-08T07:01:09.805580+0000","last_clean":"2023-10-08T07:01:09.805580+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:09.805580+0000","last_undegraded":"2023-10-08T07:01:09.805580+0000","last_fullsized":"2023-10-08T07:01:09.805580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:46.142346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876259+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:09.876259+0000","last_peered":"2023-10-08T07:01:09.876259+0000","last_clean":"2023-10-08T07:01:09.876259+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:09.876259+0000","last_undegraded":"2023-10-08T07:01:09.876259+0000","last_fullsized":"2023-10-08T07:01:09.876259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:27.988825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876116+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:09.876116+0000","last_peered":"2023-10-08T07:01:09.876116+0000","last_clean":"2023-10-08T07:01:09.876116+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:09.876116+0000","last_undegraded":"2023-10-08T07:01:09.876116+0000","last_fullsized":"2023-10-08T07:01:09.876116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:32.031015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805004+0000","last_change":"2023-10-08T07:00:58.687458+0000","last_active":"2023-10-08T07:01:09.805004+0000","last_peered":"2023-10-08T07:01:09.805004+0000","last_clean":"2023-10-08T07:01:09.805004+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:09.805004+0000","last_undegraded":"2023-10-08T07:01:09.805004+0000","last_fullsized":"2023-10-08T07:01:09.805004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:25:42.651522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886785+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:09.886785+0000","last_peered":"2023-10-08T07:01:09.886785+0000","last_clean":"2023-10-08T07:01:09.886785+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:09.886785+0000","last_undegraded":"2023-10-08T07:01:09.886785+0000","last_fullsized":"2023-10-08T07:01:09.886785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:35.339502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805622+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:09.805622+0000","last_peered":"2023-10-08T07:01:09.805622+0000","last_clean":"2023-10-08T07:01:09.805622+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:09.805622+0000","last_undegraded":"2023-10-08T07:01:09.805622+0000","last_fullsized":"2023-10-08T07:01:09.805622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:53.864366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879648+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:09.879648+0000","last_peered":"2023-10-08T07:01:09.879648+0000","last_clean":"2023-10-08T07:01:09.879648+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:09.879648+0000","last_undegraded":"2023-10-08T07:01:09.879648+0000","last_fullsized":"2023-10-08T07:01:09.879648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612614,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47200,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324640,"statfs":{"total":96636764160,"available":96588431360,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325040,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046800,"statfs":{"total":96636764160,"available":96303923200,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54200000000000004,"5min":1.998,"15min":1.998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.443}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306988,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064852,"statfs":{"total":96636764160,"available":96322408448,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:01:17.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:01:17.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:17.678 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":80,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T07:01:10.881837+0000","last_up_change":"2023-10-08T07:00:57.716764+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":38,"up_from":73,"up_thru":73,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6801","nonce":3759124899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6803","nonce":3759124899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6807","nonce":3759124899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6805","nonce":3759124899}]},"public_addr":"172.21.15.183:6801/3759124899","cluster_addr":"172.21.15.183:6803/3759124899","heartbeat_back_addr":"172.21.15.183:6807/3759124899","heartbeat_front_addr":"172.21.15.183:6805/3759124899","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":38}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:01:18.692 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T07:01:18.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T07:01:18.858 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T07:01:18.858 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T07:01:18.859 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T07:01:18.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T07:01:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T07:01:19.222 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T07:01:19.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T07:01:19.375 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T07:01:19.375 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T07:01:19.376 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T07:01:19.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T07:01:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T07:01:19.739 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T07:01:19.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T07:01:19.891 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-08T07:01:19.891 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T07:01:19.891 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-08T07:01:19.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T07:01:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T07:01:20.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:01:20.594 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:01:20.606 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-08T07:01:19.008667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679228,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436292,"statfs":{"total":289910292480,"available":289214763008,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.135204"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889369+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:09.889369+0000","last_peered":"2023-10-08T07:01:09.889369+0000","last_clean":"2023-10-08T07:01:09.889369+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:09.889369+0000","last_undegraded":"2023-10-08T07:01:09.889369+0000","last_fullsized":"2023-10-08T07:01:09.889369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879623+0000","last_change":"2023-10-08T07:00:58.757022+0000","last_active":"2023-10-08T07:01:09.879623+0000","last_peered":"2023-10-08T07:01:09.879623+0000","last_clean":"2023-10-08T07:01:09.879623+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:09.879623+0000","last_undegraded":"2023-10-08T07:01:09.879623+0000","last_fullsized":"2023-10-08T07:01:09.879623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:57.715272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876818+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:09.876818+0000","last_peered":"2023-10-08T07:01:09.876818+0000","last_clean":"2023-10-08T07:01:09.876818+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:09.876818+0000","last_undegraded":"2023-10-08T07:01:09.876818+0000","last_fullsized":"2023-10-08T07:01:09.876818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:13.653322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876767+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:09.876767+0000","last_peered":"2023-10-08T07:01:09.876767+0000","last_clean":"2023-10-08T07:01:09.876767+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:09.876767+0000","last_undegraded":"2023-10-08T07:01:09.876767+0000","last_fullsized":"2023-10-08T07:01:09.876767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:08.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886836+0000","last_change":"2023-10-08T07:01:09.882134+0000","last_active":"2023-10-08T07:01:09.886836+0000","last_peered":"2023-10-08T07:01:09.886836+0000","last_clean":"2023-10-08T07:01:09.886836+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:09.886836+0000","last_undegraded":"2023-10-08T07:01:09.886836+0000","last_fullsized":"2023-10-08T07:01:09.886836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876241+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:09.876241+0000","last_peered":"2023-10-08T07:01:09.876241+0000","last_clean":"2023-10-08T07:01:09.876241+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:09.876241+0000","last_undegraded":"2023-10-08T07:01:09.876241+0000","last_fullsized":"2023-10-08T07:01:09.876241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.341032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875903+0000","last_change":"2023-10-08T07:00:58.741788+0000","last_active":"2023-10-08T07:01:09.875903+0000","last_peered":"2023-10-08T07:01:09.875903+0000","last_clean":"2023-10-08T07:01:09.875903+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:09.875903+0000","last_undegraded":"2023-10-08T07:01:09.875903+0000","last_fullsized":"2023-10-08T07:01:09.875903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:32.537791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875853+0000","last_change":"2023-10-08T07:00:58.743309+0000","last_active":"2023-10-08T07:01:09.875853+0000","last_peered":"2023-10-08T07:01:09.875853+0000","last_clean":"2023-10-08T07:01:09.875853+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:09.875853+0000","last_undegraded":"2023-10-08T07:01:09.875853+0000","last_fullsized":"2023-10-08T07:01:09.875853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:10.662510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805710+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:09.805710+0000","last_peered":"2023-10-08T07:01:09.805710+0000","last_clean":"2023-10-08T07:01:09.805710+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:09.805710+0000","last_undegraded":"2023-10-08T07:01:09.805710+0000","last_fullsized":"2023-10-08T07:01:09.805710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:14.193056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879851+0000","last_change":"2023-10-08T07:00:58.757350+0000","last_active":"2023-10-08T07:01:09.879851+0000","last_peered":"2023-10-08T07:01:09.879851+0000","last_clean":"2023-10-08T07:01:09.879851+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:09.879851+0000","last_undegraded":"2023-10-08T07:01:09.879851+0000","last_fullsized":"2023-10-08T07:01:09.879851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:38.805578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876686+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:09.876686+0000","last_peered":"2023-10-08T07:01:09.876686+0000","last_clean":"2023-10-08T07:01:09.876686+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:09.876686+0000","last_undegraded":"2023-10-08T07:01:09.876686+0000","last_fullsized":"2023-10-08T07:01:09.876686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:11.748373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886800+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:09.886800+0000","last_peered":"2023-10-08T07:01:09.886800+0000","last_clean":"2023-10-08T07:01:09.886800+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:09.886800+0000","last_undegraded":"2023-10-08T07:01:09.886800+0000","last_fullsized":"2023-10-08T07:01:09.886800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:50.428711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.884162+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:09.884162+0000","last_peered":"2023-10-08T07:01:09.884162+0000","last_clean":"2023-10-08T07:01:09.884162+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:09.884162+0000","last_undegraded":"2023-10-08T07:01:09.884162+0000","last_fullsized":"2023-10-08T07:01:09.884162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876609+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:09.876609+0000","last_peered":"2023-10-08T07:01:09.876609+0000","last_clean":"2023-10-08T07:01:09.876609+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:09.876609+0000","last_undegraded":"2023-10-08T07:01:09.876609+0000","last_fullsized":"2023-10-08T07:01:09.876609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:55.368469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876291+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:09.876291+0000","last_peered":"2023-10-08T07:01:09.876291+0000","last_clean":"2023-10-08T07:01:09.876291+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:09.876291+0000","last_undegraded":"2023-10-08T07:01:09.876291+0000","last_fullsized":"2023-10-08T07:01:09.876291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875872+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:09.875872+0000","last_peered":"2023-10-08T07:01:09.875872+0000","last_clean":"2023-10-08T07:01:09.875872+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:09.875872+0000","last_undegraded":"2023-10-08T07:01:09.875872+0000","last_fullsized":"2023-10-08T07:01:09.875872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805445+0000","last_change":"2023-10-08T07:00:58.689994+0000","last_active":"2023-10-08T07:01:09.805445+0000","last_peered":"2023-10-08T07:01:09.805445+0000","last_clean":"2023-10-08T07:01:09.805445+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:09.805445+0000","last_undegraded":"2023-10-08T07:01:09.805445+0000","last_fullsized":"2023-10-08T07:01:09.805445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:38.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879888+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:09.879888+0000","last_peered":"2023-10-08T07:01:09.879888+0000","last_clean":"2023-10-08T07:01:09.879888+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:09.879888+0000","last_undegraded":"2023-10-08T07:01:09.879888+0000","last_fullsized":"2023-10-08T07:01:09.879888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:20.556448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805312+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:09.805312+0000","last_peered":"2023-10-08T07:01:09.805312+0000","last_clean":"2023-10-08T07:01:09.805312+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:09.805312+0000","last_undegraded":"2023-10-08T07:01:09.805312+0000","last_fullsized":"2023-10-08T07:01:09.805312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:57:56.486710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876667+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:09.876667+0000","last_peered":"2023-10-08T07:01:09.876667+0000","last_clean":"2023-10-08T07:01:09.876667+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:09.876667+0000","last_undegraded":"2023-10-08T07:01:09.876667+0000","last_fullsized":"2023-10-08T07:01:09.876667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:21.278271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876239+0000","last_change":"2023-10-08T07:00:58.743568+0000","last_active":"2023-10-08T07:01:09.876239+0000","last_peered":"2023-10-08T07:01:09.876239+0000","last_clean":"2023-10-08T07:01:09.876239+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:09.876239+0000","last_undegraded":"2023-10-08T07:01:09.876239+0000","last_fullsized":"2023-10-08T07:01:09.876239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:22.726402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886866+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:09.886866+0000","last_peered":"2023-10-08T07:01:09.886866+0000","last_clean":"2023-10-08T07:01:09.886866+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:09.886866+0000","last_undegraded":"2023-10-08T07:01:09.886866+0000","last_fullsized":"2023-10-08T07:01:09.886866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:30.912592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804896+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:09.804896+0000","last_peered":"2023-10-08T07:01:09.804896+0000","last_clean":"2023-10-08T07:01:09.804896+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:09.804896+0000","last_undegraded":"2023-10-08T07:01:09.804896+0000","last_fullsized":"2023-10-08T07:01:09.804896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:28.061195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878224+0000","last_change":"2023-10-08T07:00:58.757259+0000","last_active":"2023-10-08T07:01:09.878224+0000","last_peered":"2023-10-08T07:01:09.878224+0000","last_clean":"2023-10-08T07:01:09.878224+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:09.878224+0000","last_undegraded":"2023-10-08T07:01:09.878224+0000","last_fullsized":"2023-10-08T07:01:09.878224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:50.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880708+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:09.880708+0000","last_peered":"2023-10-08T07:01:09.880708+0000","last_clean":"2023-10-08T07:01:09.880708+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:09.880708+0000","last_undegraded":"2023-10-08T07:01:09.880708+0000","last_fullsized":"2023-10-08T07:01:09.880708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805824+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:09.805824+0000","last_peered":"2023-10-08T07:01:09.805824+0000","last_clean":"2023-10-08T07:01:09.805824+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:09.805824+0000","last_undegraded":"2023-10-08T07:01:09.805824+0000","last_fullsized":"2023-10-08T07:01:09.805824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:02:40.932995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876702+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:09.876702+0000","last_peered":"2023-10-08T07:01:09.876702+0000","last_clean":"2023-10-08T07:01:09.876702+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:09.876702+0000","last_undegraded":"2023-10-08T07:01:09.876702+0000","last_fullsized":"2023-10-08T07:01:09.876702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:57.538384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889382+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:09.889382+0000","last_peered":"2023-10-08T07:01:09.889382+0000","last_clean":"2023-10-08T07:01:09.889382+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889382+0000","last_undegraded":"2023-10-08T07:01:09.889382+0000","last_fullsized":"2023-10-08T07:01:09.889382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879867+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:09.879867+0000","last_peered":"2023-10-08T07:01:09.879867+0000","last_clean":"2023-10-08T07:01:09.879867+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:09.879867+0000","last_undegraded":"2023-10-08T07:01:09.879867+0000","last_fullsized":"2023-10-08T07:01:09.879867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:37.181979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804720+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:09.804720+0000","last_peered":"2023-10-08T07:01:09.804720+0000","last_clean":"2023-10-08T07:01:09.804720+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:09.804720+0000","last_undegraded":"2023-10-08T07:01:09.804720+0000","last_fullsized":"2023-10-08T07:01:09.804720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:18.521858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805896+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:09.805896+0000","last_peered":"2023-10-08T07:01:09.805896+0000","last_clean":"2023-10-08T07:01:09.805896+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:09.805896+0000","last_undegraded":"2023-10-08T07:01:09.805896+0000","last_fullsized":"2023-10-08T07:01:09.805896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:14:38.780240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804669+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:09.804669+0000","last_peered":"2023-10-08T07:01:09.804669+0000","last_clean":"2023-10-08T07:01:09.804669+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:09.804669+0000","last_undegraded":"2023-10-08T07:01:09.804669+0000","last_fullsized":"2023-10-08T07:01:09.804669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:42.865388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.880661+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:09.880661+0000","last_peered":"2023-10-08T07:01:09.880661+0000","last_clean":"2023-10-08T07:01:09.880661+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:09.880661+0000","last_undegraded":"2023-10-08T07:01:09.880661+0000","last_fullsized":"2023-10-08T07:01:09.880661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:37.829016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805748+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:09.805748+0000","last_peered":"2023-10-08T07:01:09.805748+0000","last_clean":"2023-10-08T07:01:09.805748+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:09.805748+0000","last_undegraded":"2023-10-08T07:01:09.805748+0000","last_fullsized":"2023-10-08T07:01:09.805748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:05:28.271541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804563+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:09.804563+0000","last_peered":"2023-10-08T07:01:09.804563+0000","last_clean":"2023-10-08T07:01:09.804563+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:09.804563+0000","last_undegraded":"2023-10-08T07:01:09.804563+0000","last_fullsized":"2023-10-08T07:01:09.804563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:40.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876794+0000","last_change":"2023-10-08T07:00:58.742002+0000","last_active":"2023-10-08T07:01:09.876794+0000","last_peered":"2023-10-08T07:01:09.876794+0000","last_clean":"2023-10-08T07:01:09.876794+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:09.876794+0000","last_undegraded":"2023-10-08T07:01:09.876794+0000","last_fullsized":"2023-10-08T07:01:09.876794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:29.906921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805026+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:09.805026+0000","last_peered":"2023-10-08T07:01:09.805026+0000","last_clean":"2023-10-08T07:01:09.805026+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:09.805026+0000","last_undegraded":"2023-10-08T07:01:09.805026+0000","last_fullsized":"2023-10-08T07:01:09.805026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:26.532564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879366+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:09.879366+0000","last_peered":"2023-10-08T07:01:09.879366+0000","last_clean":"2023-10-08T07:01:09.879366+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:09.879366+0000","last_undegraded":"2023-10-08T07:01:09.879366+0000","last_fullsized":"2023-10-08T07:01:09.879366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:48.000587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804726+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:09.804726+0000","last_peered":"2023-10-08T07:01:09.804726+0000","last_clean":"2023-10-08T07:01:09.804726+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:09.804726+0000","last_undegraded":"2023-10-08T07:01:09.804726+0000","last_fullsized":"2023-10-08T07:01:09.804726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:54.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876664+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:09.876664+0000","last_peered":"2023-10-08T07:01:09.876664+0000","last_clean":"2023-10-08T07:01:09.876664+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:09.876664+0000","last_undegraded":"2023-10-08T07:01:09.876664+0000","last_fullsized":"2023-10-08T07:01:09.876664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:50.407114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876537+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:09.876537+0000","last_peered":"2023-10-08T07:01:09.876537+0000","last_clean":"2023-10-08T07:01:09.876537+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:09.876537+0000","last_undegraded":"2023-10-08T07:01:09.876537+0000","last_fullsized":"2023-10-08T07:01:09.876537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:25.661699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876642+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:09.876642+0000","last_peered":"2023-10-08T07:01:09.876642+0000","last_clean":"2023-10-08T07:01:09.876642+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:09.876642+0000","last_undegraded":"2023-10-08T07:01:09.876642+0000","last_fullsized":"2023-10-08T07:01:09.876642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:27:49.423040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886847+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:09.886847+0000","last_peered":"2023-10-08T07:01:09.886847+0000","last_clean":"2023-10-08T07:01:09.886847+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:09.886847+0000","last_undegraded":"2023-10-08T07:01:09.886847+0000","last_fullsized":"2023-10-08T07:01:09.886847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:53.793279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804844+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:09.804844+0000","last_peered":"2023-10-08T07:01:09.804844+0000","last_clean":"2023-10-08T07:01:09.804844+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:09.804844+0000","last_undegraded":"2023-10-08T07:01:09.804844+0000","last_fullsized":"2023-10-08T07:01:09.804844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:09.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886829+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:09.886829+0000","last_peered":"2023-10-08T07:01:09.886829+0000","last_clean":"2023-10-08T07:01:09.886829+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:09.886829+0000","last_undegraded":"2023-10-08T07:01:09.886829+0000","last_fullsized":"2023-10-08T07:01:09.886829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:48.135262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878197+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:09.878197+0000","last_peered":"2023-10-08T07:01:09.878197+0000","last_clean":"2023-10-08T07:01:09.878197+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:09.878197+0000","last_undegraded":"2023-10-08T07:01:09.878197+0000","last_fullsized":"2023-10-08T07:01:09.878197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:48.993266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805734+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:09.805734+0000","last_peered":"2023-10-08T07:01:09.805734+0000","last_clean":"2023-10-08T07:01:09.805734+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:09.805734+0000","last_undegraded":"2023-10-08T07:01:09.805734+0000","last_fullsized":"2023-10-08T07:01:09.805734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:48:19.319694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876264+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:09.876264+0000","last_peered":"2023-10-08T07:01:09.876264+0000","last_clean":"2023-10-08T07:01:09.876264+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:09.876264+0000","last_undegraded":"2023-10-08T07:01:09.876264+0000","last_fullsized":"2023-10-08T07:01:09.876264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:27.649159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805857+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:09.805857+0000","last_peered":"2023-10-08T07:01:09.805857+0000","last_clean":"2023-10-08T07:01:09.805857+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:09.805857+0000","last_undegraded":"2023-10-08T07:01:09.805857+0000","last_fullsized":"2023-10-08T07:01:09.805857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:38.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876985+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:09.876985+0000","last_peered":"2023-10-08T07:01:09.876985+0000","last_clean":"2023-10-08T07:01:09.876985+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:09.876985+0000","last_undegraded":"2023-10-08T07:01:09.876985+0000","last_fullsized":"2023-10-08T07:01:09.876985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:35.081396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877688+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:09.877688+0000","last_peered":"2023-10-08T07:01:09.877688+0000","last_clean":"2023-10-08T07:01:09.877688+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:09.877688+0000","last_undegraded":"2023-10-08T07:01:09.877688+0000","last_fullsized":"2023-10-08T07:01:09.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:14.103253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879744+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:09.879744+0000","last_peered":"2023-10-08T07:01:09.879744+0000","last_clean":"2023-10-08T07:01:09.879744+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:09.879744+0000","last_undegraded":"2023-10-08T07:01:09.879744+0000","last_fullsized":"2023-10-08T07:01:09.879744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:32.085463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878510+0000","last_change":"2023-10-08T07:00:58.742366+0000","last_active":"2023-10-08T07:01:09.878510+0000","last_peered":"2023-10-08T07:01:09.878510+0000","last_clean":"2023-10-08T07:01:09.878510+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:09.878510+0000","last_undegraded":"2023-10-08T07:01:09.878510+0000","last_fullsized":"2023-10-08T07:01:09.878510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.443197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876833+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:09.876833+0000","last_peered":"2023-10-08T07:01:09.876833+0000","last_clean":"2023-10-08T07:01:09.876833+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:09.876833+0000","last_undegraded":"2023-10-08T07:01:09.876833+0000","last_fullsized":"2023-10-08T07:01:09.876833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:37.445507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876500+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:09.876500+0000","last_peered":"2023-10-08T07:01:09.876500+0000","last_clean":"2023-10-08T07:01:09.876500+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:09.876500+0000","last_undegraded":"2023-10-08T07:01:09.876500+0000","last_fullsized":"2023-10-08T07:01:09.876500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:41.315551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876366+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:09.876366+0000","last_peered":"2023-10-08T07:01:09.876366+0000","last_clean":"2023-10-08T07:01:09.876366+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:09.876366+0000","last_undegraded":"2023-10-08T07:01:09.876366+0000","last_fullsized":"2023-10-08T07:01:09.876366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:52.787608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805457+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:09.805457+0000","last_peered":"2023-10-08T07:01:09.805457+0000","last_clean":"2023-10-08T07:01:09.805457+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:09.805457+0000","last_undegraded":"2023-10-08T07:01:09.805457+0000","last_fullsized":"2023-10-08T07:01:09.805457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:46.069356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805138+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:09.805138+0000","last_peered":"2023-10-08T07:01:09.805138+0000","last_clean":"2023-10-08T07:01:09.805138+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:09.805138+0000","last_undegraded":"2023-10-08T07:01:09.805138+0000","last_fullsized":"2023-10-08T07:01:09.805138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:30.717351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876373+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:09.876373+0000","last_peered":"2023-10-08T07:01:09.876373+0000","last_clean":"2023-10-08T07:01:09.876373+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:09.876373+0000","last_undegraded":"2023-10-08T07:01:09.876373+0000","last_fullsized":"2023-10-08T07:01:09.876373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:31.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.875889+0000","last_change":"2023-10-08T07:00:58.741881+0000","last_active":"2023-10-08T07:01:09.875889+0000","last_peered":"2023-10-08T07:01:09.875889+0000","last_clean":"2023-10-08T07:01:09.875889+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:09.875889+0000","last_undegraded":"2023-10-08T07:01:09.875889+0000","last_fullsized":"2023-10-08T07:01:09.875889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:42.957083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877011+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:09.877011+0000","last_peered":"2023-10-08T07:01:09.877011+0000","last_clean":"2023-10-08T07:01:09.877011+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:09.877011+0000","last_undegraded":"2023-10-08T07:01:09.877011+0000","last_fullsized":"2023-10-08T07:01:09.877011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:31.232899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886762+0000","last_change":"2023-10-08T07:01:09.881913+0000","last_active":"2023-10-08T07:01:09.886762+0000","last_peered":"2023-10-08T07:01:09.886762+0000","last_clean":"2023-10-08T07:01:09.886762+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:09.886762+0000","last_undegraded":"2023-10-08T07:01:09.886762+0000","last_fullsized":"2023-10-08T07:01:09.886762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:43.187153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876894+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:09.876894+0000","last_peered":"2023-10-08T07:01:09.876894+0000","last_clean":"2023-10-08T07:01:09.876894+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:09.876894+0000","last_undegraded":"2023-10-08T07:01:09.876894+0000","last_fullsized":"2023-10-08T07:01:09.876894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:22.095487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878020+0000","last_change":"2023-10-08T07:00:58.757070+0000","last_active":"2023-10-08T07:01:09.878020+0000","last_peered":"2023-10-08T07:01:09.878020+0000","last_clean":"2023-10-08T07:01:09.878020+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:09.878020+0000","last_undegraded":"2023-10-08T07:01:09.878020+0000","last_fullsized":"2023-10-08T07:01:09.878020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:54.400652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805649+0000","last_change":"2023-10-08T07:00:58.690359+0000","last_active":"2023-10-08T07:01:09.805649+0000","last_peered":"2023-10-08T07:01:09.805649+0000","last_clean":"2023-10-08T07:01:09.805649+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:09.805649+0000","last_undegraded":"2023-10-08T07:01:09.805649+0000","last_fullsized":"2023-10-08T07:01:09.805649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:24.632619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805631+0000","last_change":"2023-10-08T07:00:58.689104+0000","last_active":"2023-10-08T07:01:09.805631+0000","last_peered":"2023-10-08T07:01:09.805631+0000","last_clean":"2023-10-08T07:01:09.805631+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:09.805631+0000","last_undegraded":"2023-10-08T07:01:09.805631+0000","last_fullsized":"2023-10-08T07:01:09.805631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:19.488445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876918+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:09.876918+0000","last_peered":"2023-10-08T07:01:09.876918+0000","last_clean":"2023-10-08T07:01:09.876918+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:09.876918+0000","last_undegraded":"2023-10-08T07:01:09.876918+0000","last_fullsized":"2023-10-08T07:01:09.876918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:07:54.119898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879374+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:09.879374+0000","last_peered":"2023-10-08T07:01:09.879374+0000","last_clean":"2023-10-08T07:01:09.879374+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:09.879374+0000","last_undegraded":"2023-10-08T07:01:09.879374+0000","last_fullsized":"2023-10-08T07:01:09.879374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:00.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876563+0000","last_change":"2023-10-08T07:00:58.741459+0000","last_active":"2023-10-08T07:01:09.876563+0000","last_peered":"2023-10-08T07:01:09.876563+0000","last_clean":"2023-10-08T07:01:09.876563+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:09.876563+0000","last_undegraded":"2023-10-08T07:01:09.876563+0000","last_fullsized":"2023-10-08T07:01:09.876563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:38.166894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876349+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:09.876349+0000","last_peered":"2023-10-08T07:01:09.876349+0000","last_clean":"2023-10-08T07:01:09.876349+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:09.876349+0000","last_undegraded":"2023-10-08T07:01:09.876349+0000","last_fullsized":"2023-10-08T07:01:09.876349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:42.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805368+0000","last_change":"2023-10-08T07:00:58.689101+0000","last_active":"2023-10-08T07:01:09.805368+0000","last_peered":"2023-10-08T07:01:09.805368+0000","last_clean":"2023-10-08T07:01:09.805368+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:09.805368+0000","last_undegraded":"2023-10-08T07:01:09.805368+0000","last_fullsized":"2023-10-08T07:01:09.805368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:57.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804920+0000","last_change":"2023-10-08T07:00:58.686855+0000","last_active":"2023-10-08T07:01:09.804920+0000","last_peered":"2023-10-08T07:01:09.804920+0000","last_clean":"2023-10-08T07:01:09.804920+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:09.804920+0000","last_undegraded":"2023-10-08T07:01:09.804920+0000","last_fullsized":"2023-10-08T07:01:09.804920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:30.932703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.883950+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:09.883950+0000","last_peered":"2023-10-08T07:01:09.883950+0000","last_clean":"2023-10-08T07:01:09.883950+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:09.883950+0000","last_undegraded":"2023-10-08T07:01:09.883950+0000","last_fullsized":"2023-10-08T07:01:09.883950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:05.703724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805796+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:09.805796+0000","last_peered":"2023-10-08T07:01:09.805796+0000","last_clean":"2023-10-08T07:01:09.805796+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:09.805796+0000","last_undegraded":"2023-10-08T07:01:09.805796+0000","last_fullsized":"2023-10-08T07:01:09.805796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:44.156143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876428+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:09.876428+0000","last_peered":"2023-10-08T07:01:09.876428+0000","last_clean":"2023-10-08T07:01:09.876428+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:09.876428+0000","last_undegraded":"2023-10-08T07:01:09.876428+0000","last_fullsized":"2023-10-08T07:01:09.876428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:23.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876001+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:09.876001+0000","last_peered":"2023-10-08T07:01:09.876001+0000","last_clean":"2023-10-08T07:01:09.876001+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:09.876001+0000","last_undegraded":"2023-10-08T07:01:09.876001+0000","last_fullsized":"2023-10-08T07:01:09.876001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:12:27.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805034+0000","last_change":"2023-10-08T07:00:58.687270+0000","last_active":"2023-10-08T07:01:09.805034+0000","last_peered":"2023-10-08T07:01:09.805034+0000","last_clean":"2023-10-08T07:01:09.805034+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:09.805034+0000","last_undegraded":"2023-10-08T07:01:09.805034+0000","last_fullsized":"2023-10-08T07:01:09.805034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:05.762019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877017+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:09.877017+0000","last_peered":"2023-10-08T07:01:09.877017+0000","last_clean":"2023-10-08T07:01:09.877017+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:09.877017+0000","last_undegraded":"2023-10-08T07:01:09.877017+0000","last_fullsized":"2023-10-08T07:01:09.877017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:44.857060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782468+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:11.782468+0000","last_peered":"2023-10-08T07:01:11.782468+0000","last_clean":"2023-10-08T07:01:11.782468+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:11.782468+0000","last_undegraded":"2023-10-08T07:01:11.782468+0000","last_fullsized":"2023-10-08T07:01:11.782468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:08.910878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804656+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:09.804656+0000","last_peered":"2023-10-08T07:01:09.804656+0000","last_clean":"2023-10-08T07:01:09.804656+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:09.804656+0000","last_undegraded":"2023-10-08T07:01:09.804656+0000","last_fullsized":"2023-10-08T07:01:09.804656+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:30.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886744+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:09.886744+0000","last_peered":"2023-10-08T07:01:09.886744+0000","last_clean":"2023-10-08T07:01:09.886744+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:09.886744+0000","last_undegraded":"2023-10-08T07:01:09.886744+0000","last_fullsized":"2023-10-08T07:01:09.886744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:29.167059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.889407+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:09.889407+0000","last_peered":"2023-10-08T07:01:09.889407+0000","last_clean":"2023-10-08T07:01:09.889407+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:09.889407+0000","last_undegraded":"2023-10-08T07:01:09.889407+0000","last_fullsized":"2023-10-08T07:01:09.889407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:37.936824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805266+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:09.805266+0000","last_peered":"2023-10-08T07:01:09.805266+0000","last_clean":"2023-10-08T07:01:09.805266+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:09.805266+0000","last_undegraded":"2023-10-08T07:01:09.805266+0000","last_fullsized":"2023-10-08T07:01:09.805266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:32.928459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878330+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:09.878330+0000","last_peered":"2023-10-08T07:01:09.878330+0000","last_clean":"2023-10-08T07:01:09.878330+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:09.878330+0000","last_undegraded":"2023-10-08T07:01:09.878330+0000","last_fullsized":"2023-10-08T07:01:09.878330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:06.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805556+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:09.805556+0000","last_peered":"2023-10-08T07:01:09.805556+0000","last_clean":"2023-10-08T07:01:09.805556+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:09.805556+0000","last_undegraded":"2023-10-08T07:01:09.805556+0000","last_fullsized":"2023-10-08T07:01:09.805556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:30.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805342+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:09.805342+0000","last_peered":"2023-10-08T07:01:09.805342+0000","last_clean":"2023-10-08T07:01:09.805342+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:09.805342+0000","last_undegraded":"2023-10-08T07:01:09.805342+0000","last_fullsized":"2023-10-08T07:01:09.805342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:03.680449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.804573+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:09.804573+0000","last_peered":"2023-10-08T07:01:09.804573+0000","last_clean":"2023-10-08T07:01:09.804573+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:09.804573+0000","last_undegraded":"2023-10-08T07:01:09.804573+0000","last_fullsized":"2023-10-08T07:01:09.804573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:55.749420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.877044+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:09.877044+0000","last_peered":"2023-10-08T07:01:09.877044+0000","last_clean":"2023-10-08T07:01:09.877044+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:09.877044+0000","last_undegraded":"2023-10-08T07:01:09.877044+0000","last_fullsized":"2023-10-08T07:01:09.877044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:48.161306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805626+0000","last_change":"2023-10-08T07:00:58.672669+0000","last_active":"2023-10-08T07:01:09.805626+0000","last_peered":"2023-10-08T07:01:09.805626+0000","last_clean":"2023-10-08T07:01:09.805626+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:09.805626+0000","last_undegraded":"2023-10-08T07:01:09.805626+0000","last_fullsized":"2023-10-08T07:01:09.805626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:24.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879021+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:09.879021+0000","last_peered":"2023-10-08T07:01:09.879021+0000","last_clean":"2023-10-08T07:01:09.879021+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:09.879021+0000","last_undegraded":"2023-10-08T07:01:09.879021+0000","last_fullsized":"2023-10-08T07:01:09.879021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:20.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878395+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:09.878395+0000","last_peered":"2023-10-08T07:01:09.878395+0000","last_clean":"2023-10-08T07:01:09.878395+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:09.878395+0000","last_undegraded":"2023-10-08T07:01:09.878395+0000","last_fullsized":"2023-10-08T07:01:09.878395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:06.973651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879534+0000","last_change":"2023-10-08T07:00:58.756916+0000","last_active":"2023-10-08T07:01:09.879534+0000","last_peered":"2023-10-08T07:01:09.879534+0000","last_clean":"2023-10-08T07:01:09.879534+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:09.879534+0000","last_undegraded":"2023-10-08T07:01:09.879534+0000","last_fullsized":"2023-10-08T07:01:09.879534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:45.871560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876541+0000","last_change":"2023-10-08T07:00:58.741378+0000","last_active":"2023-10-08T07:01:09.876541+0000","last_peered":"2023-10-08T07:01:09.876541+0000","last_clean":"2023-10-08T07:01:09.876541+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:09.876541+0000","last_undegraded":"2023-10-08T07:01:09.876541+0000","last_fullsized":"2023-10-08T07:01:09.876541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:34.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876257+0000","last_change":"2023-10-08T07:00:58.743707+0000","last_active":"2023-10-08T07:01:09.876257+0000","last_peered":"2023-10-08T07:01:09.876257+0000","last_clean":"2023-10-08T07:01:09.876257+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:09.876257+0000","last_undegraded":"2023-10-08T07:01:09.876257+0000","last_fullsized":"2023-10-08T07:01:09.876257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:10:58.417067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879563+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:09.879563+0000","last_peered":"2023-10-08T07:01:09.879563+0000","last_clean":"2023-10-08T07:01:09.879563+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:09.879563+0000","last_undegraded":"2023-10-08T07:01:09.879563+0000","last_fullsized":"2023-10-08T07:01:09.879563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:06.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876387+0000","last_change":"2023-10-08T07:00:58.743219+0000","last_active":"2023-10-08T07:01:09.876387+0000","last_peered":"2023-10-08T07:01:09.876387+0000","last_clean":"2023-10-08T07:01:09.876387+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:09.876387+0000","last_undegraded":"2023-10-08T07:01:09.876387+0000","last_fullsized":"2023-10-08T07:01:09.876387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:11.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805505+0000","last_change":"2023-10-08T07:00:58.689299+0000","last_active":"2023-10-08T07:01:09.805505+0000","last_peered":"2023-10-08T07:01:09.805505+0000","last_clean":"2023-10-08T07:01:09.805505+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:09.805505+0000","last_undegraded":"2023-10-08T07:01:09.805505+0000","last_fullsized":"2023-10-08T07:01:09.805505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:03.194361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.878607+0000","last_change":"2023-10-08T07:00:58.742191+0000","last_active":"2023-10-08T07:01:09.878607+0000","last_peered":"2023-10-08T07:01:09.878607+0000","last_clean":"2023-10-08T07:01:09.878607+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:09.878607+0000","last_undegraded":"2023-10-08T07:01:09.878607+0000","last_fullsized":"2023-10-08T07:01:09.878607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.860327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805580+0000","last_change":"2023-10-08T07:00:58.672323+0000","last_active":"2023-10-08T07:01:09.805580+0000","last_peered":"2023-10-08T07:01:09.805580+0000","last_clean":"2023-10-08T07:01:09.805580+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:09.805580+0000","last_undegraded":"2023-10-08T07:01:09.805580+0000","last_fullsized":"2023-10-08T07:01:09.805580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:46.142346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876259+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:09.876259+0000","last_peered":"2023-10-08T07:01:09.876259+0000","last_clean":"2023-10-08T07:01:09.876259+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:09.876259+0000","last_undegraded":"2023-10-08T07:01:09.876259+0000","last_fullsized":"2023-10-08T07:01:09.876259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:27.988825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.876116+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:09.876116+0000","last_peered":"2023-10-08T07:01:09.876116+0000","last_clean":"2023-10-08T07:01:09.876116+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:09.876116+0000","last_undegraded":"2023-10-08T07:01:09.876116+0000","last_fullsized":"2023-10-08T07:01:09.876116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:32.031015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805004+0000","last_change":"2023-10-08T07:00:58.687458+0000","last_active":"2023-10-08T07:01:09.805004+0000","last_peered":"2023-10-08T07:01:09.805004+0000","last_clean":"2023-10-08T07:01:09.805004+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:09.805004+0000","last_undegraded":"2023-10-08T07:01:09.805004+0000","last_fullsized":"2023-10-08T07:01:09.805004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:25:42.651522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.886785+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:09.886785+0000","last_peered":"2023-10-08T07:01:09.886785+0000","last_clean":"2023-10-08T07:01:09.886785+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:09.886785+0000","last_undegraded":"2023-10-08T07:01:09.886785+0000","last_fullsized":"2023-10-08T07:01:09.886785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:35.339502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.805622+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:09.805622+0000","last_peered":"2023-10-08T07:01:09.805622+0000","last_clean":"2023-10-08T07:01:09.805622+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:09.805622+0000","last_undegraded":"2023-10-08T07:01:09.805622+0000","last_fullsized":"2023-10-08T07:01:09.805622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:53.864366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T07:01:09.879648+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:09.879648+0000","last_peered":"2023-10-08T07:01:09.879648+0000","last_clean":"2023-10-08T07:01:09.879648+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:09.879648+0000","last_undegraded":"2023-10-08T07:01:09.879648+0000","last_fullsized":"2023-10-08T07:01:09.879648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.986179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612614,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47200,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324640,"statfs":{"total":96636764160,"available":96588431360,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325040,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046800,"statfs":{"total":96636764160,"available":96303923200,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:00:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54200000000000004,"5min":1.998,"15min":1.998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.443}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306988,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064852,"statfs":{"total":96636764160,"available":96322408448,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:01:20.616 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.617 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.617 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.617 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.617 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.617 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.618 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.618 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.618 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.618 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.618 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.619 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.619 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.619 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.619 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.619 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.620 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.620 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.620 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.620 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.621 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.621 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.621 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.621 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.621 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.622 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.622 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.622 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.622 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.622 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.623 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.623 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.623 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.623 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.623 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.623 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.623 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.624 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.624 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.624 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.624 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.624 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.624 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.624 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.625 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.625 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.625 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.625 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.625 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.625 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.625 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.626 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.626 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.626 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.626 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.627 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.627 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.627 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.627 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.627 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.627 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.628 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.628 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.628 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.628 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.629 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.629 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.629 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.630 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.630 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.630 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.630 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.631 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.631 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.631 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.631 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T06:57:05.252014+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=5, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.632 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.632 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.632 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.632 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.633 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.633 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.633 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.633 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.634 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.634 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.634 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.634 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.635 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.635 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.635 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.636 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.636 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.637 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.637 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.637 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.638 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.638 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.638 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.639 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.639 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.639 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.639 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.640 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.640 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:20.640 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:01:40.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:01:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:01:41.009 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:01:41.020 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2023-10-08T07:01:39.013769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679208,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436312,"statfs":{"total":289910292480,"available":289214783488,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003139"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726586+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:19.726586+0000","last_peered":"2023-10-08T07:01:19.726586+0000","last_clean":"2023-10-08T07:01:19.726586+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:19.726586+0000","last_undegraded":"2023-10-08T07:01:19.726586+0000","last_fullsized":"2023-10-08T07:01:19.726586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:26.943085+0000","last_change":"2023-10-08T07:01:26.943085+0000","last_active":"2023-10-08T07:01:26.943085+0000","last_peered":"2023-10-08T07:01:26.943085+0000","last_clean":"2023-10-08T07:01:26.943085+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:26.943085+0000","last_undegraded":"2023-10-08T07:01:26.943085+0000","last_fullsized":"2023-10-08T07:01:26.943085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_clean_scrub_stamp":"2023-10-08T07:01:26.942930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:33.364930+0000","scrub_duration":0.0017987770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209443+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:19.209443+0000","last_peered":"2023-10-08T07:01:19.209443+0000","last_clean":"2023-10-08T07:01:19.209443+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:19.209443+0000","last_undegraded":"2023-10-08T07:01:19.209443+0000","last_fullsized":"2023-10-08T07:01:19.209443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.126324+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:19.126324+0000","last_peered":"2023-10-08T07:01:19.126324+0000","last_clean":"2023-10-08T07:01:19.126324+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:19.126324+0000","last_undegraded":"2023-10-08T07:01:19.126324+0000","last_fullsized":"2023-10-08T07:01:19.126324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:21.969184+0000","last_change":"2023-10-08T07:01:21.969248+0000","last_active":"2023-10-08T07:01:21.969184+0000","last_peered":"2023-10-08T07:01:21.969184+0000","last_clean":"2023-10-08T07:01:21.969184+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:21.969184+0000","last_undegraded":"2023-10-08T07:01:21.969184+0000","last_fullsized":"2023-10-08T07:01:21.969184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_clean_scrub_stamp":"2023-10-08T07:01:21.969069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:37.695683+0000","scrub_duration":0.013488305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783190+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:11.783190+0000","last_peered":"2023-10-08T07:01:11.783190+0000","last_clean":"2023-10-08T07:01:11.783190+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:11.783190+0000","last_undegraded":"2023-10-08T07:01:11.783190+0000","last_fullsized":"2023-10-08T07:01:11.783190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782801+0000","last_change":"2023-10-08T07:00:58.741788+0000","last_active":"2023-10-08T07:01:11.782801+0000","last_peered":"2023-10-08T07:01:11.782801+0000","last_clean":"2023-10-08T07:01:11.782801+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:11.782801+0000","last_undegraded":"2023-10-08T07:01:11.782801+0000","last_fullsized":"2023-10-08T07:01:11.782801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782661+0000","last_change":"2023-10-08T07:00:58.743309+0000","last_active":"2023-10-08T07:01:11.782661+0000","last_peered":"2023-10-08T07:01:11.782661+0000","last_clean":"2023-10-08T07:01:11.782661+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:11.782661+0000","last_undegraded":"2023-10-08T07:01:11.782661+0000","last_fullsized":"2023-10-08T07:01:11.782661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856336+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:10.856336+0000","last_peered":"2023-10-08T07:01:10.856336+0000","last_clean":"2023-10-08T07:01:10.856336+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:10.856336+0000","last_undegraded":"2023-10-08T07:01:10.856336+0000","last_fullsized":"2023-10-08T07:01:10.856336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887958+0000","last_change":"2023-10-08T07:00:58.757350+0000","last_active":"2023-10-08T07:01:10.887958+0000","last_peered":"2023-10-08T07:01:10.887958+0000","last_clean":"2023-10-08T07:01:10.887958+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:10.887958+0000","last_undegraded":"2023-10-08T07:01:10.887958+0000","last_fullsized":"2023-10-08T07:01:10.887958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783385+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:11.783385+0000","last_peered":"2023-10-08T07:01:11.783385+0000","last_clean":"2023-10-08T07:01:11.783385+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:11.783385+0000","last_undegraded":"2023-10-08T07:01:11.783385+0000","last_fullsized":"2023-10-08T07:01:11.783385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887480+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:10.887480+0000","last_peered":"2023-10-08T07:01:10.887480+0000","last_clean":"2023-10-08T07:01:10.887480+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:10.887480+0000","last_undegraded":"2023-10-08T07:01:10.887480+0000","last_fullsized":"2023-10-08T07:01:10.887480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887522+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:10.887522+0000","last_peered":"2023-10-08T07:01:10.887522+0000","last_clean":"2023-10-08T07:01:10.887522+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:10.887522+0000","last_undegraded":"2023-10-08T07:01:10.887522+0000","last_fullsized":"2023-10-08T07:01:10.887522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783745+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:11.783745+0000","last_peered":"2023-10-08T07:01:11.783745+0000","last_clean":"2023-10-08T07:01:11.783745+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:11.783745+0000","last_undegraded":"2023-10-08T07:01:11.783745+0000","last_fullsized":"2023-10-08T07:01:11.783745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783020+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:11.783020+0000","last_peered":"2023-10-08T07:01:11.783020+0000","last_clean":"2023-10-08T07:01:11.783020+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:11.783020+0000","last_undegraded":"2023-10-08T07:01:11.783020+0000","last_fullsized":"2023-10-08T07:01:11.783020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782718+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:11.782718+0000","last_peered":"2023-10-08T07:01:11.782718+0000","last_clean":"2023-10-08T07:01:11.782718+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:11.782718+0000","last_undegraded":"2023-10-08T07:01:11.782718+0000","last_fullsized":"2023-10-08T07:01:11.782718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856089+0000","last_change":"2023-10-08T07:00:58.689994+0000","last_active":"2023-10-08T07:01:10.856089+0000","last_peered":"2023-10-08T07:01:10.856089+0000","last_clean":"2023-10-08T07:01:10.856089+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:10.856089+0000","last_undegraded":"2023-10-08T07:01:10.856089+0000","last_fullsized":"2023-10-08T07:01:10.856089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.888100+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:10.888100+0000","last_peered":"2023-10-08T07:01:10.888100+0000","last_clean":"2023-10-08T07:01:10.888100+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:10.888100+0000","last_undegraded":"2023-10-08T07:01:10.888100+0000","last_fullsized":"2023-10-08T07:01:10.888100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855956+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:10.855956+0000","last_peered":"2023-10-08T07:01:10.855956+0000","last_clean":"2023-10-08T07:01:10.855956+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:10.855956+0000","last_undegraded":"2023-10-08T07:01:10.855956+0000","last_fullsized":"2023-10-08T07:01:10.855956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783621+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:11.783621+0000","last_peered":"2023-10-08T07:01:11.783621+0000","last_clean":"2023-10-08T07:01:11.783621+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:11.783621+0000","last_undegraded":"2023-10-08T07:01:11.783621+0000","last_fullsized":"2023-10-08T07:01:11.783621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:31.610321+0000","last_change":"2023-10-08T07:01:31.610403+0000","last_active":"2023-10-08T07:01:31.610321+0000","last_peered":"2023-10-08T07:01:31.610321+0000","last_clean":"2023-10-08T07:01:31.610321+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:31.610321+0000","last_undegraded":"2023-10-08T07:01:31.610321+0000","last_fullsized":"2023-10-08T07:01:31.610321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_clean_scrub_stamp":"2023-10-08T07:01:31.610144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:26.179749+0000","scrub_duration":0.024703487999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887318+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:10.887318+0000","last_peered":"2023-10-08T07:01:10.887318+0000","last_clean":"2023-10-08T07:01:10.887318+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:10.887318+0000","last_undegraded":"2023-10-08T07:01:10.887318+0000","last_fullsized":"2023-10-08T07:01:10.887318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855440+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:10.855440+0000","last_peered":"2023-10-08T07:01:10.855440+0000","last_clean":"2023-10-08T07:01:10.855440+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:10.855440+0000","last_undegraded":"2023-10-08T07:01:10.855440+0000","last_fullsized":"2023-10-08T07:01:10.855440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.987397+0000","last_change":"2023-10-08T07:01:24.987480+0000","last_active":"2023-10-08T07:01:24.987397+0000","last_peered":"2023-10-08T07:01:24.987397+0000","last_clean":"2023-10-08T07:01:24.987397+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:24.987397+0000","last_undegraded":"2023-10-08T07:01:24.987397+0000","last_fullsized":"2023-10-08T07:01:24.987397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.987290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:07.099956+0000","scrub_duration":0.0019193140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.888197+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:10.888197+0000","last_peered":"2023-10-08T07:01:10.888197+0000","last_clean":"2023-10-08T07:01:10.888197+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:10.888197+0000","last_undegraded":"2023-10-08T07:01:10.888197+0000","last_fullsized":"2023-10-08T07:01:10.888197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856279+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:10.856279+0000","last_peered":"2023-10-08T07:01:10.856279+0000","last_clean":"2023-10-08T07:01:10.856279+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:10.856279+0000","last_undegraded":"2023-10-08T07:01:10.856279+0000","last_fullsized":"2023-10-08T07:01:10.856279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783449+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:11.783449+0000","last_peered":"2023-10-08T07:01:11.783449+0000","last_clean":"2023-10-08T07:01:11.783449+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:11.783449+0000","last_undegraded":"2023-10-08T07:01:11.783449+0000","last_fullsized":"2023-10-08T07:01:11.783449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887451+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:10.887451+0000","last_peered":"2023-10-08T07:01:10.887451+0000","last_clean":"2023-10-08T07:01:10.887451+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:10.887451+0000","last_undegraded":"2023-10-08T07:01:10.887451+0000","last_fullsized":"2023-10-08T07:01:10.887451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.888074+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:10.888074+0000","last_peered":"2023-10-08T07:01:10.888074+0000","last_clean":"2023-10-08T07:01:10.888074+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:10.888074+0000","last_undegraded":"2023-10-08T07:01:10.888074+0000","last_fullsized":"2023-10-08T07:01:10.888074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855219+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:10.855219+0000","last_peered":"2023-10-08T07:01:10.855219+0000","last_clean":"2023-10-08T07:01:10.855219+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:10.855219+0000","last_undegraded":"2023-10-08T07:01:10.855219+0000","last_fullsized":"2023-10-08T07:01:10.855219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856331+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:10.856331+0000","last_peered":"2023-10-08T07:01:10.856331+0000","last_clean":"2023-10-08T07:01:10.856331+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:10.856331+0000","last_undegraded":"2023-10-08T07:01:10.856331+0000","last_fullsized":"2023-10-08T07:01:10.856331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855172+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:10.855172+0000","last_peered":"2023-10-08T07:01:10.855172+0000","last_clean":"2023-10-08T07:01:10.855172+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:10.855172+0000","last_undegraded":"2023-10-08T07:01:10.855172+0000","last_fullsized":"2023-10-08T07:01:10.855172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726423+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:19.726423+0000","last_peered":"2023-10-08T07:01:19.726423+0000","last_clean":"2023-10-08T07:01:19.726423+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:19.726423+0000","last_undegraded":"2023-10-08T07:01:19.726423+0000","last_fullsized":"2023-10-08T07:01:19.726423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856372+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:10.856372+0000","last_peered":"2023-10-08T07:01:10.856372+0000","last_clean":"2023-10-08T07:01:10.856372+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:10.856372+0000","last_undegraded":"2023-10-08T07:01:10.856372+0000","last_fullsized":"2023-10-08T07:01:10.856372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855080+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:10.855080+0000","last_peered":"2023-10-08T07:01:10.855080+0000","last_clean":"2023-10-08T07:01:10.855080+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:10.855080+0000","last_undegraded":"2023-10-08T07:01:10.855080+0000","last_fullsized":"2023-10-08T07:01:10.855080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:30.574699+0000","last_change":"2023-10-08T07:01:30.574748+0000","last_active":"2023-10-08T07:01:30.574699+0000","last_peered":"2023-10-08T07:01:30.574699+0000","last_clean":"2023-10-08T07:01:30.574699+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:30.574699+0000","last_undegraded":"2023-10-08T07:01:30.574699+0000","last_fullsized":"2023-10-08T07:01:30.574699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_clean_scrub_stamp":"2023-10-08T07:01:30.574594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:52.811528+0000","scrub_duration":0.0024001500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855631+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:10.855631+0000","last_peered":"2023-10-08T07:01:10.855631+0000","last_clean":"2023-10-08T07:01:10.855631+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:10.855631+0000","last_undegraded":"2023-10-08T07:01:10.855631+0000","last_fullsized":"2023-10-08T07:01:10.855631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887796+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:10.887796+0000","last_peered":"2023-10-08T07:01:10.887796+0000","last_clean":"2023-10-08T07:01:10.887796+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:10.887796+0000","last_undegraded":"2023-10-08T07:01:10.887796+0000","last_fullsized":"2023-10-08T07:01:10.887796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855235+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:10.855235+0000","last_peered":"2023-10-08T07:01:10.855235+0000","last_clean":"2023-10-08T07:01:10.855235+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:10.855235+0000","last_undegraded":"2023-10-08T07:01:10.855235+0000","last_fullsized":"2023-10-08T07:01:10.855235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783507+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:11.783507+0000","last_peered":"2023-10-08T07:01:11.783507+0000","last_clean":"2023-10-08T07:01:11.783507+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:11.783507+0000","last_undegraded":"2023-10-08T07:01:11.783507+0000","last_fullsized":"2023-10-08T07:01:11.783507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783856+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:11.783856+0000","last_peered":"2023-10-08T07:01:11.783856+0000","last_clean":"2023-10-08T07:01:11.783856+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:11.783856+0000","last_undegraded":"2023-10-08T07:01:11.783856+0000","last_fullsized":"2023-10-08T07:01:11.783856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783749+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:11.783749+0000","last_peered":"2023-10-08T07:01:11.783749+0000","last_clean":"2023-10-08T07:01:11.783749+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:11.783749+0000","last_undegraded":"2023-10-08T07:01:11.783749+0000","last_fullsized":"2023-10-08T07:01:11.783749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887713+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:10.887713+0000","last_peered":"2023-10-08T07:01:10.887713+0000","last_clean":"2023-10-08T07:01:10.887713+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:10.887713+0000","last_undegraded":"2023-10-08T07:01:10.887713+0000","last_fullsized":"2023-10-08T07:01:10.887713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855387+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:10.855387+0000","last_peered":"2023-10-08T07:01:10.855387+0000","last_clean":"2023-10-08T07:01:10.855387+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:10.855387+0000","last_undegraded":"2023-10-08T07:01:10.855387+0000","last_fullsized":"2023-10-08T07:01:10.855387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887978+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:10.887978+0000","last_peered":"2023-10-08T07:01:10.887978+0000","last_clean":"2023-10-08T07:01:10.887978+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:10.887978+0000","last_undegraded":"2023-10-08T07:01:10.887978+0000","last_fullsized":"2023-10-08T07:01:10.887978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887237+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:10.887237+0000","last_peered":"2023-10-08T07:01:10.887237+0000","last_clean":"2023-10-08T07:01:10.887237+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:10.887237+0000","last_undegraded":"2023-10-08T07:01:10.887237+0000","last_fullsized":"2023-10-08T07:01:10.887237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856200+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:10.856200+0000","last_peered":"2023-10-08T07:01:10.856200+0000","last_clean":"2023-10-08T07:01:10.856200+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:10.856200+0000","last_undegraded":"2023-10-08T07:01:10.856200+0000","last_fullsized":"2023-10-08T07:01:10.856200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782862+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:11.782862+0000","last_peered":"2023-10-08T07:01:11.782862+0000","last_clean":"2023-10-08T07:01:11.782862+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:11.782862+0000","last_undegraded":"2023-10-08T07:01:11.782862+0000","last_fullsized":"2023-10-08T07:01:11.782862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856459+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:10.856459+0000","last_peered":"2023-10-08T07:01:10.856459+0000","last_clean":"2023-10-08T07:01:10.856459+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:10.856459+0000","last_undegraded":"2023-10-08T07:01:10.856459+0000","last_fullsized":"2023-10-08T07:01:10.856459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783821+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:11.783821+0000","last_peered":"2023-10-08T07:01:11.783821+0000","last_clean":"2023-10-08T07:01:11.783821+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:11.783821+0000","last_undegraded":"2023-10-08T07:01:11.783821+0000","last_fullsized":"2023-10-08T07:01:11.783821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.886962+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:10.886962+0000","last_peered":"2023-10-08T07:01:10.886962+0000","last_clean":"2023-10-08T07:01:10.886962+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:10.886962+0000","last_undegraded":"2023-10-08T07:01:10.886962+0000","last_fullsized":"2023-10-08T07:01:10.886962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887831+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:10.887831+0000","last_peered":"2023-10-08T07:01:10.887831+0000","last_clean":"2023-10-08T07:01:10.887831+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:10.887831+0000","last_undegraded":"2023-10-08T07:01:10.887831+0000","last_fullsized":"2023-10-08T07:01:10.887831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887355+0000","last_change":"2023-10-08T07:00:58.742366+0000","last_active":"2023-10-08T07:01:10.887355+0000","last_peered":"2023-10-08T07:01:10.887355+0000","last_clean":"2023-10-08T07:01:10.887355+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:10.887355+0000","last_undegraded":"2023-10-08T07:01:10.887355+0000","last_fullsized":"2023-10-08T07:01:10.887355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783504+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:11.783504+0000","last_peered":"2023-10-08T07:01:11.783504+0000","last_clean":"2023-10-08T07:01:11.783504+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:11.783504+0000","last_undegraded":"2023-10-08T07:01:11.783504+0000","last_fullsized":"2023-10-08T07:01:11.783504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783190+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:11.783190+0000","last_peered":"2023-10-08T07:01:11.783190+0000","last_clean":"2023-10-08T07:01:11.783190+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:11.783190+0000","last_undegraded":"2023-10-08T07:01:11.783190+0000","last_fullsized":"2023-10-08T07:01:11.783190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783574+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:11.783574+0000","last_peered":"2023-10-08T07:01:11.783574+0000","last_clean":"2023-10-08T07:01:11.783574+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:11.783574+0000","last_undegraded":"2023-10-08T07:01:11.783574+0000","last_fullsized":"2023-10-08T07:01:11.783574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855732+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:10.855732+0000","last_peered":"2023-10-08T07:01:10.855732+0000","last_clean":"2023-10-08T07:01:10.855732+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:10.855732+0000","last_undegraded":"2023-10-08T07:01:10.855732+0000","last_fullsized":"2023-10-08T07:01:10.855732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855601+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:10.855601+0000","last_peered":"2023-10-08T07:01:10.855601+0000","last_clean":"2023-10-08T07:01:10.855601+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:10.855601+0000","last_undegraded":"2023-10-08T07:01:10.855601+0000","last_fullsized":"2023-10-08T07:01:10.855601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783161+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:11.783161+0000","last_peered":"2023-10-08T07:01:11.783161+0000","last_clean":"2023-10-08T07:01:11.783161+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:11.783161+0000","last_undegraded":"2023-10-08T07:01:11.783161+0000","last_fullsized":"2023-10-08T07:01:11.783161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782808+0000","last_change":"2023-10-08T07:00:58.741881+0000","last_active":"2023-10-08T07:01:11.782808+0000","last_peered":"2023-10-08T07:01:11.782808+0000","last_clean":"2023-10-08T07:01:11.782808+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:11.782808+0000","last_undegraded":"2023-10-08T07:01:11.782808+0000","last_fullsized":"2023-10-08T07:01:11.782808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783812+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:11.783812+0000","last_peered":"2023-10-08T07:01:11.783812+0000","last_clean":"2023-10-08T07:01:11.783812+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:11.783812+0000","last_undegraded":"2023-10-08T07:01:11.783812+0000","last_fullsized":"2023-10-08T07:01:11.783812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:22.981405+0000","last_change":"2023-10-08T07:01:22.981449+0000","last_active":"2023-10-08T07:01:22.981405+0000","last_peered":"2023-10-08T07:01:22.981405+0000","last_clean":"2023-10-08T07:01:22.981405+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:22.981405+0000","last_undegraded":"2023-10-08T07:01:22.981405+0000","last_fullsized":"2023-10-08T07:01:22.981405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_clean_scrub_stamp":"2023-10-08T07:01:22.981312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:27.955182+0000","scrub_duration":0.0020775799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783438+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:11.783438+0000","last_peered":"2023-10-08T07:01:11.783438+0000","last_clean":"2023-10-08T07:01:11.783438+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:11.783438+0000","last_undegraded":"2023-10-08T07:01:11.783438+0000","last_fullsized":"2023-10-08T07:01:11.783438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887159+0000","last_change":"2023-10-08T07:00:58.757070+0000","last_active":"2023-10-08T07:01:10.887159+0000","last_peered":"2023-10-08T07:01:10.887159+0000","last_clean":"2023-10-08T07:01:10.887159+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:10.887159+0000","last_undegraded":"2023-10-08T07:01:10.887159+0000","last_fullsized":"2023-10-08T07:01:10.887159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856303+0000","last_change":"2023-10-08T07:00:58.690359+0000","last_active":"2023-10-08T07:01:10.856303+0000","last_peered":"2023-10-08T07:01:10.856303+0000","last_clean":"2023-10-08T07:01:10.856303+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:10.856303+0000","last_undegraded":"2023-10-08T07:01:10.856303+0000","last_fullsized":"2023-10-08T07:01:10.856303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:23.787068+0000","last_change":"2023-10-08T07:01:23.787118+0000","last_active":"2023-10-08T07:01:23.787068+0000","last_peered":"2023-10-08T07:01:23.787068+0000","last_clean":"2023-10-08T07:01:23.787068+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:23.787068+0000","last_undegraded":"2023-10-08T07:01:23.787068+0000","last_fullsized":"2023-10-08T07:01:23.787068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_clean_scrub_stamp":"2023-10-08T07:01:23.786970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:11.680051+0000","scrub_duration":0.0020370760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208905+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:19.208905+0000","last_peered":"2023-10-08T07:01:19.208905+0000","last_clean":"2023-10-08T07:01:19.208905+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:19.208905+0000","last_undegraded":"2023-10-08T07:01:19.208905+0000","last_fullsized":"2023-10-08T07:01:19.208905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726261+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:19.726261+0000","last_peered":"2023-10-08T07:01:19.726261+0000","last_clean":"2023-10-08T07:01:19.726261+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:19.726261+0000","last_undegraded":"2023-10-08T07:01:19.726261+0000","last_fullsized":"2023-10-08T07:01:19.726261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208866+0000","last_change":"2023-10-08T07:00:58.741459+0000","last_active":"2023-10-08T07:01:19.208866+0000","last_peered":"2023-10-08T07:01:19.208866+0000","last_clean":"2023-10-08T07:01:19.208866+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:19.208866+0000","last_undegraded":"2023-10-08T07:01:19.208866+0000","last_fullsized":"2023-10-08T07:01:19.208866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208976+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:19.208976+0000","last_peered":"2023-10-08T07:01:19.208976+0000","last_clean":"2023-10-08T07:01:19.208976+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:19.208976+0000","last_undegraded":"2023-10-08T07:01:19.208976+0000","last_fullsized":"2023-10-08T07:01:19.208976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855883+0000","last_change":"2023-10-08T07:00:58.689101+0000","last_active":"2023-10-08T07:01:10.855883+0000","last_peered":"2023-10-08T07:01:10.855883+0000","last_clean":"2023-10-08T07:01:10.855883+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:10.855883+0000","last_undegraded":"2023-10-08T07:01:10.855883+0000","last_fullsized":"2023-10-08T07:01:10.855883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:27.690641+0000","last_change":"2023-10-08T07:01:27.690692+0000","last_active":"2023-10-08T07:01:27.690641+0000","last_peered":"2023-10-08T07:01:27.690641+0000","last_clean":"2023-10-08T07:01:27.690641+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:27.690641+0000","last_undegraded":"2023-10-08T07:01:27.690641+0000","last_fullsized":"2023-10-08T07:01:27.690641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_clean_scrub_stamp":"2023-10-08T07:01:27.690553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.772607+0000","scrub_duration":0.0017559400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887075+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:10.887075+0000","last_peered":"2023-10-08T07:01:10.887075+0000","last_clean":"2023-10-08T07:01:10.887075+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:10.887075+0000","last_undegraded":"2023-10-08T07:01:10.887075+0000","last_fullsized":"2023-10-08T07:01:10.887075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856431+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:10.856431+0000","last_peered":"2023-10-08T07:01:10.856431+0000","last_clean":"2023-10-08T07:01:10.856431+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:10.856431+0000","last_undegraded":"2023-10-08T07:01:10.856431+0000","last_fullsized":"2023-10-08T07:01:10.856431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208866+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:19.208866+0000","last_peered":"2023-10-08T07:01:19.208866+0000","last_clean":"2023-10-08T07:01:19.208866+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:19.208866+0000","last_undegraded":"2023-10-08T07:01:19.208866+0000","last_fullsized":"2023-10-08T07:01:19.208866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":277,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782751+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:11.782751+0000","last_peered":"2023-10-08T07:01:11.782751+0000","last_clean":"2023-10-08T07:01:11.782751+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:11.782751+0000","last_undegraded":"2023-10-08T07:01:11.782751+0000","last_fullsized":"2023-10-08T07:01:11.782751+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.763443+0000","last_change":"2023-10-08T07:01:24.763513+0000","last_active":"2023-10-08T07:01:24.763443+0000","last_peered":"2023-10-08T07:01:24.763443+0000","last_clean":"2023-10-08T07:01:24.763443+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:24.763443+0000","last_undegraded":"2023-10-08T07:01:24.763443+0000","last_fullsized":"2023-10-08T07:01:24.763443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.763341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:32.962887+0000","scrub_duration":0.0020468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209103+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:19.209103+0000","last_peered":"2023-10-08T07:01:19.209103+0000","last_clean":"2023-10-08T07:01:19.209103+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:19.209103+0000","last_undegraded":"2023-10-08T07:01:19.209103+0000","last_fullsized":"2023-10-08T07:01:19.209103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:14.125450+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:14.125450+0000","last_peered":"2023-10-08T07:01:14.125450+0000","last_clean":"2023-10-08T07:01:14.125450+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:14.125450+0000","last_undegraded":"2023-10-08T07:01:14.125450+0000","last_fullsized":"2023-10-08T07:01:14.125450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855141+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:10.855141+0000","last_peered":"2023-10-08T07:01:10.855141+0000","last_clean":"2023-10-08T07:01:10.855141+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:10.855141+0000","last_undegraded":"2023-10-08T07:01:10.855141+0000","last_fullsized":"2023-10-08T07:01:10.855141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887997+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:10.887997+0000","last_peered":"2023-10-08T07:01:10.887997+0000","last_clean":"2023-10-08T07:01:10.887997+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:10.887997+0000","last_undegraded":"2023-10-08T07:01:10.887997+0000","last_fullsized":"2023-10-08T07:01:10.887997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726096+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:19.726096+0000","last_peered":"2023-10-08T07:01:19.726096+0000","last_clean":"2023-10-08T07:01:19.726096+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726096+0000","last_undegraded":"2023-10-08T07:01:19.726096+0000","last_fullsized":"2023-10-08T07:01:19.726096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855769+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:10.855769+0000","last_peered":"2023-10-08T07:01:10.855769+0000","last_clean":"2023-10-08T07:01:10.855769+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:10.855769+0000","last_undegraded":"2023-10-08T07:01:10.855769+0000","last_fullsized":"2023-10-08T07:01:10.855769+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726279+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:19.726279+0000","last_peered":"2023-10-08T07:01:19.726279+0000","last_clean":"2023-10-08T07:01:19.726279+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:19.726279+0000","last_undegraded":"2023-10-08T07:01:19.726279+0000","last_fullsized":"2023-10-08T07:01:19.726279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856207+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:10.856207+0000","last_peered":"2023-10-08T07:01:10.856207+0000","last_clean":"2023-10-08T07:01:10.856207+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:10.856207+0000","last_undegraded":"2023-10-08T07:01:10.856207+0000","last_fullsized":"2023-10-08T07:01:10.856207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855980+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:10.855980+0000","last_peered":"2023-10-08T07:01:10.855980+0000","last_clean":"2023-10-08T07:01:10.855980+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:10.855980+0000","last_undegraded":"2023-10-08T07:01:10.855980+0000","last_fullsized":"2023-10-08T07:01:10.855980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855047+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:10.855047+0000","last_peered":"2023-10-08T07:01:10.855047+0000","last_clean":"2023-10-08T07:01:10.855047+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:10.855047+0000","last_undegraded":"2023-10-08T07:01:10.855047+0000","last_fullsized":"2023-10-08T07:01:10.855047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208921+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:19.208921+0000","last_peered":"2023-10-08T07:01:19.208921+0000","last_clean":"2023-10-08T07:01:19.208921+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:19.208921+0000","last_undegraded":"2023-10-08T07:01:19.208921+0000","last_fullsized":"2023-10-08T07:01:19.208921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856115+0000","last_change":"2023-10-08T07:00:58.672669+0000","last_active":"2023-10-08T07:01:10.856115+0000","last_peered":"2023-10-08T07:01:10.856115+0000","last_clean":"2023-10-08T07:01:10.856115+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:10.856115+0000","last_undegraded":"2023-10-08T07:01:10.856115+0000","last_fullsized":"2023-10-08T07:01:10.856115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726236+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:19.726236+0000","last_peered":"2023-10-08T07:01:19.726236+0000","last_clean":"2023-10-08T07:01:19.726236+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:19.726236+0000","last_undegraded":"2023-10-08T07:01:19.726236+0000","last_fullsized":"2023-10-08T07:01:19.726236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887454+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:10.887454+0000","last_peered":"2023-10-08T07:01:10.887454+0000","last_clean":"2023-10-08T07:01:10.887454+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:10.887454+0000","last_undegraded":"2023-10-08T07:01:10.887454+0000","last_fullsized":"2023-10-08T07:01:10.887454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887960+0000","last_change":"2023-10-08T07:00:58.756916+0000","last_active":"2023-10-08T07:01:10.887960+0000","last_peered":"2023-10-08T07:01:10.887960+0000","last_clean":"2023-10-08T07:01:10.887960+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:10.887960+0000","last_undegraded":"2023-10-08T07:01:10.887960+0000","last_fullsized":"2023-10-08T07:01:10.887960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783358+0000","last_change":"2023-10-08T07:00:58.741378+0000","last_active":"2023-10-08T07:01:11.783358+0000","last_peered":"2023-10-08T07:01:11.783358+0000","last_clean":"2023-10-08T07:01:11.783358+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:11.783358+0000","last_undegraded":"2023-10-08T07:01:11.783358+0000","last_fullsized":"2023-10-08T07:01:11.783358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:28.609648+0000","last_change":"2023-10-08T07:01:28.609729+0000","last_active":"2023-10-08T07:01:28.609648+0000","last_peered":"2023-10-08T07:01:28.609648+0000","last_clean":"2023-10-08T07:01:28.609648+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:28.609648+0000","last_undegraded":"2023-10-08T07:01:28.609648+0000","last_fullsized":"2023-10-08T07:01:28.609648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_clean_scrub_stamp":"2023-10-08T07:01:28.609502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:34.613067+0000","scrub_duration":0.042684845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887984+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:10.887984+0000","last_peered":"2023-10-08T07:01:10.887984+0000","last_clean":"2023-10-08T07:01:10.887984+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:10.887984+0000","last_undegraded":"2023-10-08T07:01:10.887984+0000","last_fullsized":"2023-10-08T07:01:10.887984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783066+0000","last_change":"2023-10-08T07:00:58.743219+0000","last_active":"2023-10-08T07:01:11.783066+0000","last_peered":"2023-10-08T07:01:11.783066+0000","last_clean":"2023-10-08T07:01:11.783066+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:11.783066+0000","last_undegraded":"2023-10-08T07:01:11.783066+0000","last_fullsized":"2023-10-08T07:01:11.783066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856088+0000","last_change":"2023-10-08T07:00:58.689299+0000","last_active":"2023-10-08T07:01:10.856088+0000","last_peered":"2023-10-08T07:01:10.856088+0000","last_clean":"2023-10-08T07:01:10.856088+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:10.856088+0000","last_undegraded":"2023-10-08T07:01:10.856088+0000","last_fullsized":"2023-10-08T07:01:10.856088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887475+0000","last_change":"2023-10-08T07:00:58.742191+0000","last_active":"2023-10-08T07:01:10.887475+0000","last_peered":"2023-10-08T07:01:10.887475+0000","last_clean":"2023-10-08T07:01:10.887475+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:10.887475+0000","last_undegraded":"2023-10-08T07:01:10.887475+0000","last_fullsized":"2023-10-08T07:01:10.887475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856205+0000","last_change":"2023-10-08T07:00:58.672323+0000","last_active":"2023-10-08T07:01:10.856205+0000","last_peered":"2023-10-08T07:01:10.856205+0000","last_clean":"2023-10-08T07:01:10.856205+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:10.856205+0000","last_undegraded":"2023-10-08T07:01:10.856205+0000","last_fullsized":"2023-10-08T07:01:10.856205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782967+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:11.782967+0000","last_peered":"2023-10-08T07:01:11.782967+0000","last_clean":"2023-10-08T07:01:11.782967+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:11.782967+0000","last_undegraded":"2023-10-08T07:01:11.782967+0000","last_fullsized":"2023-10-08T07:01:11.782967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209279+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:19.209279+0000","last_peered":"2023-10-08T07:01:19.209279+0000","last_clean":"2023-10-08T07:01:19.209279+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:19.209279+0000","last_undegraded":"2023-10-08T07:01:19.209279+0000","last_fullsized":"2023-10-08T07:01:19.209279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:32.686938+0000","last_change":"2023-10-08T07:01:32.687008+0000","last_active":"2023-10-08T07:01:32.686938+0000","last_peered":"2023-10-08T07:01:32.686938+0000","last_clean":"2023-10-08T07:01:32.686938+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:32.686938+0000","last_undegraded":"2023-10-08T07:01:32.686938+0000","last_fullsized":"2023-10-08T07:01:32.686938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_clean_scrub_stamp":"2023-10-08T07:01:32.686840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:36.443277+0000","scrub_duration":0.0020720539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887814+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:10.887814+0000","last_peered":"2023-10-08T07:01:10.887814+0000","last_clean":"2023-10-08T07:01:10.887814+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:10.887814+0000","last_undegraded":"2023-10-08T07:01:10.887814+0000","last_fullsized":"2023-10-08T07:01:10.887814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855818+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:10.855818+0000","last_peered":"2023-10-08T07:01:10.855818+0000","last_clean":"2023-10-08T07:01:10.855818+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:10.855818+0000","last_undegraded":"2023-10-08T07:01:10.855818+0000","last_fullsized":"2023-10-08T07:01:10.855818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887906+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:10.887906+0000","last_peered":"2023-10-08T07:01:10.887906+0000","last_clean":"2023-10-08T07:01:10.887906+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:10.887906+0000","last_undegraded":"2023-10-08T07:01:10.887906+0000","last_fullsized":"2023-10-08T07:01:10.887906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612618,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47196,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324644,"statfs":{"total":96636764160,"available":96588435456,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325036,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046804,"statfs":{"total":96636764160,"available":96303927296,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.373,"15min":0.35899999999999999},"min":{"1min":0.39800000000000002,"5min":0.157,"15min":0.157},"max":{"1min":0.73399999999999999,"5min":1.845,"15min":1.845},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.34899999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.998,"15min":1.998},"last":0.314}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.439},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.496}]}]},{"osd":1,"up_from":8,"seq":34359738426,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.439},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:01:41.026 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.026 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.026 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.027 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.027 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.027 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.027 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.027 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.027 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.027 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.028 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.029 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.030 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.031 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.032 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.033 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.034 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T06:57:05.252014+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=5, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.035 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.036 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.037 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.038 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.038 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.038 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.038 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:01:41.038 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:02:01.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:02:01.395 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:02:01.425 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:02:01.425 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2023-10-08T07:02:01.019169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679208,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436312,"statfs":{"total":289910292480,"available":289214783488,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002921"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726586+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:19.726586+0000","last_peered":"2023-10-08T07:01:19.726586+0000","last_clean":"2023-10-08T07:01:19.726586+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:19.726586+0000","last_undegraded":"2023-10-08T07:01:19.726586+0000","last_fullsized":"2023-10-08T07:01:19.726586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:26.943085+0000","last_change":"2023-10-08T07:01:26.943085+0000","last_active":"2023-10-08T07:01:26.943085+0000","last_peered":"2023-10-08T07:01:26.943085+0000","last_clean":"2023-10-08T07:01:26.943085+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:26.943085+0000","last_undegraded":"2023-10-08T07:01:26.943085+0000","last_fullsized":"2023-10-08T07:01:26.943085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_clean_scrub_stamp":"2023-10-08T07:01:26.942930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:33.364930+0000","scrub_duration":0.0017987770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209443+0000","last_change":"2023-10-08T06:57:17.339216+0000","last_active":"2023-10-08T07:01:19.209443+0000","last_peered":"2023-10-08T07:01:19.209443+0000","last_clean":"2023-10-08T07:01:19.209443+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:01:19.209443+0000","last_undegraded":"2023-10-08T07:01:19.209443+0000","last_fullsized":"2023-10-08T07:01:19.209443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.126324+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:19.126324+0000","last_peered":"2023-10-08T07:01:19.126324+0000","last_clean":"2023-10-08T07:01:19.126324+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:19.126324+0000","last_undegraded":"2023-10-08T07:01:19.126324+0000","last_fullsized":"2023-10-08T07:01:19.126324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:21.969184+0000","last_change":"2023-10-08T07:01:21.969248+0000","last_active":"2023-10-08T07:01:21.969184+0000","last_peered":"2023-10-08T07:01:21.969184+0000","last_clean":"2023-10-08T07:01:21.969184+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:21.969184+0000","last_undegraded":"2023-10-08T07:01:21.969184+0000","last_fullsized":"2023-10-08T07:01:21.969184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_clean_scrub_stamp":"2023-10-08T07:01:21.969069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:37.695683+0000","scrub_duration":0.013488305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783190+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:11.783190+0000","last_peered":"2023-10-08T07:01:11.783190+0000","last_clean":"2023-10-08T07:01:11.783190+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:11.783190+0000","last_undegraded":"2023-10-08T07:01:11.783190+0000","last_fullsized":"2023-10-08T07:01:11.783190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:57.750357+0000","last_change":"2023-10-08T07:01:57.750404+0000","last_active":"2023-10-08T07:01:57.750357+0000","last_peered":"2023-10-08T07:01:57.750357+0000","last_clean":"2023-10-08T07:01:57.750357+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:57.750357+0000","last_undegraded":"2023-10-08T07:01:57.750357+0000","last_fullsized":"2023-10-08T07:01:57.750357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_clean_scrub_stamp":"2023-10-08T07:01:57.750253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:45.382652+0000","scrub_duration":0.012901334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:56.730027+0000","last_change":"2023-10-08T07:01:56.730073+0000","last_active":"2023-10-08T07:01:56.730027+0000","last_peered":"2023-10-08T07:01:56.730027+0000","last_clean":"2023-10-08T07:01:56.730027+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:56.730027+0000","last_undegraded":"2023-10-08T07:01:56.730027+0000","last_fullsized":"2023-10-08T07:01:56.730027+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_clean_scrub_stamp":"2023-10-08T07:01:56.729910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:33.646540+0000","scrub_duration":0.001731001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856336+0000","last_change":"2023-10-08T07:00:58.690206+0000","last_active":"2023-10-08T07:01:10.856336+0000","last_peered":"2023-10-08T07:01:10.856336+0000","last_clean":"2023-10-08T07:01:10.856336+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:01:10.856336+0000","last_undegraded":"2023-10-08T07:01:10.856336+0000","last_fullsized":"2023-10-08T07:01:10.856336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.174372+0000","last_change":"2023-10-08T07:01:45.174431+0000","last_active":"2023-10-08T07:01:45.174372+0000","last_peered":"2023-10-08T07:01:45.174372+0000","last_clean":"2023-10-08T07:01:45.174372+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:45.174372+0000","last_undegraded":"2023-10-08T07:01:45.174372+0000","last_fullsized":"2023-10-08T07:01:45.174372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.174265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:07.913029+0000","scrub_duration":0.002167066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.783385+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:11.783385+0000","last_peered":"2023-10-08T07:01:11.783385+0000","last_clean":"2023-10-08T07:01:11.783385+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:11.783385+0000","last_undegraded":"2023-10-08T07:01:11.783385+0000","last_fullsized":"2023-10-08T07:01:11.783385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887480+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:10.887480+0000","last_peered":"2023-10-08T07:01:10.887480+0000","last_clean":"2023-10-08T07:01:10.887480+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:10.887480+0000","last_undegraded":"2023-10-08T07:01:10.887480+0000","last_fullsized":"2023-10-08T07:01:10.887480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887522+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:10.887522+0000","last_peered":"2023-10-08T07:01:10.887522+0000","last_clean":"2023-10-08T07:01:10.887522+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:10.887522+0000","last_undegraded":"2023-10-08T07:01:10.887522+0000","last_fullsized":"2023-10-08T07:01:10.887522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209365+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:19.209365+0000","last_peered":"2023-10-08T07:01:19.209365+0000","last_clean":"2023-10-08T07:01:19.209365+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:19.209365+0000","last_undegraded":"2023-10-08T07:01:19.209365+0000","last_fullsized":"2023-10-08T07:01:19.209365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209295+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:19.209295+0000","last_peered":"2023-10-08T07:01:19.209295+0000","last_clean":"2023-10-08T07:01:19.209295+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:19.209295+0000","last_undegraded":"2023-10-08T07:01:19.209295+0000","last_fullsized":"2023-10-08T07:01:19.209295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209279+0000","last_change":"2023-10-08T07:00:58.743227+0000","last_active":"2023-10-08T07:01:19.209279+0000","last_peered":"2023-10-08T07:01:19.209279+0000","last_clean":"2023-10-08T07:01:19.209279+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:01:19.209279+0000","last_undegraded":"2023-10-08T07:01:19.209279+0000","last_fullsized":"2023-10-08T07:01:19.209279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.688380+0000","last_change":"2023-10-08T07:01:50.688440+0000","last_active":"2023-10-08T07:01:50.688380+0000","last_peered":"2023-10-08T07:01:50.688380+0000","last_clean":"2023-10-08T07:01:50.688380+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:50.688380+0000","last_undegraded":"2023-10-08T07:01:50.688380+0000","last_fullsized":"2023-10-08T07:01:50.688380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.688235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:07.345735+0000","scrub_duration":0.058960934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726493+0000","last_change":"2023-10-08T07:00:58.757358+0000","last_active":"2023-10-08T07:01:19.726493+0000","last_peered":"2023-10-08T07:01:19.726493+0000","last_clean":"2023-10-08T07:01:19.726493+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:01:19.726493+0000","last_undegraded":"2023-10-08T07:01:19.726493+0000","last_fullsized":"2023-10-08T07:01:19.726493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855956+0000","last_change":"2023-10-08T07:00:58.688115+0000","last_active":"2023-10-08T07:01:10.855956+0000","last_peered":"2023-10-08T07:01:10.855956+0000","last_clean":"2023-10-08T07:01:10.855956+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:01:10.855956+0000","last_undegraded":"2023-10-08T07:01:10.855956+0000","last_fullsized":"2023-10-08T07:01:10.855956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209296+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:19.209296+0000","last_peered":"2023-10-08T07:01:19.209296+0000","last_clean":"2023-10-08T07:01:19.209296+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:19.209296+0000","last_undegraded":"2023-10-08T07:01:19.209296+0000","last_fullsized":"2023-10-08T07:01:19.209296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:31.610403+0000","last_change":"2023-10-08T07:01:31.610403+0000","last_active":"2023-10-08T07:01:31.610403+0000","last_peered":"2023-10-08T07:01:31.610403+0000","last_clean":"2023-10-08T07:01:31.610403+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:31.610403+0000","last_undegraded":"2023-10-08T07:01:31.610403+0000","last_fullsized":"2023-10-08T07:01:31.610403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_clean_scrub_stamp":"2023-10-08T07:01:31.610144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:26.179749+0000","scrub_duration":0.024703487999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887318+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:10.887318+0000","last_peered":"2023-10-08T07:01:10.887318+0000","last_clean":"2023-10-08T07:01:10.887318+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:10.887318+0000","last_undegraded":"2023-10-08T07:01:10.887318+0000","last_fullsized":"2023-10-08T07:01:10.887318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855440+0000","last_change":"2023-10-08T07:00:58.669438+0000","last_active":"2023-10-08T07:01:10.855440+0000","last_peered":"2023-10-08T07:01:10.855440+0000","last_clean":"2023-10-08T07:01:10.855440+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:01:10.855440+0000","last_undegraded":"2023-10-08T07:01:10.855440+0000","last_fullsized":"2023-10-08T07:01:10.855440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.987480+0000","last_change":"2023-10-08T07:01:24.987480+0000","last_active":"2023-10-08T07:01:24.987480+0000","last_peered":"2023-10-08T07:01:24.987480+0000","last_clean":"2023-10-08T07:01:24.987480+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:24.987480+0000","last_undegraded":"2023-10-08T07:01:24.987480+0000","last_fullsized":"2023-10-08T07:01:24.987480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.987290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:07.099956+0000","scrub_duration":0.0019193140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726453+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:19.726453+0000","last_peered":"2023-10-08T07:01:19.726453+0000","last_clean":"2023-10-08T07:01:19.726453+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:19.726453+0000","last_undegraded":"2023-10-08T07:01:19.726453+0000","last_fullsized":"2023-10-08T07:01:19.726453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856279+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:10.856279+0000","last_peered":"2023-10-08T07:01:10.856279+0000","last_clean":"2023-10-08T07:01:10.856279+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:10.856279+0000","last_undegraded":"2023-10-08T07:01:10.856279+0000","last_fullsized":"2023-10-08T07:01:10.856279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209256+0000","last_change":"2023-10-08T06:57:17.339543+0000","last_active":"2023-10-08T07:01:19.209256+0000","last_peered":"2023-10-08T07:01:19.209256+0000","last_clean":"2023-10-08T07:01:19.209256+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:01:19.209256+0000","last_undegraded":"2023-10-08T07:01:19.209256+0000","last_fullsized":"2023-10-08T07:01:19.209256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887451+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:10.887451+0000","last_peered":"2023-10-08T07:01:10.887451+0000","last_clean":"2023-10-08T07:01:10.887451+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:10.887451+0000","last_undegraded":"2023-10-08T07:01:10.887451+0000","last_fullsized":"2023-10-08T07:01:10.887451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.888074+0000","last_change":"2023-10-08T06:57:17.342330+0000","last_active":"2023-10-08T07:01:10.888074+0000","last_peered":"2023-10-08T07:01:10.888074+0000","last_clean":"2023-10-08T07:01:10.888074+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:01:10.888074+0000","last_undegraded":"2023-10-08T07:01:10.888074+0000","last_fullsized":"2023-10-08T07:01:10.888074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855219+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:10.855219+0000","last_peered":"2023-10-08T07:01:10.855219+0000","last_clean":"2023-10-08T07:01:10.855219+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:10.855219+0000","last_undegraded":"2023-10-08T07:01:10.855219+0000","last_fullsized":"2023-10-08T07:01:10.855219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856331+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:10.856331+0000","last_peered":"2023-10-08T07:01:10.856331+0000","last_clean":"2023-10-08T07:01:10.856331+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:10.856331+0000","last_undegraded":"2023-10-08T07:01:10.856331+0000","last_fullsized":"2023-10-08T07:01:10.856331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855172+0000","last_change":"2023-10-08T07:00:58.687315+0000","last_active":"2023-10-08T07:01:10.855172+0000","last_peered":"2023-10-08T07:01:10.855172+0000","last_clean":"2023-10-08T07:01:10.855172+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:10.855172+0000","last_undegraded":"2023-10-08T07:01:10.855172+0000","last_fullsized":"2023-10-08T07:01:10.855172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726423+0000","last_change":"2023-10-08T06:57:17.336463+0000","last_active":"2023-10-08T07:01:19.726423+0000","last_peered":"2023-10-08T07:01:19.726423+0000","last_clean":"2023-10-08T07:01:19.726423+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:01:19.726423+0000","last_undegraded":"2023-10-08T07:01:19.726423+0000","last_fullsized":"2023-10-08T07:01:19.726423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856372+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:10.856372+0000","last_peered":"2023-10-08T07:01:10.856372+0000","last_clean":"2023-10-08T07:01:10.856372+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:10.856372+0000","last_undegraded":"2023-10-08T07:01:10.856372+0000","last_fullsized":"2023-10-08T07:01:10.856372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855080+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:10.855080+0000","last_peered":"2023-10-08T07:01:10.855080+0000","last_clean":"2023-10-08T07:01:10.855080+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:10.855080+0000","last_undegraded":"2023-10-08T07:01:10.855080+0000","last_fullsized":"2023-10-08T07:01:10.855080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:30.574699+0000","last_change":"2023-10-08T07:01:30.574748+0000","last_active":"2023-10-08T07:01:30.574699+0000","last_peered":"2023-10-08T07:01:30.574699+0000","last_clean":"2023-10-08T07:01:30.574699+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:30.574699+0000","last_undegraded":"2023-10-08T07:01:30.574699+0000","last_fullsized":"2023-10-08T07:01:30.574699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_clean_scrub_stamp":"2023-10-08T07:01:30.574594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:52.811528+0000","scrub_duration":0.0024001500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855631+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:10.855631+0000","last_peered":"2023-10-08T07:01:10.855631+0000","last_clean":"2023-10-08T07:01:10.855631+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:10.855631+0000","last_undegraded":"2023-10-08T07:01:10.855631+0000","last_fullsized":"2023-10-08T07:01:10.855631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887796+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:10.887796+0000","last_peered":"2023-10-08T07:01:10.887796+0000","last_clean":"2023-10-08T07:01:10.887796+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:10.887796+0000","last_undegraded":"2023-10-08T07:01:10.887796+0000","last_fullsized":"2023-10-08T07:01:10.887796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855235+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:10.855235+0000","last_peered":"2023-10-08T07:01:10.855235+0000","last_clean":"2023-10-08T07:01:10.855235+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:10.855235+0000","last_undegraded":"2023-10-08T07:01:10.855235+0000","last_fullsized":"2023-10-08T07:01:10.855235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209022+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:19.209022+0000","last_peered":"2023-10-08T07:01:19.209022+0000","last_clean":"2023-10-08T07:01:19.209022+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:19.209022+0000","last_undegraded":"2023-10-08T07:01:19.209022+0000","last_fullsized":"2023-10-08T07:01:19.209022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209193+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:19.209193+0000","last_peered":"2023-10-08T07:01:19.209193+0000","last_clean":"2023-10-08T07:01:19.209193+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:19.209193+0000","last_undegraded":"2023-10-08T07:01:19.209193+0000","last_fullsized":"2023-10-08T07:01:19.209193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209043+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:19.209043+0000","last_peered":"2023-10-08T07:01:19.209043+0000","last_clean":"2023-10-08T07:01:19.209043+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:19.209043+0000","last_undegraded":"2023-10-08T07:01:19.209043+0000","last_fullsized":"2023-10-08T07:01:19.209043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726352+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:19.726352+0000","last_peered":"2023-10-08T07:01:19.726352+0000","last_clean":"2023-10-08T07:01:19.726352+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:19.726352+0000","last_undegraded":"2023-10-08T07:01:19.726352+0000","last_fullsized":"2023-10-08T07:01:19.726352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855387+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:10.855387+0000","last_peered":"2023-10-08T07:01:10.855387+0000","last_clean":"2023-10-08T07:01:10.855387+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:10.855387+0000","last_undegraded":"2023-10-08T07:01:10.855387+0000","last_fullsized":"2023-10-08T07:01:10.855387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887978+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:10.887978+0000","last_peered":"2023-10-08T07:01:10.887978+0000","last_clean":"2023-10-08T07:01:10.887978+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:10.887978+0000","last_undegraded":"2023-10-08T07:01:10.887978+0000","last_fullsized":"2023-10-08T07:01:10.887978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726094+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:19.726094+0000","last_peered":"2023-10-08T07:01:19.726094+0000","last_clean":"2023-10-08T07:01:19.726094+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:19.726094+0000","last_undegraded":"2023-10-08T07:01:19.726094+0000","last_fullsized":"2023-10-08T07:01:19.726094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856200+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:10.856200+0000","last_peered":"2023-10-08T07:01:10.856200+0000","last_clean":"2023-10-08T07:01:10.856200+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:10.856200+0000","last_undegraded":"2023-10-08T07:01:10.856200+0000","last_fullsized":"2023-10-08T07:01:10.856200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208996+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:19.208996+0000","last_peered":"2023-10-08T07:01:19.208996+0000","last_clean":"2023-10-08T07:01:19.208996+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:19.208996+0000","last_undegraded":"2023-10-08T07:01:19.208996+0000","last_fullsized":"2023-10-08T07:01:19.208996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856459+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:10.856459+0000","last_peered":"2023-10-08T07:01:10.856459+0000","last_clean":"2023-10-08T07:01:10.856459+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:10.856459+0000","last_undegraded":"2023-10-08T07:01:10.856459+0000","last_fullsized":"2023-10-08T07:01:10.856459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208986+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:19.208986+0000","last_peered":"2023-10-08T07:01:19.208986+0000","last_clean":"2023-10-08T07:01:19.208986+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:19.208986+0000","last_undegraded":"2023-10-08T07:01:19.208986+0000","last_fullsized":"2023-10-08T07:01:19.208986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726302+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:19.726302+0000","last_peered":"2023-10-08T07:01:19.726302+0000","last_clean":"2023-10-08T07:01:19.726302+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:19.726302+0000","last_undegraded":"2023-10-08T07:01:19.726302+0000","last_fullsized":"2023-10-08T07:01:19.726302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726126+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:19.726126+0000","last_peered":"2023-10-08T07:01:19.726126+0000","last_clean":"2023-10-08T07:01:19.726126+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:19.726126+0000","last_undegraded":"2023-10-08T07:01:19.726126+0000","last_fullsized":"2023-10-08T07:01:19.726126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:48.225570+0000","last_change":"2023-10-08T07:01:48.225616+0000","last_active":"2023-10-08T07:01:48.225570+0000","last_peered":"2023-10-08T07:01:48.225570+0000","last_clean":"2023-10-08T07:01:48.225570+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:48.225570+0000","last_undegraded":"2023-10-08T07:01:48.225570+0000","last_fullsized":"2023-10-08T07:01:48.225570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_clean_scrub_stamp":"2023-10-08T07:01:48.225481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:42.795086+0000","scrub_duration":0.001625563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209001+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:19.209001+0000","last_peered":"2023-10-08T07:01:19.209001+0000","last_clean":"2023-10-08T07:01:19.209001+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:19.209001+0000","last_undegraded":"2023-10-08T07:01:19.209001+0000","last_fullsized":"2023-10-08T07:01:19.209001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209124+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:19.209124+0000","last_peered":"2023-10-08T07:01:19.209124+0000","last_clean":"2023-10-08T07:01:19.209124+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:19.209124+0000","last_undegraded":"2023-10-08T07:01:19.209124+0000","last_fullsized":"2023-10-08T07:01:19.209124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208928+0000","last_change":"2023-10-08T07:00:58.743366+0000","last_active":"2023-10-08T07:01:19.208928+0000","last_peered":"2023-10-08T07:01:19.208928+0000","last_clean":"2023-10-08T07:01:19.208928+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:01:19.208928+0000","last_undegraded":"2023-10-08T07:01:19.208928+0000","last_fullsized":"2023-10-08T07:01:19.208928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855732+0000","last_change":"2023-10-08T07:00:58.672382+0000","last_active":"2023-10-08T07:01:10.855732+0000","last_peered":"2023-10-08T07:01:10.855732+0000","last_clean":"2023-10-08T07:01:10.855732+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:01:10.855732+0000","last_undegraded":"2023-10-08T07:01:10.855732+0000","last_fullsized":"2023-10-08T07:01:10.855732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855601+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:10.855601+0000","last_peered":"2023-10-08T07:01:10.855601+0000","last_clean":"2023-10-08T07:01:10.855601+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:10.855601+0000","last_undegraded":"2023-10-08T07:01:10.855601+0000","last_fullsized":"2023-10-08T07:01:10.855601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209140+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:19.209140+0000","last_peered":"2023-10-08T07:01:19.209140+0000","last_clean":"2023-10-08T07:01:19.209140+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:19.209140+0000","last_undegraded":"2023-10-08T07:01:19.209140+0000","last_fullsized":"2023-10-08T07:01:19.209140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:51.695304+0000","last_change":"2023-10-08T07:01:51.695353+0000","last_active":"2023-10-08T07:01:51.695304+0000","last_peered":"2023-10-08T07:01:51.695304+0000","last_clean":"2023-10-08T07:01:51.695304+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:51.695304+0000","last_undegraded":"2023-10-08T07:01:51.695304+0000","last_fullsized":"2023-10-08T07:01:51.695304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_clean_scrub_stamp":"2023-10-08T07:01:51.695202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.269000+0000","scrub_duration":0.001739123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209139+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:19.209139+0000","last_peered":"2023-10-08T07:01:19.209139+0000","last_clean":"2023-10-08T07:01:19.209139+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:19.209139+0000","last_undegraded":"2023-10-08T07:01:19.209139+0000","last_fullsized":"2023-10-08T07:01:19.209139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:22.981405+0000","last_change":"2023-10-08T07:01:22.981449+0000","last_active":"2023-10-08T07:01:22.981405+0000","last_peered":"2023-10-08T07:01:22.981405+0000","last_clean":"2023-10-08T07:01:22.981405+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:22.981405+0000","last_undegraded":"2023-10-08T07:01:22.981405+0000","last_fullsized":"2023-10-08T07:01:22.981405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_clean_scrub_stamp":"2023-10-08T07:01:22.981312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:27.955182+0000","scrub_duration":0.0020775799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209107+0000","last_change":"2023-10-08T06:57:17.334774+0000","last_active":"2023-10-08T07:01:19.209107+0000","last_peered":"2023-10-08T07:01:19.209107+0000","last_clean":"2023-10-08T07:01:19.209107+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:01:19.209107+0000","last_undegraded":"2023-10-08T07:01:19.209107+0000","last_fullsized":"2023-10-08T07:01:19.209107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.038967+0000","last_change":"2023-10-08T07:01:39.038967+0000","last_active":"2023-10-08T07:01:39.038967+0000","last_peered":"2023-10-08T07:01:39.038967+0000","last_clean":"2023-10-08T07:01:39.038967+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:39.038967+0000","last_undegraded":"2023-10-08T07:01:39.038967+0000","last_fullsized":"2023-10-08T07:01:39.038967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.038786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:33.889107+0000","scrub_duration":0.0024023780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:49.638640+0000","last_change":"2023-10-08T07:01:49.638700+0000","last_active":"2023-10-08T07:01:49.638640+0000","last_peered":"2023-10-08T07:01:49.638640+0000","last_clean":"2023-10-08T07:01:49.638640+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:49.638640+0000","last_undegraded":"2023-10-08T07:01:49.638640+0000","last_fullsized":"2023-10-08T07:01:49.638640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_clean_scrub_stamp":"2023-10-08T07:01:49.638527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:19.403345+0000","scrub_duration":0.045952461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:23.787068+0000","last_change":"2023-10-08T07:01:23.787118+0000","last_active":"2023-10-08T07:01:23.787068+0000","last_peered":"2023-10-08T07:01:23.787068+0000","last_clean":"2023-10-08T07:01:23.787068+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:23.787068+0000","last_undegraded":"2023-10-08T07:01:23.787068+0000","last_fullsized":"2023-10-08T07:01:23.787068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_clean_scrub_stamp":"2023-10-08T07:01:23.786970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:11.680051+0000","scrub_duration":0.0020370760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208905+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:19.208905+0000","last_peered":"2023-10-08T07:01:19.208905+0000","last_clean":"2023-10-08T07:01:19.208905+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:19.208905+0000","last_undegraded":"2023-10-08T07:01:19.208905+0000","last_fullsized":"2023-10-08T07:01:19.208905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726261+0000","last_change":"2023-10-08T06:57:17.337559+0000","last_active":"2023-10-08T07:01:19.726261+0000","last_peered":"2023-10-08T07:01:19.726261+0000","last_clean":"2023-10-08T07:01:19.726261+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:01:19.726261+0000","last_undegraded":"2023-10-08T07:01:19.726261+0000","last_fullsized":"2023-10-08T07:01:19.726261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:44.684847+0000","last_change":"2023-10-08T07:01:44.684911+0000","last_active":"2023-10-08T07:01:44.684847+0000","last_peered":"2023-10-08T07:01:44.684847+0000","last_clean":"2023-10-08T07:01:44.684847+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:44.684847+0000","last_undegraded":"2023-10-08T07:01:44.684847+0000","last_fullsized":"2023-10-08T07:01:44.684847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_clean_scrub_stamp":"2023-10-08T07:01:44.684726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:06.172009+0000","scrub_duration":0.0021191029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208976+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:19.208976+0000","last_peered":"2023-10-08T07:01:19.208976+0000","last_clean":"2023-10-08T07:01:19.208976+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:19.208976+0000","last_undegraded":"2023-10-08T07:01:19.208976+0000","last_fullsized":"2023-10-08T07:01:19.208976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.560363+0000","last_change":"2023-10-08T07:01:45.560412+0000","last_active":"2023-10-08T07:01:45.560363+0000","last_peered":"2023-10-08T07:01:45.560363+0000","last_clean":"2023-10-08T07:01:45.560363+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:45.560363+0000","last_undegraded":"2023-10-08T07:01:45.560363+0000","last_fullsized":"2023-10-08T07:01:45.560363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.560260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:37.159112+0000","scrub_duration":0.0017976050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:27.690641+0000","last_change":"2023-10-08T07:01:27.690692+0000","last_active":"2023-10-08T07:01:27.690641+0000","last_peered":"2023-10-08T07:01:27.690641+0000","last_clean":"2023-10-08T07:01:27.690641+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:27.690641+0000","last_undegraded":"2023-10-08T07:01:27.690641+0000","last_fullsized":"2023-10-08T07:01:27.690641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_clean_scrub_stamp":"2023-10-08T07:01:27.690553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.772607+0000","scrub_duration":0.0017559400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887075+0000","last_change":"2023-10-08T07:01:09.880622+0000","last_active":"2023-10-08T07:01:10.887075+0000","last_peered":"2023-10-08T07:01:10.887075+0000","last_clean":"2023-10-08T07:01:10.887075+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:01:10.887075+0000","last_undegraded":"2023-10-08T07:01:10.887075+0000","last_fullsized":"2023-10-08T07:01:10.887075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856431+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:10.856431+0000","last_peered":"2023-10-08T07:01:10.856431+0000","last_clean":"2023-10-08T07:01:10.856431+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:10.856431+0000","last_undegraded":"2023-10-08T07:01:10.856431+0000","last_fullsized":"2023-10-08T07:01:10.856431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208866+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:19.208866+0000","last_peered":"2023-10-08T07:01:19.208866+0000","last_clean":"2023-10-08T07:01:19.208866+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:19.208866+0000","last_undegraded":"2023-10-08T07:01:19.208866+0000","last_fullsized":"2023-10-08T07:01:19.208866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":277,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782751+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:11.782751+0000","last_peered":"2023-10-08T07:01:11.782751+0000","last_clean":"2023-10-08T07:01:11.782751+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:11.782751+0000","last_undegraded":"2023-10-08T07:01:11.782751+0000","last_fullsized":"2023-10-08T07:01:11.782751+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.763443+0000","last_change":"2023-10-08T07:01:24.763513+0000","last_active":"2023-10-08T07:01:24.763443+0000","last_peered":"2023-10-08T07:01:24.763443+0000","last_clean":"2023-10-08T07:01:24.763443+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:24.763443+0000","last_undegraded":"2023-10-08T07:01:24.763443+0000","last_fullsized":"2023-10-08T07:01:24.763443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.763341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:32.962887+0000","scrub_duration":0.0020468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209103+0000","last_change":"2023-10-08T06:57:17.338034+0000","last_active":"2023-10-08T07:01:19.209103+0000","last_peered":"2023-10-08T07:01:19.209103+0000","last_clean":"2023-10-08T07:01:19.209103+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:01:19.209103+0000","last_undegraded":"2023-10-08T07:01:19.209103+0000","last_fullsized":"2023-10-08T07:01:19.209103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:14.125450+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:14.125450+0000","last_peered":"2023-10-08T07:01:14.125450+0000","last_clean":"2023-10-08T07:01:14.125450+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:14.125450+0000","last_undegraded":"2023-10-08T07:01:14.125450+0000","last_fullsized":"2023-10-08T07:01:14.125450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855141+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:10.855141+0000","last_peered":"2023-10-08T07:01:10.855141+0000","last_clean":"2023-10-08T07:01:10.855141+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:10.855141+0000","last_undegraded":"2023-10-08T07:01:10.855141+0000","last_fullsized":"2023-10-08T07:01:10.855141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726305+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:19.726305+0000","last_peered":"2023-10-08T07:01:19.726305+0000","last_clean":"2023-10-08T07:01:19.726305+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:19.726305+0000","last_undegraded":"2023-10-08T07:01:19.726305+0000","last_fullsized":"2023-10-08T07:01:19.726305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726096+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:19.726096+0000","last_peered":"2023-10-08T07:01:19.726096+0000","last_clean":"2023-10-08T07:01:19.726096+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726096+0000","last_undegraded":"2023-10-08T07:01:19.726096+0000","last_fullsized":"2023-10-08T07:01:19.726096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855769+0000","last_change":"2023-10-08T07:00:58.688347+0000","last_active":"2023-10-08T07:01:10.855769+0000","last_peered":"2023-10-08T07:01:10.855769+0000","last_clean":"2023-10-08T07:01:10.855769+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:10.855769+0000","last_undegraded":"2023-10-08T07:01:10.855769+0000","last_fullsized":"2023-10-08T07:01:10.855769+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726279+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:19.726279+0000","last_peered":"2023-10-08T07:01:19.726279+0000","last_clean":"2023-10-08T07:01:19.726279+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:19.726279+0000","last_undegraded":"2023-10-08T07:01:19.726279+0000","last_fullsized":"2023-10-08T07:01:19.726279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856207+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:10.856207+0000","last_peered":"2023-10-08T07:01:10.856207+0000","last_clean":"2023-10-08T07:01:10.856207+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:10.856207+0000","last_undegraded":"2023-10-08T07:01:10.856207+0000","last_fullsized":"2023-10-08T07:01:10.856207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855980+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:10.855980+0000","last_peered":"2023-10-08T07:01:10.855980+0000","last_clean":"2023-10-08T07:01:10.855980+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:10.855980+0000","last_undegraded":"2023-10-08T07:01:10.855980+0000","last_fullsized":"2023-10-08T07:01:10.855980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855047+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:10.855047+0000","last_peered":"2023-10-08T07:01:10.855047+0000","last_clean":"2023-10-08T07:01:10.855047+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:10.855047+0000","last_undegraded":"2023-10-08T07:01:10.855047+0000","last_fullsized":"2023-10-08T07:01:10.855047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208921+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:19.208921+0000","last_peered":"2023-10-08T07:01:19.208921+0000","last_clean":"2023-10-08T07:01:19.208921+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:19.208921+0000","last_undegraded":"2023-10-08T07:01:19.208921+0000","last_fullsized":"2023-10-08T07:01:19.208921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"80'2","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.576981+0000","last_change":"2023-10-08T07:01:39.577040+0000","last_active":"2023-10-08T07:01:39.576981+0000","last_peered":"2023-10-08T07:01:39.576981+0000","last_clean":"2023-10-08T07:01:39.576981+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:39.576981+0000","last_undegraded":"2023-10-08T07:01:39.576981+0000","last_fullsized":"2023-10-08T07:01:39.576981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.576897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:14.587630+0000","scrub_duration":0.0034481989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726236+0000","last_change":"2023-10-08T06:57:17.333905+0000","last_active":"2023-10-08T07:01:19.726236+0000","last_peered":"2023-10-08T07:01:19.726236+0000","last_clean":"2023-10-08T07:01:19.726236+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:01:19.726236+0000","last_undegraded":"2023-10-08T07:01:19.726236+0000","last_fullsized":"2023-10-08T07:01:19.726236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887454+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:10.887454+0000","last_peered":"2023-10-08T07:01:10.887454+0000","last_clean":"2023-10-08T07:01:10.887454+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:10.887454+0000","last_undegraded":"2023-10-08T07:01:10.887454+0000","last_fullsized":"2023-10-08T07:01:10.887454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.216099+0000","last_change":"2023-10-08T07:01:50.216225+0000","last_active":"2023-10-08T07:01:50.216099+0000","last_peered":"2023-10-08T07:01:50.216099+0000","last_clean":"2023-10-08T07:01:50.216099+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:50.216099+0000","last_undegraded":"2023-10-08T07:01:50.216099+0000","last_fullsized":"2023-10-08T07:01:50.216099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.215973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:05.464123+0000","scrub_duration":0.002109798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"80'3","reported_seq":96,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:37.613457+0000","last_change":"2023-10-08T07:01:37.613532+0000","last_active":"2023-10-08T07:01:37.613457+0000","last_peered":"2023-10-08T07:01:37.613457+0000","last_clean":"2023-10-08T07:01:37.613457+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:37.613457+0000","last_undegraded":"2023-10-08T07:01:37.613457+0000","last_fullsized":"2023-10-08T07:01:37.613457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_clean_scrub_stamp":"2023-10-08T07:01:37.613340+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:13:09.671822+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:28.609648+0000","last_change":"2023-10-08T07:01:28.609729+0000","last_active":"2023-10-08T07:01:28.609648+0000","last_peered":"2023-10-08T07:01:28.609648+0000","last_clean":"2023-10-08T07:01:28.609648+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:28.609648+0000","last_undegraded":"2023-10-08T07:01:28.609648+0000","last_fullsized":"2023-10-08T07:01:28.609648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_clean_scrub_stamp":"2023-10-08T07:01:28.609502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:34.613067+0000","scrub_duration":0.042684845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887984+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:10.887984+0000","last_peered":"2023-10-08T07:01:10.887984+0000","last_clean":"2023-10-08T07:01:10.887984+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:10.887984+0000","last_undegraded":"2023-10-08T07:01:10.887984+0000","last_fullsized":"2023-10-08T07:01:10.887984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.644954+0000","last_change":"2023-10-08T07:01:50.645000+0000","last_active":"2023-10-08T07:01:50.644954+0000","last_peered":"2023-10-08T07:01:50.644954+0000","last_clean":"2023-10-08T07:01:50.644954+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:50.644954+0000","last_undegraded":"2023-10-08T07:01:50.644954+0000","last_fullsized":"2023-10-08T07:01:50.644954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:25.236202+0000","scrub_duration":0.0017188049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:55.773479+0000","last_change":"2023-10-08T07:01:55.773529+0000","last_active":"2023-10-08T07:01:55.773479+0000","last_peered":"2023-10-08T07:01:55.773479+0000","last_clean":"2023-10-08T07:01:55.773479+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:55.773479+0000","last_undegraded":"2023-10-08T07:01:55.773479+0000","last_fullsized":"2023-10-08T07:01:55.773479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_clean_scrub_stamp":"2023-10-08T07:01:55.773378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:40.743189+0000","scrub_duration":0.001795956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:35.079413+0000","last_change":"2023-10-08T07:01:35.079468+0000","last_active":"2023-10-08T07:01:35.079413+0000","last_peered":"2023-10-08T07:01:35.079413+0000","last_clean":"2023-10-08T07:01:35.079413+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:35.079413+0000","last_undegraded":"2023-10-08T07:01:35.079413+0000","last_fullsized":"2023-10-08T07:01:35.079413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_clean_scrub_stamp":"2023-10-08T07:01:35.079301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:18.577402+0000","scrub_duration":0.014529075000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:46.601700+0000","last_change":"2023-10-08T07:01:46.601759+0000","last_active":"2023-10-08T07:01:46.601700+0000","last_peered":"2023-10-08T07:01:46.601700+0000","last_clean":"2023-10-08T07:01:46.601700+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:46.601700+0000","last_undegraded":"2023-10-08T07:01:46.601700+0000","last_fullsized":"2023-10-08T07:01:46.601700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_clean_scrub_stamp":"2023-10-08T07:01:46.601588+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:47.103452+0000","scrub_duration":0.0040752189999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782967+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:11.782967+0000","last_peered":"2023-10-08T07:01:11.782967+0000","last_clean":"2023-10-08T07:01:11.782967+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:11.782967+0000","last_undegraded":"2023-10-08T07:01:11.782967+0000","last_fullsized":"2023-10-08T07:01:11.782967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209279+0000","last_change":"2023-10-08T07:00:58.744415+0000","last_active":"2023-10-08T07:01:19.209279+0000","last_peered":"2023-10-08T07:01:19.209279+0000","last_clean":"2023-10-08T07:01:19.209279+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:01:19.209279+0000","last_undegraded":"2023-10-08T07:01:19.209279+0000","last_fullsized":"2023-10-08T07:01:19.209279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:32.686938+0000","last_change":"2023-10-08T07:01:32.687008+0000","last_active":"2023-10-08T07:01:32.686938+0000","last_peered":"2023-10-08T07:01:32.686938+0000","last_clean":"2023-10-08T07:01:32.686938+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:32.686938+0000","last_undegraded":"2023-10-08T07:01:32.686938+0000","last_fullsized":"2023-10-08T07:01:32.686938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_clean_scrub_stamp":"2023-10-08T07:01:32.686840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:36.443277+0000","scrub_duration":0.0020720539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887814+0000","last_change":"2023-10-08T07:01:09.881985+0000","last_active":"2023-10-08T07:01:10.887814+0000","last_peered":"2023-10-08T07:01:10.887814+0000","last_clean":"2023-10-08T07:01:10.887814+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:01:10.887814+0000","last_undegraded":"2023-10-08T07:01:10.887814+0000","last_fullsized":"2023-10-08T07:01:10.887814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855818+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:10.855818+0000","last_peered":"2023-10-08T07:01:10.855818+0000","last_clean":"2023-10-08T07:01:10.855818+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:10.855818+0000","last_undegraded":"2023-10-08T07:01:10.855818+0000","last_fullsized":"2023-10-08T07:01:10.855818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726486+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:19.726486+0000","last_peered":"2023-10-08T07:01:19.726486+0000","last_clean":"2023-10-08T07:01:19.726486+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:19.726486+0000","last_undegraded":"2023-10-08T07:01:19.726486+0000","last_fullsized":"2023-10-08T07:01:19.726486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612622,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47196,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324644,"statfs":{"total":96636764160,"available":96588435456,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325036,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046804,"statfs":{"total":96636764160,"available":96303927296,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.373,"15min":0.35899999999999999},"min":{"1min":0.39800000000000002,"5min":0.157,"15min":0.157},"max":{"1min":0.73399999999999999,"5min":1.845,"15min":1.845},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.34899999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.998,"15min":1.998},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Oct 8 06:58:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.57399999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.37,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.75900000000000001,"5min":1.518,"15min":1.518},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.434},"min":{"1min":0.34999999999999998,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.70799999999999996,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 07:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.55500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:02:01.432 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.432 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.432 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.432 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.433 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.433 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.433 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.433 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.433 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.433 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.433 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.434 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.435 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.436 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.437 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.438 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.439 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.439 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.439 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.439 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.439 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.439 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.439 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T06:57:05.252014+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=5, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.440 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.441 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.441 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.441 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.441 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.441 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.441 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.441 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.442 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.442 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.442 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.442 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:01.442 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:02:21.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:02:21.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:02:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:02:21.804 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2023-10-08T07:02:21.024494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679208,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436312,"statfs":{"total":289910292480,"available":289214783488,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003110"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726586+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:19.726586+0000","last_peered":"2023-10-08T07:01:19.726586+0000","last_clean":"2023-10-08T07:01:19.726586+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:19.726586+0000","last_undegraded":"2023-10-08T07:01:19.726586+0000","last_fullsized":"2023-10-08T07:01:19.726586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:26.943085+0000","last_change":"2023-10-08T07:01:26.943085+0000","last_active":"2023-10-08T07:01:26.943085+0000","last_peered":"2023-10-08T07:01:26.943085+0000","last_clean":"2023-10-08T07:01:26.943085+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:26.943085+0000","last_undegraded":"2023-10-08T07:01:26.943085+0000","last_fullsized":"2023-10-08T07:01:26.943085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_clean_scrub_stamp":"2023-10-08T07:01:26.942930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:33.364930+0000","scrub_duration":0.0017987770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:12.752541+0000","last_change":"2023-10-08T07:02:12.752610+0000","last_active":"2023-10-08T07:02:12.752541+0000","last_peered":"2023-10-08T07:02:12.752541+0000","last_clean":"2023-10-08T07:02:12.752541+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:02:12.752541+0000","last_undegraded":"2023-10-08T07:02:12.752541+0000","last_fullsized":"2023-10-08T07:02:12.752541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_clean_scrub_stamp":"2023-10-08T07:02:12.752388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.974197+0000","scrub_duration":0.0021934350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.126324+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:19.126324+0000","last_peered":"2023-10-08T07:01:19.126324+0000","last_clean":"2023-10-08T07:01:19.126324+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:19.126324+0000","last_undegraded":"2023-10-08T07:01:19.126324+0000","last_fullsized":"2023-10-08T07:01:19.126324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:21.969248+0000","last_change":"2023-10-08T07:01:21.969248+0000","last_active":"2023-10-08T07:01:21.969248+0000","last_peered":"2023-10-08T07:01:21.969248+0000","last_clean":"2023-10-08T07:01:21.969248+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:21.969248+0000","last_undegraded":"2023-10-08T07:01:21.969248+0000","last_fullsized":"2023-10-08T07:01:21.969248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_clean_scrub_stamp":"2023-10-08T07:01:21.969069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:37.695683+0000","scrub_duration":0.013488305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209422+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:19.209422+0000","last_peered":"2023-10-08T07:01:19.209422+0000","last_clean":"2023-10-08T07:01:19.209422+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:19.209422+0000","last_undegraded":"2023-10-08T07:01:19.209422+0000","last_fullsized":"2023-10-08T07:01:19.209422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:57.750404+0000","last_change":"2023-10-08T07:01:57.750404+0000","last_active":"2023-10-08T07:01:57.750404+0000","last_peered":"2023-10-08T07:01:57.750404+0000","last_clean":"2023-10-08T07:01:57.750404+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:57.750404+0000","last_undegraded":"2023-10-08T07:01:57.750404+0000","last_fullsized":"2023-10-08T07:01:57.750404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_clean_scrub_stamp":"2023-10-08T07:01:57.750253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:45.382652+0000","scrub_duration":0.012901334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:56.730073+0000","last_change":"2023-10-08T07:01:56.730073+0000","last_active":"2023-10-08T07:01:56.730073+0000","last_peered":"2023-10-08T07:01:56.730073+0000","last_clean":"2023-10-08T07:01:56.730073+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:56.730073+0000","last_undegraded":"2023-10-08T07:01:56.730073+0000","last_fullsized":"2023-10-08T07:01:56.730073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_clean_scrub_stamp":"2023-10-08T07:01:56.729910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:33.646540+0000","scrub_duration":0.001731001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.961827+0000","last_change":"2023-10-08T07:02:13.961921+0000","last_active":"2023-10-08T07:02:13.961827+0000","last_peered":"2023-10-08T07:02:13.961827+0000","last_clean":"2023-10-08T07:02:13.961827+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:02:13.961827+0000","last_undegraded":"2023-10-08T07:02:13.961827+0000","last_fullsized":"2023-10-08T07:02:13.961827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.961668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:45.329692+0000","scrub_duration":0.024638136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.174431+0000","last_change":"2023-10-08T07:01:45.174431+0000","last_active":"2023-10-08T07:01:45.174431+0000","last_peered":"2023-10-08T07:01:45.174431+0000","last_clean":"2023-10-08T07:01:45.174431+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:45.174431+0000","last_undegraded":"2023-10-08T07:01:45.174431+0000","last_fullsized":"2023-10-08T07:01:45.174431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.174265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:07.913029+0000","scrub_duration":0.002167066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209380+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:19.209380+0000","last_peered":"2023-10-08T07:01:19.209380+0000","last_clean":"2023-10-08T07:01:19.209380+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:19.209380+0000","last_undegraded":"2023-10-08T07:01:19.209380+0000","last_fullsized":"2023-10-08T07:01:19.209380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887480+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:10.887480+0000","last_peered":"2023-10-08T07:01:10.887480+0000","last_clean":"2023-10-08T07:01:10.887480+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:10.887480+0000","last_undegraded":"2023-10-08T07:01:10.887480+0000","last_fullsized":"2023-10-08T07:01:10.887480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726496+0000","last_change":"2023-10-08T07:01:09.879883+0000","last_active":"2023-10-08T07:01:19.726496+0000","last_peered":"2023-10-08T07:01:19.726496+0000","last_clean":"2023-10-08T07:01:19.726496+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:01:19.726496+0000","last_undegraded":"2023-10-08T07:01:19.726496+0000","last_fullsized":"2023-10-08T07:01:19.726496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209365+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:19.209365+0000","last_peered":"2023-10-08T07:01:19.209365+0000","last_clean":"2023-10-08T07:01:19.209365+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:19.209365+0000","last_undegraded":"2023-10-08T07:01:19.209365+0000","last_fullsized":"2023-10-08T07:01:19.209365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209295+0000","last_change":"2023-10-08T06:57:17.334406+0000","last_active":"2023-10-08T07:01:19.209295+0000","last_peered":"2023-10-08T07:01:19.209295+0000","last_clean":"2023-10-08T07:01:19.209295+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:01:19.209295+0000","last_undegraded":"2023-10-08T07:01:19.209295+0000","last_fullsized":"2023-10-08T07:01:19.209295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.693294+0000","last_change":"2023-10-08T07:02:06.693347+0000","last_active":"2023-10-08T07:02:06.693294+0000","last_peered":"2023-10-08T07:02:06.693294+0000","last_clean":"2023-10-08T07:02:06.693294+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:02:06.693294+0000","last_undegraded":"2023-10-08T07:02:06.693294+0000","last_fullsized":"2023-10-08T07:02:06.693294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.693202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:51.323946+0000","scrub_duration":0.001534101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.688380+0000","last_change":"2023-10-08T07:01:50.688440+0000","last_active":"2023-10-08T07:01:50.688380+0000","last_peered":"2023-10-08T07:01:50.688380+0000","last_clean":"2023-10-08T07:01:50.688380+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:50.688380+0000","last_undegraded":"2023-10-08T07:01:50.688380+0000","last_fullsized":"2023-10-08T07:01:50.688380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.688235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:07.345735+0000","scrub_duration":0.058960934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.178032+0000","last_change":"2023-10-08T07:02:04.178077+0000","last_active":"2023-10-08T07:02:04.178032+0000","last_peered":"2023-10-08T07:02:04.178032+0000","last_clean":"2023-10-08T07:02:04.178032+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:02:04.178032+0000","last_undegraded":"2023-10-08T07:02:04.178032+0000","last_fullsized":"2023-10-08T07:02:04.178032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.177926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.809779+0000","scrub_duration":0.001839074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:09.853908+0000","last_change":"2023-10-08T07:02:09.853986+0000","last_active":"2023-10-08T07:02:09.853908+0000","last_peered":"2023-10-08T07:02:09.853908+0000","last_clean":"2023-10-08T07:02:09.853908+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:02:09.853908+0000","last_undegraded":"2023-10-08T07:02:09.853908+0000","last_fullsized":"2023-10-08T07:02:09.853908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_clean_scrub_stamp":"2023-10-08T07:02:09.853744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:31:03.195743+0000","scrub_duration":0.02129166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209296+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:19.209296+0000","last_peered":"2023-10-08T07:01:19.209296+0000","last_clean":"2023-10-08T07:01:19.209296+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:19.209296+0000","last_undegraded":"2023-10-08T07:01:19.209296+0000","last_fullsized":"2023-10-08T07:01:19.209296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:31.610403+0000","last_change":"2023-10-08T07:01:31.610403+0000","last_active":"2023-10-08T07:01:31.610403+0000","last_peered":"2023-10-08T07:01:31.610403+0000","last_clean":"2023-10-08T07:01:31.610403+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:31.610403+0000","last_undegraded":"2023-10-08T07:01:31.610403+0000","last_fullsized":"2023-10-08T07:01:31.610403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_clean_scrub_stamp":"2023-10-08T07:01:31.610144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:26.179749+0000","scrub_duration":0.024703487999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887318+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:10.887318+0000","last_peered":"2023-10-08T07:01:10.887318+0000","last_clean":"2023-10-08T07:01:10.887318+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:10.887318+0000","last_undegraded":"2023-10-08T07:01:10.887318+0000","last_fullsized":"2023-10-08T07:01:10.887318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.817152+0000","last_change":"2023-10-08T07:02:00.817194+0000","last_active":"2023-10-08T07:02:00.817152+0000","last_peered":"2023-10-08T07:02:00.817152+0000","last_clean":"2023-10-08T07:02:00.817152+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:02:00.817152+0000","last_undegraded":"2023-10-08T07:02:00.817152+0000","last_fullsized":"2023-10-08T07:02:00.817152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.817055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:43.652542+0000","scrub_duration":0.0020658320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.987480+0000","last_change":"2023-10-08T07:01:24.987480+0000","last_active":"2023-10-08T07:01:24.987480+0000","last_peered":"2023-10-08T07:01:24.987480+0000","last_clean":"2023-10-08T07:01:24.987480+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:24.987480+0000","last_undegraded":"2023-10-08T07:01:24.987480+0000","last_fullsized":"2023-10-08T07:01:24.987480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.987290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:07.099956+0000","scrub_duration":0.0019193140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726453+0000","last_change":"2023-10-08T06:57:17.333902+0000","last_active":"2023-10-08T07:01:19.726453+0000","last_peered":"2023-10-08T07:01:19.726453+0000","last_clean":"2023-10-08T07:01:19.726453+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:01:19.726453+0000","last_undegraded":"2023-10-08T07:01:19.726453+0000","last_fullsized":"2023-10-08T07:01:19.726453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856279+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:10.856279+0000","last_peered":"2023-10-08T07:01:10.856279+0000","last_clean":"2023-10-08T07:01:10.856279+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:10.856279+0000","last_undegraded":"2023-10-08T07:01:10.856279+0000","last_fullsized":"2023-10-08T07:01:10.856279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:08.671486+0000","last_change":"2023-10-08T07:02:08.671550+0000","last_active":"2023-10-08T07:02:08.671486+0000","last_peered":"2023-10-08T07:02:08.671486+0000","last_clean":"2023-10-08T07:02:08.671486+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:02:08.671486+0000","last_undegraded":"2023-10-08T07:02:08.671486+0000","last_fullsized":"2023-10-08T07:02:08.671486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_clean_scrub_stamp":"2023-10-08T07:02:08.671339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:29.879286+0000","scrub_duration":0.001757886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726163+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:19.726163+0000","last_peered":"2023-10-08T07:01:19.726163+0000","last_clean":"2023-10-08T07:01:19.726163+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726163+0000","last_undegraded":"2023-10-08T07:01:19.726163+0000","last_fullsized":"2023-10-08T07:01:19.726163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:05.217103+0000","last_change":"2023-10-08T07:02:05.217103+0000","last_active":"2023-10-08T07:02:05.217103+0000","last_peered":"2023-10-08T07:02:05.217103+0000","last_clean":"2023-10-08T07:02:05.217103+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:02:05.217103+0000","last_undegraded":"2023-10-08T07:02:05.217103+0000","last_fullsized":"2023-10-08T07:02:05.217103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_clean_scrub_stamp":"2023-10-08T07:02:05.216949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:39.808310+0000","scrub_duration":0.0020402969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855219+0000","last_change":"2023-10-08T07:00:58.667973+0000","last_active":"2023-10-08T07:01:10.855219+0000","last_peered":"2023-10-08T07:01:10.855219+0000","last_clean":"2023-10-08T07:01:10.855219+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:01:10.855219+0000","last_undegraded":"2023-10-08T07:01:10.855219+0000","last_fullsized":"2023-10-08T07:01:10.855219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856331+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:10.856331+0000","last_peered":"2023-10-08T07:01:10.856331+0000","last_clean":"2023-10-08T07:01:10.856331+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:10.856331+0000","last_undegraded":"2023-10-08T07:01:10.856331+0000","last_fullsized":"2023-10-08T07:01:10.856331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:59.853347+0000","last_change":"2023-10-08T07:01:59.853394+0000","last_active":"2023-10-08T07:01:59.853347+0000","last_peered":"2023-10-08T07:01:59.853347+0000","last_clean":"2023-10-08T07:01:59.853347+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:59.853347+0000","last_undegraded":"2023-10-08T07:01:59.853347+0000","last_fullsized":"2023-10-08T07:01:59.853347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_clean_scrub_stamp":"2023-10-08T07:01:59.853244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:32.293985+0000","scrub_duration":0.002167183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:11.225174+0000","last_change":"2023-10-08T07:02:11.225253+0000","last_active":"2023-10-08T07:02:11.225174+0000","last_peered":"2023-10-08T07:02:11.225174+0000","last_clean":"2023-10-08T07:02:11.225174+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:02:11.225174+0000","last_undegraded":"2023-10-08T07:02:11.225174+0000","last_fullsized":"2023-10-08T07:02:11.225174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_clean_scrub_stamp":"2023-10-08T07:02:11.225019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:48.141649+0000","scrub_duration":0.067035265999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856372+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:10.856372+0000","last_peered":"2023-10-08T07:01:10.856372+0000","last_clean":"2023-10-08T07:01:10.856372+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:10.856372+0000","last_undegraded":"2023-10-08T07:01:10.856372+0000","last_fullsized":"2023-10-08T07:01:10.856372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855080+0000","last_change":"2023-10-08T07:00:58.668094+0000","last_active":"2023-10-08T07:01:10.855080+0000","last_peered":"2023-10-08T07:01:10.855080+0000","last_clean":"2023-10-08T07:01:10.855080+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:01:10.855080+0000","last_undegraded":"2023-10-08T07:01:10.855080+0000","last_fullsized":"2023-10-08T07:01:10.855080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:30.574748+0000","last_change":"2023-10-08T07:01:30.574748+0000","last_active":"2023-10-08T07:01:30.574748+0000","last_peered":"2023-10-08T07:01:30.574748+0000","last_clean":"2023-10-08T07:01:30.574748+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:30.574748+0000","last_undegraded":"2023-10-08T07:01:30.574748+0000","last_fullsized":"2023-10-08T07:01:30.574748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_clean_scrub_stamp":"2023-10-08T07:01:30.574594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:52.811528+0000","scrub_duration":0.0024001500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855631+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:10.855631+0000","last_peered":"2023-10-08T07:01:10.855631+0000","last_clean":"2023-10-08T07:01:10.855631+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:10.855631+0000","last_undegraded":"2023-10-08T07:01:10.855631+0000","last_fullsized":"2023-10-08T07:01:10.855631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726137+0000","last_change":"2023-10-08T06:57:16.322232+0000","last_active":"2023-10-08T07:01:19.726137+0000","last_peered":"2023-10-08T07:01:19.726137+0000","last_clean":"2023-10-08T07:01:19.726137+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:01:19.726137+0000","last_undegraded":"2023-10-08T07:01:19.726137+0000","last_fullsized":"2023-10-08T07:01:19.726137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855235+0000","last_change":"2023-10-08T07:00:58.668156+0000","last_active":"2023-10-08T07:01:10.855235+0000","last_peered":"2023-10-08T07:01:10.855235+0000","last_clean":"2023-10-08T07:01:10.855235+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:01:10.855235+0000","last_undegraded":"2023-10-08T07:01:10.855235+0000","last_fullsized":"2023-10-08T07:01:10.855235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209022+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:19.209022+0000","last_peered":"2023-10-08T07:01:19.209022+0000","last_clean":"2023-10-08T07:01:19.209022+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:19.209022+0000","last_undegraded":"2023-10-08T07:01:19.209022+0000","last_fullsized":"2023-10-08T07:01:19.209022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209193+0000","last_change":"2023-10-08T06:57:17.334438+0000","last_active":"2023-10-08T07:01:19.209193+0000","last_peered":"2023-10-08T07:01:19.209193+0000","last_clean":"2023-10-08T07:01:19.209193+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:01:19.209193+0000","last_undegraded":"2023-10-08T07:01:19.209193+0000","last_fullsized":"2023-10-08T07:01:19.209193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209043+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:19.209043+0000","last_peered":"2023-10-08T07:01:19.209043+0000","last_clean":"2023-10-08T07:01:19.209043+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:19.209043+0000","last_undegraded":"2023-10-08T07:01:19.209043+0000","last_fullsized":"2023-10-08T07:01:19.209043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726352+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:19.726352+0000","last_peered":"2023-10-08T07:01:19.726352+0000","last_clean":"2023-10-08T07:01:19.726352+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:19.726352+0000","last_undegraded":"2023-10-08T07:01:19.726352+0000","last_fullsized":"2023-10-08T07:01:19.726352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855387+0000","last_change":"2023-10-08T07:00:58.669535+0000","last_active":"2023-10-08T07:01:10.855387+0000","last_peered":"2023-10-08T07:01:10.855387+0000","last_clean":"2023-10-08T07:01:10.855387+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:01:10.855387+0000","last_undegraded":"2023-10-08T07:01:10.855387+0000","last_fullsized":"2023-10-08T07:01:10.855387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726354+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:19.726354+0000","last_peered":"2023-10-08T07:01:19.726354+0000","last_clean":"2023-10-08T07:01:19.726354+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:19.726354+0000","last_undegraded":"2023-10-08T07:01:19.726354+0000","last_fullsized":"2023-10-08T07:01:19.726354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726094+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:19.726094+0000","last_peered":"2023-10-08T07:01:19.726094+0000","last_clean":"2023-10-08T07:01:19.726094+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:19.726094+0000","last_undegraded":"2023-10-08T07:01:19.726094+0000","last_fullsized":"2023-10-08T07:01:19.726094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856200+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:10.856200+0000","last_peered":"2023-10-08T07:01:10.856200+0000","last_clean":"2023-10-08T07:01:10.856200+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:10.856200+0000","last_undegraded":"2023-10-08T07:01:10.856200+0000","last_fullsized":"2023-10-08T07:01:10.856200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208996+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:19.208996+0000","last_peered":"2023-10-08T07:01:19.208996+0000","last_clean":"2023-10-08T07:01:19.208996+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:19.208996+0000","last_undegraded":"2023-10-08T07:01:19.208996+0000","last_fullsized":"2023-10-08T07:01:19.208996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856459+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:10.856459+0000","last_peered":"2023-10-08T07:01:10.856459+0000","last_clean":"2023-10-08T07:01:10.856459+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:10.856459+0000","last_undegraded":"2023-10-08T07:01:10.856459+0000","last_fullsized":"2023-10-08T07:01:10.856459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208986+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:19.208986+0000","last_peered":"2023-10-08T07:01:19.208986+0000","last_clean":"2023-10-08T07:01:19.208986+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:19.208986+0000","last_undegraded":"2023-10-08T07:01:19.208986+0000","last_fullsized":"2023-10-08T07:01:19.208986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726302+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:19.726302+0000","last_peered":"2023-10-08T07:01:19.726302+0000","last_clean":"2023-10-08T07:01:19.726302+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:19.726302+0000","last_undegraded":"2023-10-08T07:01:19.726302+0000","last_fullsized":"2023-10-08T07:01:19.726302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726126+0000","last_change":"2023-10-08T06:57:16.321936+0000","last_active":"2023-10-08T07:01:19.726126+0000","last_peered":"2023-10-08T07:01:19.726126+0000","last_clean":"2023-10-08T07:01:19.726126+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:01:19.726126+0000","last_undegraded":"2023-10-08T07:01:19.726126+0000","last_fullsized":"2023-10-08T07:01:19.726126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:48.225570+0000","last_change":"2023-10-08T07:01:48.225616+0000","last_active":"2023-10-08T07:01:48.225570+0000","last_peered":"2023-10-08T07:01:48.225570+0000","last_clean":"2023-10-08T07:01:48.225570+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:48.225570+0000","last_undegraded":"2023-10-08T07:01:48.225570+0000","last_fullsized":"2023-10-08T07:01:48.225570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_clean_scrub_stamp":"2023-10-08T07:01:48.225481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:42.795086+0000","scrub_duration":0.001625563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209001+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:19.209001+0000","last_peered":"2023-10-08T07:01:19.209001+0000","last_clean":"2023-10-08T07:01:19.209001+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:19.209001+0000","last_undegraded":"2023-10-08T07:01:19.209001+0000","last_fullsized":"2023-10-08T07:01:19.209001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209124+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:19.209124+0000","last_peered":"2023-10-08T07:01:19.209124+0000","last_clean":"2023-10-08T07:01:19.209124+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:19.209124+0000","last_undegraded":"2023-10-08T07:01:19.209124+0000","last_fullsized":"2023-10-08T07:01:19.209124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:10.762620+0000","last_change":"2023-10-08T07:02:10.762696+0000","last_active":"2023-10-08T07:02:10.762620+0000","last_peered":"2023-10-08T07:02:10.762620+0000","last_clean":"2023-10-08T07:02:10.762620+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:02:10.762620+0000","last_undegraded":"2023-10-08T07:02:10.762620+0000","last_fullsized":"2023-10-08T07:02:10.762620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_clean_scrub_stamp":"2023-10-08T07:02:10.762509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:26.540080+0000","scrub_duration":0.001712603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:01.817759+0000","last_change":"2023-10-08T07:02:01.817861+0000","last_active":"2023-10-08T07:02:01.817759+0000","last_peered":"2023-10-08T07:02:01.817759+0000","last_clean":"2023-10-08T07:02:01.817759+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:02:01.817759+0000","last_undegraded":"2023-10-08T07:02:01.817759+0000","last_fullsized":"2023-10-08T07:02:01.817759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_clean_scrub_stamp":"2023-10-08T07:02:01.817590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:34.561641+0000","scrub_duration":0.020576817000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855601+0000","last_change":"2023-10-08T07:00:58.669615+0000","last_active":"2023-10-08T07:01:10.855601+0000","last_peered":"2023-10-08T07:01:10.855601+0000","last_clean":"2023-10-08T07:01:10.855601+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:01:10.855601+0000","last_undegraded":"2023-10-08T07:01:10.855601+0000","last_fullsized":"2023-10-08T07:01:10.855601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209140+0000","last_change":"2023-10-08T07:00:58.741622+0000","last_active":"2023-10-08T07:01:19.209140+0000","last_peered":"2023-10-08T07:01:19.209140+0000","last_clean":"2023-10-08T07:01:19.209140+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:01:19.209140+0000","last_undegraded":"2023-10-08T07:01:19.209140+0000","last_fullsized":"2023-10-08T07:01:19.209140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:51.695304+0000","last_change":"2023-10-08T07:01:51.695353+0000","last_active":"2023-10-08T07:01:51.695304+0000","last_peered":"2023-10-08T07:01:51.695304+0000","last_clean":"2023-10-08T07:01:51.695304+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:51.695304+0000","last_undegraded":"2023-10-08T07:01:51.695304+0000","last_fullsized":"2023-10-08T07:01:51.695304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_clean_scrub_stamp":"2023-10-08T07:01:51.695202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.269000+0000","scrub_duration":0.001739123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209139+0000","last_change":"2023-10-08T06:57:17.337015+0000","last_active":"2023-10-08T07:01:19.209139+0000","last_peered":"2023-10-08T07:01:19.209139+0000","last_clean":"2023-10-08T07:01:19.209139+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:01:19.209139+0000","last_undegraded":"2023-10-08T07:01:19.209139+0000","last_fullsized":"2023-10-08T07:01:19.209139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:22.981405+0000","last_change":"2023-10-08T07:01:22.981449+0000","last_active":"2023-10-08T07:01:22.981405+0000","last_peered":"2023-10-08T07:01:22.981405+0000","last_clean":"2023-10-08T07:01:22.981405+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:22.981405+0000","last_undegraded":"2023-10-08T07:01:22.981405+0000","last_fullsized":"2023-10-08T07:01:22.981405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_clean_scrub_stamp":"2023-10-08T07:01:22.981312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:27.955182+0000","scrub_duration":0.0020775799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.688387+0000","last_change":"2023-10-08T07:02:04.688434+0000","last_active":"2023-10-08T07:02:04.688387+0000","last_peered":"2023-10-08T07:02:04.688387+0000","last_clean":"2023-10-08T07:02:04.688387+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:02:04.688387+0000","last_undegraded":"2023-10-08T07:02:04.688387+0000","last_fullsized":"2023-10-08T07:02:04.688387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.688267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:43.315446+0000","scrub_duration":0.0020964360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.038967+0000","last_change":"2023-10-08T07:01:39.038967+0000","last_active":"2023-10-08T07:01:39.038967+0000","last_peered":"2023-10-08T07:01:39.038967+0000","last_clean":"2023-10-08T07:01:39.038967+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:39.038967+0000","last_undegraded":"2023-10-08T07:01:39.038967+0000","last_fullsized":"2023-10-08T07:01:39.038967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.038786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:33.889107+0000","scrub_duration":0.0024023780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:49.638640+0000","last_change":"2023-10-08T07:01:49.638700+0000","last_active":"2023-10-08T07:01:49.638640+0000","last_peered":"2023-10-08T07:01:49.638640+0000","last_clean":"2023-10-08T07:01:49.638640+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:49.638640+0000","last_undegraded":"2023-10-08T07:01:49.638640+0000","last_fullsized":"2023-10-08T07:01:49.638640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_clean_scrub_stamp":"2023-10-08T07:01:49.638527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:19.403345+0000","scrub_duration":0.045952461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:23.787068+0000","last_change":"2023-10-08T07:01:23.787118+0000","last_active":"2023-10-08T07:01:23.787068+0000","last_peered":"2023-10-08T07:01:23.787068+0000","last_clean":"2023-10-08T07:01:23.787068+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:23.787068+0000","last_undegraded":"2023-10-08T07:01:23.787068+0000","last_fullsized":"2023-10-08T07:01:23.787068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_clean_scrub_stamp":"2023-10-08T07:01:23.786970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:11.680051+0000","scrub_duration":0.0020370760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208905+0000","last_change":"2023-10-08T07:00:58.741773+0000","last_active":"2023-10-08T07:01:19.208905+0000","last_peered":"2023-10-08T07:01:19.208905+0000","last_clean":"2023-10-08T07:01:19.208905+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:01:19.208905+0000","last_undegraded":"2023-10-08T07:01:19.208905+0000","last_fullsized":"2023-10-08T07:01:19.208905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.237498+0000","last_change":"2023-10-08T07:02:00.237563+0000","last_active":"2023-10-08T07:02:00.237498+0000","last_peered":"2023-10-08T07:02:00.237498+0000","last_clean":"2023-10-08T07:02:00.237498+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:02:00.237498+0000","last_undegraded":"2023-10-08T07:02:00.237498+0000","last_fullsized":"2023-10-08T07:02:00.237498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.237364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:16.425225+0000","scrub_duration":0.0020507379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:44.684847+0000","last_change":"2023-10-08T07:01:44.684911+0000","last_active":"2023-10-08T07:01:44.684847+0000","last_peered":"2023-10-08T07:01:44.684847+0000","last_clean":"2023-10-08T07:01:44.684847+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:44.684847+0000","last_undegraded":"2023-10-08T07:01:44.684847+0000","last_fullsized":"2023-10-08T07:01:44.684847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_clean_scrub_stamp":"2023-10-08T07:01:44.684726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:06.172009+0000","scrub_duration":0.0021191029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208976+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:19.208976+0000","last_peered":"2023-10-08T07:01:19.208976+0000","last_clean":"2023-10-08T07:01:19.208976+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:19.208976+0000","last_undegraded":"2023-10-08T07:01:19.208976+0000","last_fullsized":"2023-10-08T07:01:19.208976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.560363+0000","last_change":"2023-10-08T07:01:45.560412+0000","last_active":"2023-10-08T07:01:45.560363+0000","last_peered":"2023-10-08T07:01:45.560363+0000","last_clean":"2023-10-08T07:01:45.560363+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:45.560363+0000","last_undegraded":"2023-10-08T07:01:45.560363+0000","last_fullsized":"2023-10-08T07:01:45.560363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.560260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:37.159112+0000","scrub_duration":0.0017976050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:27.690641+0000","last_change":"2023-10-08T07:01:27.690692+0000","last_active":"2023-10-08T07:01:27.690641+0000","last_peered":"2023-10-08T07:01:27.690641+0000","last_clean":"2023-10-08T07:01:27.690641+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:27.690641+0000","last_undegraded":"2023-10-08T07:01:27.690641+0000","last_fullsized":"2023-10-08T07:01:27.690641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_clean_scrub_stamp":"2023-10-08T07:01:27.690553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.772607+0000","scrub_duration":0.0017559400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.178065+0000","last_change":"2023-10-08T07:02:06.178108+0000","last_active":"2023-10-08T07:02:06.178065+0000","last_peered":"2023-10-08T07:02:06.178065+0000","last_clean":"2023-10-08T07:02:06.178065+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:02:06.178065+0000","last_undegraded":"2023-10-08T07:02:06.178065+0000","last_fullsized":"2023-10-08T07:02:06.178065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.177967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:14.751766+0000","scrub_duration":0.001743947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856431+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:10.856431+0000","last_peered":"2023-10-08T07:01:10.856431+0000","last_clean":"2023-10-08T07:01:10.856431+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:10.856431+0000","last_undegraded":"2023-10-08T07:01:10.856431+0000","last_fullsized":"2023-10-08T07:01:10.856431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208866+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:19.208866+0000","last_peered":"2023-10-08T07:01:19.208866+0000","last_clean":"2023-10-08T07:01:19.208866+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:19.208866+0000","last_undegraded":"2023-10-08T07:01:19.208866+0000","last_fullsized":"2023-10-08T07:01:19.208866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":277,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:11.782751+0000","last_change":"2023-10-08T06:57:06.271944+0000","last_active":"2023-10-08T07:01:11.782751+0000","last_peered":"2023-10-08T07:01:11.782751+0000","last_clean":"2023-10-08T07:01:11.782751+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:01:11.782751+0000","last_undegraded":"2023-10-08T07:01:11.782751+0000","last_fullsized":"2023-10-08T07:01:11.782751+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:05.252014+0000","last_clean_scrub_stamp":"2023-10-08T06:57:05.252014+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.763443+0000","last_change":"2023-10-08T07:01:24.763513+0000","last_active":"2023-10-08T07:01:24.763443+0000","last_peered":"2023-10-08T07:01:24.763443+0000","last_clean":"2023-10-08T07:01:24.763443+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:24.763443+0000","last_undegraded":"2023-10-08T07:01:24.763443+0000","last_fullsized":"2023-10-08T07:01:24.763443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.763341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:32.962887+0000","scrub_duration":0.0020468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.675374+0000","last_change":"2023-10-08T07:02:16.675417+0000","last_active":"2023-10-08T07:02:16.675374+0000","last_peered":"2023-10-08T07:02:16.675374+0000","last_clean":"2023-10-08T07:02:16.675374+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:02:16.675374+0000","last_undegraded":"2023-10-08T07:02:16.675374+0000","last_fullsized":"2023-10-08T07:02:16.675374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.675273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:47:21.079374+0000","scrub_duration":0.0018053679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:14.125450+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:14.125450+0000","last_peered":"2023-10-08T07:01:14.125450+0000","last_clean":"2023-10-08T07:01:14.125450+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:14.125450+0000","last_undegraded":"2023-10-08T07:01:14.125450+0000","last_fullsized":"2023-10-08T07:01:14.125450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855141+0000","last_change":"2023-10-08T07:00:58.668539+0000","last_active":"2023-10-08T07:01:10.855141+0000","last_peered":"2023-10-08T07:01:10.855141+0000","last_clean":"2023-10-08T07:01:10.855141+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:01:10.855141+0000","last_undegraded":"2023-10-08T07:01:10.855141+0000","last_fullsized":"2023-10-08T07:01:10.855141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726305+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:19.726305+0000","last_peered":"2023-10-08T07:01:19.726305+0000","last_clean":"2023-10-08T07:01:19.726305+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:19.726305+0000","last_undegraded":"2023-10-08T07:01:19.726305+0000","last_fullsized":"2023-10-08T07:01:19.726305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726096+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:19.726096+0000","last_peered":"2023-10-08T07:01:19.726096+0000","last_clean":"2023-10-08T07:01:19.726096+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726096+0000","last_undegraded":"2023-10-08T07:01:19.726096+0000","last_fullsized":"2023-10-08T07:01:19.726096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:58.847293+0000","last_change":"2023-10-08T07:01:58.847357+0000","last_active":"2023-10-08T07:01:58.847293+0000","last_peered":"2023-10-08T07:01:58.847293+0000","last_clean":"2023-10-08T07:01:58.847293+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:58.847293+0000","last_undegraded":"2023-10-08T07:01:58.847293+0000","last_fullsized":"2023-10-08T07:01:58.847293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_clean_scrub_stamp":"2023-10-08T07:01:58.847143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:41.440486+0000","scrub_duration":0.0019445949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726279+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:19.726279+0000","last_peered":"2023-10-08T07:01:19.726279+0000","last_clean":"2023-10-08T07:01:19.726279+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:19.726279+0000","last_undegraded":"2023-10-08T07:01:19.726279+0000","last_fullsized":"2023-10-08T07:01:19.726279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856207+0000","last_change":"2023-10-08T07:00:58.690184+0000","last_active":"2023-10-08T07:01:10.856207+0000","last_peered":"2023-10-08T07:01:10.856207+0000","last_clean":"2023-10-08T07:01:10.856207+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:01:10.856207+0000","last_undegraded":"2023-10-08T07:01:10.856207+0000","last_fullsized":"2023-10-08T07:01:10.856207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855980+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:10.855980+0000","last_peered":"2023-10-08T07:01:10.855980+0000","last_clean":"2023-10-08T07:01:10.855980+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:10.855980+0000","last_undegraded":"2023-10-08T07:01:10.855980+0000","last_fullsized":"2023-10-08T07:01:10.855980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855047+0000","last_change":"2023-10-08T07:00:58.669377+0000","last_active":"2023-10-08T07:01:10.855047+0000","last_peered":"2023-10-08T07:01:10.855047+0000","last_clean":"2023-10-08T07:01:10.855047+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:01:10.855047+0000","last_undegraded":"2023-10-08T07:01:10.855047+0000","last_fullsized":"2023-10-08T07:01:10.855047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208921+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:19.208921+0000","last_peered":"2023-10-08T07:01:19.208921+0000","last_clean":"2023-10-08T07:01:19.208921+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:19.208921+0000","last_undegraded":"2023-10-08T07:01:19.208921+0000","last_fullsized":"2023-10-08T07:01:19.208921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"80'2","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.576981+0000","last_change":"2023-10-08T07:01:39.577040+0000","last_active":"2023-10-08T07:01:39.576981+0000","last_peered":"2023-10-08T07:01:39.576981+0000","last_clean":"2023-10-08T07:01:39.576981+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:39.576981+0000","last_undegraded":"2023-10-08T07:01:39.576981+0000","last_fullsized":"2023-10-08T07:01:39.576981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.576897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:14.587630+0000","scrub_duration":0.0034481989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:18.216128+0000","last_change":"2023-10-08T07:02:18.216182+0000","last_active":"2023-10-08T07:02:18.216128+0000","last_peered":"2023-10-08T07:02:18.216128+0000","last_clean":"2023-10-08T07:02:18.216128+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:02:18.216128+0000","last_undegraded":"2023-10-08T07:02:18.216128+0000","last_fullsized":"2023-10-08T07:02:18.216128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_clean_scrub_stamp":"2023-10-08T07:02:18.216021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:56.843200+0000","scrub_duration":0.001736359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726188+0000","last_change":"2023-10-08T06:57:16.321692+0000","last_active":"2023-10-08T07:01:19.726188+0000","last_peered":"2023-10-08T07:01:19.726188+0000","last_clean":"2023-10-08T07:01:19.726188+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:01:19.726188+0000","last_undegraded":"2023-10-08T07:01:19.726188+0000","last_fullsized":"2023-10-08T07:01:19.726188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.216225+0000","last_change":"2023-10-08T07:01:50.216225+0000","last_active":"2023-10-08T07:01:50.216225+0000","last_peered":"2023-10-08T07:01:50.216225+0000","last_clean":"2023-10-08T07:01:50.216225+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:50.216225+0000","last_undegraded":"2023-10-08T07:01:50.216225+0000","last_fullsized":"2023-10-08T07:01:50.216225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.215973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:05.464123+0000","scrub_duration":0.002109798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"80'3","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:37.613532+0000","last_change":"2023-10-08T07:01:37.613532+0000","last_active":"2023-10-08T07:01:37.613532+0000","last_peered":"2023-10-08T07:01:37.613532+0000","last_clean":"2023-10-08T07:01:37.613532+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:37.613532+0000","last_undegraded":"2023-10-08T07:01:37.613532+0000","last_fullsized":"2023-10-08T07:01:37.613532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_clean_scrub_stamp":"2023-10-08T07:01:37.613340+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:13:09.671822+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:28.609729+0000","last_change":"2023-10-08T07:01:28.609729+0000","last_active":"2023-10-08T07:01:28.609729+0000","last_peered":"2023-10-08T07:01:28.609729+0000","last_clean":"2023-10-08T07:01:28.609729+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:28.609729+0000","last_undegraded":"2023-10-08T07:01:28.609729+0000","last_fullsized":"2023-10-08T07:01:28.609729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_clean_scrub_stamp":"2023-10-08T07:01:28.609502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:34.613067+0000","scrub_duration":0.042684845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726209+0000","last_change":"2023-10-08T06:57:16.322766+0000","last_active":"2023-10-08T07:01:19.726209+0000","last_peered":"2023-10-08T07:01:19.726209+0000","last_clean":"2023-10-08T07:01:19.726209+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:01:19.726209+0000","last_undegraded":"2023-10-08T07:01:19.726209+0000","last_fullsized":"2023-10-08T07:01:19.726209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.645000+0000","last_change":"2023-10-08T07:01:50.645000+0000","last_active":"2023-10-08T07:01:50.645000+0000","last_peered":"2023-10-08T07:01:50.645000+0000","last_clean":"2023-10-08T07:01:50.645000+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:50.645000+0000","last_undegraded":"2023-10-08T07:01:50.645000+0000","last_fullsized":"2023-10-08T07:01:50.645000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:25.236202+0000","scrub_duration":0.0017188049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:55.773479+0000","last_change":"2023-10-08T07:01:55.773529+0000","last_active":"2023-10-08T07:01:55.773479+0000","last_peered":"2023-10-08T07:01:55.773479+0000","last_clean":"2023-10-08T07:01:55.773479+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:55.773479+0000","last_undegraded":"2023-10-08T07:01:55.773479+0000","last_fullsized":"2023-10-08T07:01:55.773479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_clean_scrub_stamp":"2023-10-08T07:01:55.773378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:40.743189+0000","scrub_duration":0.001795956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:35.079468+0000","last_change":"2023-10-08T07:01:35.079468+0000","last_active":"2023-10-08T07:01:35.079468+0000","last_peered":"2023-10-08T07:01:35.079468+0000","last_clean":"2023-10-08T07:01:35.079468+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:35.079468+0000","last_undegraded":"2023-10-08T07:01:35.079468+0000","last_fullsized":"2023-10-08T07:01:35.079468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_clean_scrub_stamp":"2023-10-08T07:01:35.079301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:18.577402+0000","scrub_duration":0.014529075000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:46.601700+0000","last_change":"2023-10-08T07:01:46.601759+0000","last_active":"2023-10-08T07:01:46.601700+0000","last_peered":"2023-10-08T07:01:46.601700+0000","last_clean":"2023-10-08T07:01:46.601700+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:46.601700+0000","last_undegraded":"2023-10-08T07:01:46.601700+0000","last_fullsized":"2023-10-08T07:01:46.601700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_clean_scrub_stamp":"2023-10-08T07:01:46.601588+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:47.103452+0000","scrub_duration":0.0040752189999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209199+0000","last_change":"2023-10-08T07:00:58.743716+0000","last_active":"2023-10-08T07:01:19.209199+0000","last_peered":"2023-10-08T07:01:19.209199+0000","last_clean":"2023-10-08T07:01:19.209199+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:01:19.209199+0000","last_undegraded":"2023-10-08T07:01:19.209199+0000","last_fullsized":"2023-10-08T07:01:19.209199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.717435+0000","last_change":"2023-10-08T07:02:13.717480+0000","last_active":"2023-10-08T07:02:13.717435+0000","last_peered":"2023-10-08T07:02:13.717435+0000","last_clean":"2023-10-08T07:02:13.717435+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:02:13.717435+0000","last_undegraded":"2023-10-08T07:02:13.717435+0000","last_fullsized":"2023-10-08T07:02:13.717435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:25.008447+0000","scrub_duration":0.001854704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:32.686938+0000","last_change":"2023-10-08T07:01:32.687008+0000","last_active":"2023-10-08T07:01:32.686938+0000","last_peered":"2023-10-08T07:01:32.686938+0000","last_clean":"2023-10-08T07:01:32.686938+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:32.686938+0000","last_undegraded":"2023-10-08T07:01:32.686938+0000","last_fullsized":"2023-10-08T07:01:32.686938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_clean_scrub_stamp":"2023-10-08T07:01:32.686840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:36.443277+0000","scrub_duration":0.0020720539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.174655+0000","last_change":"2023-10-08T07:02:13.174730+0000","last_active":"2023-10-08T07:02:13.174655+0000","last_peered":"2023-10-08T07:02:13.174655+0000","last_clean":"2023-10-08T07:02:13.174655+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:02:13.174655+0000","last_undegraded":"2023-10-08T07:02:13.174655+0000","last_fullsized":"2023-10-08T07:02:13.174655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.174510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:00.806909+0000","scrub_duration":0.00191114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855818+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:10.855818+0000","last_peered":"2023-10-08T07:01:10.855818+0000","last_clean":"2023-10-08T07:01:10.855818+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:10.855818+0000","last_undegraded":"2023-10-08T07:01:10.855818+0000","last_fullsized":"2023-10-08T07:01:10.855818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726486+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:19.726486+0000","last_peered":"2023-10-08T07:01:19.726486+0000","last_clean":"2023-10-08T07:01:19.726486+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:19.726486+0000","last_undegraded":"2023-10-08T07:01:19.726486+0000","last_fullsized":"2023-10-08T07:01:19.726486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612626,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47196,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324644,"statfs":{"total":96636764160,"available":96588435456,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 07:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.62},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.67700000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325036,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046804,"statfs":{"total":96636764160,"available":96303927296,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.157,"15min":0.157},"max":{"1min":0.70499999999999996,"5min":1.845,"15min":1.845},"last":0.374},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.41199999999999998},"min":{"1min":0.308,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.64500000000000002,"5min":1.998,"15min":1.998},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:02:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.44600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738435,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.442,"15min":0.39800000000000002},"min":{"1min":0.40600000000000003,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.66900000000000004,"5min":1.518,"15min":1.518},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51200000000000001,"15min":0.442},"min":{"1min":0.42699999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.65200000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Oct 8 07:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:02:21.811 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.811 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.811 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.811 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.811 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.812 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.813 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.813 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.813 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.813 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.813 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.813 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.813 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.814 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.815 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.815 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.815 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.815 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.815 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.815 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.815 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.816 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.816 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.816 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.816 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.816 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.816 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.816 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T06:57:05.252014+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=5, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.817 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.818 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.818 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.818 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.818 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.818 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.818 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:21.818 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:02:41.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:02:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:02:42.177 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:02:42.187 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-08T07:02:41.029987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679208,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436312,"statfs":{"total":289910292480,"available":289214783488,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003144"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726586+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:19.726586+0000","last_peered":"2023-10-08T07:01:19.726586+0000","last_clean":"2023-10-08T07:01:19.726586+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:19.726586+0000","last_undegraded":"2023-10-08T07:01:19.726586+0000","last_fullsized":"2023-10-08T07:01:19.726586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:26.943085+0000","last_change":"2023-10-08T07:01:26.943085+0000","last_active":"2023-10-08T07:01:26.943085+0000","last_peered":"2023-10-08T07:01:26.943085+0000","last_clean":"2023-10-08T07:01:26.943085+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:26.943085+0000","last_undegraded":"2023-10-08T07:01:26.943085+0000","last_fullsized":"2023-10-08T07:01:26.943085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_clean_scrub_stamp":"2023-10-08T07:01:26.942930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:33.364930+0000","scrub_duration":0.0017987770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:12.752541+0000","last_change":"2023-10-08T07:02:12.752610+0000","last_active":"2023-10-08T07:02:12.752541+0000","last_peered":"2023-10-08T07:02:12.752541+0000","last_clean":"2023-10-08T07:02:12.752541+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:02:12.752541+0000","last_undegraded":"2023-10-08T07:02:12.752541+0000","last_fullsized":"2023-10-08T07:02:12.752541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_clean_scrub_stamp":"2023-10-08T07:02:12.752388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.974197+0000","scrub_duration":0.0021934350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.126324+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:19.126324+0000","last_peered":"2023-10-08T07:01:19.126324+0000","last_clean":"2023-10-08T07:01:19.126324+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:19.126324+0000","last_undegraded":"2023-10-08T07:01:19.126324+0000","last_fullsized":"2023-10-08T07:01:19.126324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:21.969248+0000","last_change":"2023-10-08T07:01:21.969248+0000","last_active":"2023-10-08T07:01:21.969248+0000","last_peered":"2023-10-08T07:01:21.969248+0000","last_clean":"2023-10-08T07:01:21.969248+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:21.969248+0000","last_undegraded":"2023-10-08T07:01:21.969248+0000","last_fullsized":"2023-10-08T07:01:21.969248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_clean_scrub_stamp":"2023-10-08T07:01:21.969069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:37.695683+0000","scrub_duration":0.013488305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209422+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:19.209422+0000","last_peered":"2023-10-08T07:01:19.209422+0000","last_clean":"2023-10-08T07:01:19.209422+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:19.209422+0000","last_undegraded":"2023-10-08T07:01:19.209422+0000","last_fullsized":"2023-10-08T07:01:19.209422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:57.750404+0000","last_change":"2023-10-08T07:01:57.750404+0000","last_active":"2023-10-08T07:01:57.750404+0000","last_peered":"2023-10-08T07:01:57.750404+0000","last_clean":"2023-10-08T07:01:57.750404+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:57.750404+0000","last_undegraded":"2023-10-08T07:01:57.750404+0000","last_fullsized":"2023-10-08T07:01:57.750404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_clean_scrub_stamp":"2023-10-08T07:01:57.750253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:45.382652+0000","scrub_duration":0.012901334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:56.730073+0000","last_change":"2023-10-08T07:01:56.730073+0000","last_active":"2023-10-08T07:01:56.730073+0000","last_peered":"2023-10-08T07:01:56.730073+0000","last_clean":"2023-10-08T07:01:56.730073+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:56.730073+0000","last_undegraded":"2023-10-08T07:01:56.730073+0000","last_fullsized":"2023-10-08T07:01:56.730073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_clean_scrub_stamp":"2023-10-08T07:01:56.729910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:33.646540+0000","scrub_duration":0.001731001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.961827+0000","last_change":"2023-10-08T07:02:13.961921+0000","last_active":"2023-10-08T07:02:13.961827+0000","last_peered":"2023-10-08T07:02:13.961827+0000","last_clean":"2023-10-08T07:02:13.961827+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:02:13.961827+0000","last_undegraded":"2023-10-08T07:02:13.961827+0000","last_fullsized":"2023-10-08T07:02:13.961827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.961668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:45.329692+0000","scrub_duration":0.024638136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.174431+0000","last_change":"2023-10-08T07:01:45.174431+0000","last_active":"2023-10-08T07:01:45.174431+0000","last_peered":"2023-10-08T07:01:45.174431+0000","last_clean":"2023-10-08T07:01:45.174431+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:45.174431+0000","last_undegraded":"2023-10-08T07:01:45.174431+0000","last_fullsized":"2023-10-08T07:01:45.174431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.174265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:07.913029+0000","scrub_duration":0.002167066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209380+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:19.209380+0000","last_peered":"2023-10-08T07:01:19.209380+0000","last_clean":"2023-10-08T07:01:19.209380+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:19.209380+0000","last_undegraded":"2023-10-08T07:01:19.209380+0000","last_fullsized":"2023-10-08T07:01:19.209380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887480+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:10.887480+0000","last_peered":"2023-10-08T07:01:10.887480+0000","last_clean":"2023-10-08T07:01:10.887480+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:10.887480+0000","last_undegraded":"2023-10-08T07:01:10.887480+0000","last_fullsized":"2023-10-08T07:01:10.887480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:21.230827+0000","last_change":"2023-10-08T07:02:21.230881+0000","last_active":"2023-10-08T07:02:21.230827+0000","last_peered":"2023-10-08T07:02:21.230827+0000","last_clean":"2023-10-08T07:02:21.230827+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:02:21.230827+0000","last_undegraded":"2023-10-08T07:02:21.230827+0000","last_fullsized":"2023-10-08T07:02:21.230827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_clean_scrub_stamp":"2023-10-08T07:02:21.229837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:05.860581+0000","scrub_duration":0.013675958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209365+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:19.209365+0000","last_peered":"2023-10-08T07:01:19.209365+0000","last_clean":"2023-10-08T07:01:19.209365+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:19.209365+0000","last_undegraded":"2023-10-08T07:01:19.209365+0000","last_fullsized":"2023-10-08T07:01:19.209365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:25.791594+0000","last_change":"2023-10-08T07:02:25.791642+0000","last_active":"2023-10-08T07:02:25.791594+0000","last_peered":"2023-10-08T07:02:25.791594+0000","last_clean":"2023-10-08T07:02:25.791594+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:02:25.791594+0000","last_undegraded":"2023-10-08T07:02:25.791594+0000","last_fullsized":"2023-10-08T07:02:25.791594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_clean_scrub_stamp":"2023-10-08T07:02:25.791498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:18.470455+0000","scrub_duration":0.0022261389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.693294+0000","last_change":"2023-10-08T07:02:06.693347+0000","last_active":"2023-10-08T07:02:06.693294+0000","last_peered":"2023-10-08T07:02:06.693294+0000","last_clean":"2023-10-08T07:02:06.693294+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:02:06.693294+0000","last_undegraded":"2023-10-08T07:02:06.693294+0000","last_fullsized":"2023-10-08T07:02:06.693294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.693202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:51.323946+0000","scrub_duration":0.001534101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.688380+0000","last_change":"2023-10-08T07:01:50.688440+0000","last_active":"2023-10-08T07:01:50.688380+0000","last_peered":"2023-10-08T07:01:50.688380+0000","last_clean":"2023-10-08T07:01:50.688380+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:50.688380+0000","last_undegraded":"2023-10-08T07:01:50.688380+0000","last_fullsized":"2023-10-08T07:01:50.688380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.688235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:07.345735+0000","scrub_duration":0.058960934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.178032+0000","last_change":"2023-10-08T07:02:04.178077+0000","last_active":"2023-10-08T07:02:04.178032+0000","last_peered":"2023-10-08T07:02:04.178032+0000","last_clean":"2023-10-08T07:02:04.178032+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:02:04.178032+0000","last_undegraded":"2023-10-08T07:02:04.178032+0000","last_fullsized":"2023-10-08T07:02:04.178032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.177926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.809779+0000","scrub_duration":0.001839074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:09.853908+0000","last_change":"2023-10-08T07:02:09.853986+0000","last_active":"2023-10-08T07:02:09.853908+0000","last_peered":"2023-10-08T07:02:09.853908+0000","last_clean":"2023-10-08T07:02:09.853908+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:02:09.853908+0000","last_undegraded":"2023-10-08T07:02:09.853908+0000","last_fullsized":"2023-10-08T07:02:09.853908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_clean_scrub_stamp":"2023-10-08T07:02:09.853744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:31:03.195743+0000","scrub_duration":0.02129166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209296+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:19.209296+0000","last_peered":"2023-10-08T07:01:19.209296+0000","last_clean":"2023-10-08T07:01:19.209296+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:19.209296+0000","last_undegraded":"2023-10-08T07:01:19.209296+0000","last_fullsized":"2023-10-08T07:01:19.209296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:31.610403+0000","last_change":"2023-10-08T07:01:31.610403+0000","last_active":"2023-10-08T07:01:31.610403+0000","last_peered":"2023-10-08T07:01:31.610403+0000","last_clean":"2023-10-08T07:01:31.610403+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:31.610403+0000","last_undegraded":"2023-10-08T07:01:31.610403+0000","last_fullsized":"2023-10-08T07:01:31.610403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_clean_scrub_stamp":"2023-10-08T07:01:31.610144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:26.179749+0000","scrub_duration":0.024703487999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887318+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:10.887318+0000","last_peered":"2023-10-08T07:01:10.887318+0000","last_clean":"2023-10-08T07:01:10.887318+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:10.887318+0000","last_undegraded":"2023-10-08T07:01:10.887318+0000","last_fullsized":"2023-10-08T07:01:10.887318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.817152+0000","last_change":"2023-10-08T07:02:00.817194+0000","last_active":"2023-10-08T07:02:00.817152+0000","last_peered":"2023-10-08T07:02:00.817152+0000","last_clean":"2023-10-08T07:02:00.817152+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:02:00.817152+0000","last_undegraded":"2023-10-08T07:02:00.817152+0000","last_fullsized":"2023-10-08T07:02:00.817152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.817055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:43.652542+0000","scrub_duration":0.0020658320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.987480+0000","last_change":"2023-10-08T07:01:24.987480+0000","last_active":"2023-10-08T07:01:24.987480+0000","last_peered":"2023-10-08T07:01:24.987480+0000","last_clean":"2023-10-08T07:01:24.987480+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:24.987480+0000","last_undegraded":"2023-10-08T07:01:24.987480+0000","last_fullsized":"2023-10-08T07:01:24.987480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.987290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:07.099956+0000","scrub_duration":0.0019193140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.234880+0000","last_change":"2023-10-08T07:02:23.234951+0000","last_active":"2023-10-08T07:02:23.234880+0000","last_peered":"2023-10-08T07:02:23.234880+0000","last_clean":"2023-10-08T07:02:23.234880+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:02:23.234880+0000","last_undegraded":"2023-10-08T07:02:23.234880+0000","last_fullsized":"2023-10-08T07:02:23.234880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.234752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:30.102430+0000","scrub_duration":0.037375644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856279+0000","last_change":"2023-10-08T07:00:58.675007+0000","last_active":"2023-10-08T07:01:10.856279+0000","last_peered":"2023-10-08T07:01:10.856279+0000","last_clean":"2023-10-08T07:01:10.856279+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:01:10.856279+0000","last_undegraded":"2023-10-08T07:01:10.856279+0000","last_fullsized":"2023-10-08T07:01:10.856279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:08.671486+0000","last_change":"2023-10-08T07:02:08.671550+0000","last_active":"2023-10-08T07:02:08.671486+0000","last_peered":"2023-10-08T07:02:08.671486+0000","last_clean":"2023-10-08T07:02:08.671486+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:02:08.671486+0000","last_undegraded":"2023-10-08T07:02:08.671486+0000","last_fullsized":"2023-10-08T07:02:08.671486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_clean_scrub_stamp":"2023-10-08T07:02:08.671339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:29.879286+0000","scrub_duration":0.001757886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726163+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:19.726163+0000","last_peered":"2023-10-08T07:01:19.726163+0000","last_clean":"2023-10-08T07:01:19.726163+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726163+0000","last_undegraded":"2023-10-08T07:01:19.726163+0000","last_fullsized":"2023-10-08T07:01:19.726163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:05.217103+0000","last_change":"2023-10-08T07:02:05.217103+0000","last_active":"2023-10-08T07:02:05.217103+0000","last_peered":"2023-10-08T07:02:05.217103+0000","last_clean":"2023-10-08T07:02:05.217103+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:02:05.217103+0000","last_undegraded":"2023-10-08T07:02:05.217103+0000","last_fullsized":"2023-10-08T07:02:05.217103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_clean_scrub_stamp":"2023-10-08T07:02:05.216949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:39.808310+0000","scrub_duration":0.0020402969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.931817+0000","last_change":"2023-10-08T07:02:33.931866+0000","last_active":"2023-10-08T07:02:33.931817+0000","last_peered":"2023-10-08T07:02:33.931817+0000","last_clean":"2023-10-08T07:02:33.931817+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:02:33.931817+0000","last_undegraded":"2023-10-08T07:02:33.931817+0000","last_fullsized":"2023-10-08T07:02:33.931817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.931709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:41.216079+0000","scrub_duration":0.0019470710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856331+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:10.856331+0000","last_peered":"2023-10-08T07:01:10.856331+0000","last_clean":"2023-10-08T07:01:10.856331+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:10.856331+0000","last_undegraded":"2023-10-08T07:01:10.856331+0000","last_fullsized":"2023-10-08T07:01:10.856331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:59.853347+0000","last_change":"2023-10-08T07:01:59.853394+0000","last_active":"2023-10-08T07:01:59.853347+0000","last_peered":"2023-10-08T07:01:59.853347+0000","last_clean":"2023-10-08T07:01:59.853347+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:59.853347+0000","last_undegraded":"2023-10-08T07:01:59.853347+0000","last_fullsized":"2023-10-08T07:01:59.853347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_clean_scrub_stamp":"2023-10-08T07:01:59.853244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:32.293985+0000","scrub_duration":0.002167183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:11.225174+0000","last_change":"2023-10-08T07:02:11.225253+0000","last_active":"2023-10-08T07:02:11.225174+0000","last_peered":"2023-10-08T07:02:11.225174+0000","last_clean":"2023-10-08T07:02:11.225174+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:02:11.225174+0000","last_undegraded":"2023-10-08T07:02:11.225174+0000","last_fullsized":"2023-10-08T07:02:11.225174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_clean_scrub_stamp":"2023-10-08T07:02:11.225019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:48.141649+0000","scrub_duration":0.067035265999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856372+0000","last_change":"2023-10-08T07:00:58.674241+0000","last_active":"2023-10-08T07:01:10.856372+0000","last_peered":"2023-10-08T07:01:10.856372+0000","last_clean":"2023-10-08T07:01:10.856372+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:01:10.856372+0000","last_undegraded":"2023-10-08T07:01:10.856372+0000","last_fullsized":"2023-10-08T07:01:10.856372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:27.796617+0000","last_change":"2023-10-08T07:02:27.796666+0000","last_active":"2023-10-08T07:02:27.796617+0000","last_peered":"2023-10-08T07:02:27.796617+0000","last_clean":"2023-10-08T07:02:27.796617+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:02:27.796617+0000","last_undegraded":"2023-10-08T07:02:27.796617+0000","last_fullsized":"2023-10-08T07:02:27.796617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_clean_scrub_stamp":"2023-10-08T07:02:27.796523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:56.809518+0000","scrub_duration":0.0019890369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:30.574748+0000","last_change":"2023-10-08T07:01:30.574748+0000","last_active":"2023-10-08T07:01:30.574748+0000","last_peered":"2023-10-08T07:01:30.574748+0000","last_clean":"2023-10-08T07:01:30.574748+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:30.574748+0000","last_undegraded":"2023-10-08T07:01:30.574748+0000","last_fullsized":"2023-10-08T07:01:30.574748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_clean_scrub_stamp":"2023-10-08T07:01:30.574594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:52.811528+0000","scrub_duration":0.0024001500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855631+0000","last_change":"2023-10-08T07:00:58.672467+0000","last_active":"2023-10-08T07:01:10.855631+0000","last_peered":"2023-10-08T07:01:10.855631+0000","last_clean":"2023-10-08T07:01:10.855631+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:01:10.855631+0000","last_undegraded":"2023-10-08T07:01:10.855631+0000","last_fullsized":"2023-10-08T07:01:10.855631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"80'5","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:29.272021+0000","last_change":"2023-10-08T07:02:29.272082+0000","last_active":"2023-10-08T07:02:29.272021+0000","last_peered":"2023-10-08T07:02:29.272021+0000","last_clean":"2023-10-08T07:02:29.272021+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:02:29.272021+0000","last_undegraded":"2023-10-08T07:02:29.272021+0000","last_fullsized":"2023-10-08T07:02:29.272021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_clean_scrub_stamp":"2023-10-08T07:02:29.271932+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:17.488172+0000","scrub_duration":0.0039090369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.838802+0000","last_change":"2023-10-08T07:02:23.838844+0000","last_active":"2023-10-08T07:02:23.838802+0000","last_peered":"2023-10-08T07:02:23.838802+0000","last_clean":"2023-10-08T07:02:23.838802+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:02:23.838802+0000","last_undegraded":"2023-10-08T07:02:23.838802+0000","last_fullsized":"2023-10-08T07:02:23.838802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.838707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:40.234311+0000","scrub_duration":0.0019657749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209022+0000","last_change":"2023-10-08T06:57:16.321104+0000","last_active":"2023-10-08T07:01:19.209022+0000","last_peered":"2023-10-08T07:01:19.209022+0000","last_clean":"2023-10-08T07:01:19.209022+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:01:19.209022+0000","last_undegraded":"2023-10-08T07:01:19.209022+0000","last_fullsized":"2023-10-08T07:01:19.209022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:37.862068+0000","last_change":"2023-10-08T07:02:37.862114+0000","last_active":"2023-10-08T07:02:37.862068+0000","last_peered":"2023-10-08T07:02:37.862068+0000","last_clean":"2023-10-08T07:02:37.862068+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:02:37.862068+0000","last_undegraded":"2023-10-08T07:02:37.862068+0000","last_fullsized":"2023-10-08T07:02:37.862068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_clean_scrub_stamp":"2023-10-08T07:02:37.861974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:59.365584+0000","scrub_duration":0.001729883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209043+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:19.209043+0000","last_peered":"2023-10-08T07:01:19.209043+0000","last_clean":"2023-10-08T07:01:19.209043+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:19.209043+0000","last_undegraded":"2023-10-08T07:01:19.209043+0000","last_fullsized":"2023-10-08T07:01:19.209043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726352+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:19.726352+0000","last_peered":"2023-10-08T07:01:19.726352+0000","last_clean":"2023-10-08T07:01:19.726352+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:19.726352+0000","last_undegraded":"2023-10-08T07:01:19.726352+0000","last_fullsized":"2023-10-08T07:01:19.726352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.873305+0000","last_change":"2023-10-08T07:02:16.873360+0000","last_active":"2023-10-08T07:02:16.873305+0000","last_peered":"2023-10-08T07:02:16.873305+0000","last_clean":"2023-10-08T07:02:16.873305+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:02:16.873305+0000","last_undegraded":"2023-10-08T07:02:16.873305+0000","last_fullsized":"2023-10-08T07:02:16.873305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.873196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:35.207672+0000","scrub_duration":0.0021297239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726354+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:19.726354+0000","last_peered":"2023-10-08T07:01:19.726354+0000","last_clean":"2023-10-08T07:01:19.726354+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:19.726354+0000","last_undegraded":"2023-10-08T07:01:19.726354+0000","last_fullsized":"2023-10-08T07:01:19.726354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726094+0000","last_change":"2023-10-08T06:57:16.322372+0000","last_active":"2023-10-08T07:01:19.726094+0000","last_peered":"2023-10-08T07:01:19.726094+0000","last_clean":"2023-10-08T07:01:19.726094+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:01:19.726094+0000","last_undegraded":"2023-10-08T07:01:19.726094+0000","last_fullsized":"2023-10-08T07:01:19.726094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856200+0000","last_change":"2023-10-08T07:00:58.674776+0000","last_active":"2023-10-08T07:01:10.856200+0000","last_peered":"2023-10-08T07:01:10.856200+0000","last_clean":"2023-10-08T07:01:10.856200+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:01:10.856200+0000","last_undegraded":"2023-10-08T07:01:10.856200+0000","last_fullsized":"2023-10-08T07:01:10.856200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208996+0000","last_change":"2023-10-08T06:57:16.321610+0000","last_active":"2023-10-08T07:01:19.208996+0000","last_peered":"2023-10-08T07:01:19.208996+0000","last_clean":"2023-10-08T07:01:19.208996+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:01:19.208996+0000","last_undegraded":"2023-10-08T07:01:19.208996+0000","last_fullsized":"2023-10-08T07:01:19.208996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856459+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:10.856459+0000","last_peered":"2023-10-08T07:01:10.856459+0000","last_clean":"2023-10-08T07:01:10.856459+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:10.856459+0000","last_undegraded":"2023-10-08T07:01:10.856459+0000","last_fullsized":"2023-10-08T07:01:10.856459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208986+0000","last_change":"2023-10-08T06:57:16.320862+0000","last_active":"2023-10-08T07:01:19.208986+0000","last_peered":"2023-10-08T07:01:19.208986+0000","last_clean":"2023-10-08T07:01:19.208986+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:01:19.208986+0000","last_undegraded":"2023-10-08T07:01:19.208986+0000","last_fullsized":"2023-10-08T07:01:19.208986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726302+0000","last_change":"2023-10-08T06:57:17.341965+0000","last_active":"2023-10-08T07:01:19.726302+0000","last_peered":"2023-10-08T07:01:19.726302+0000","last_clean":"2023-10-08T07:01:19.726302+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:01:19.726302+0000","last_undegraded":"2023-10-08T07:01:19.726302+0000","last_fullsized":"2023-10-08T07:01:19.726302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.306868+0000","last_change":"2023-10-08T07:02:35.306939+0000","last_active":"2023-10-08T07:02:35.306868+0000","last_peered":"2023-10-08T07:02:35.306868+0000","last_clean":"2023-10-08T07:02:35.306868+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:02:35.306868+0000","last_undegraded":"2023-10-08T07:02:35.306868+0000","last_fullsized":"2023-10-08T07:02:35.306868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.306760+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:26.941872+0000","scrub_duration":0.0033496849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:48.225570+0000","last_change":"2023-10-08T07:01:48.225616+0000","last_active":"2023-10-08T07:01:48.225570+0000","last_peered":"2023-10-08T07:01:48.225570+0000","last_clean":"2023-10-08T07:01:48.225570+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:48.225570+0000","last_undegraded":"2023-10-08T07:01:48.225570+0000","last_fullsized":"2023-10-08T07:01:48.225570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_clean_scrub_stamp":"2023-10-08T07:01:48.225481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:42.795086+0000","scrub_duration":0.001625563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209001+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:19.209001+0000","last_peered":"2023-10-08T07:01:19.209001+0000","last_clean":"2023-10-08T07:01:19.209001+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:19.209001+0000","last_undegraded":"2023-10-08T07:01:19.209001+0000","last_fullsized":"2023-10-08T07:01:19.209001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209124+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:19.209124+0000","last_peered":"2023-10-08T07:01:19.209124+0000","last_clean":"2023-10-08T07:01:19.209124+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:19.209124+0000","last_undegraded":"2023-10-08T07:01:19.209124+0000","last_fullsized":"2023-10-08T07:01:19.209124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:10.762620+0000","last_change":"2023-10-08T07:02:10.762696+0000","last_active":"2023-10-08T07:02:10.762620+0000","last_peered":"2023-10-08T07:02:10.762620+0000","last_clean":"2023-10-08T07:02:10.762620+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:02:10.762620+0000","last_undegraded":"2023-10-08T07:02:10.762620+0000","last_fullsized":"2023-10-08T07:02:10.762620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_clean_scrub_stamp":"2023-10-08T07:02:10.762509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:26.540080+0000","scrub_duration":0.001712603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:01.817759+0000","last_change":"2023-10-08T07:02:01.817861+0000","last_active":"2023-10-08T07:02:01.817759+0000","last_peered":"2023-10-08T07:02:01.817759+0000","last_clean":"2023-10-08T07:02:01.817759+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:02:01.817759+0000","last_undegraded":"2023-10-08T07:02:01.817759+0000","last_fullsized":"2023-10-08T07:02:01.817759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_clean_scrub_stamp":"2023-10-08T07:02:01.817590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:34.561641+0000","scrub_duration":0.020576817000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:26.843345+0000","last_change":"2023-10-08T07:02:26.843409+0000","last_active":"2023-10-08T07:02:26.843345+0000","last_peered":"2023-10-08T07:02:26.843345+0000","last_clean":"2023-10-08T07:02:26.843345+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:02:26.843345+0000","last_undegraded":"2023-10-08T07:02:26.843345+0000","last_fullsized":"2023-10-08T07:02:26.843345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_clean_scrub_stamp":"2023-10-08T07:02:26.843242+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:19.529204+0000","scrub_duration":0.003535131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.803998+0000","last_change":"2023-10-08T07:02:23.804050+0000","last_active":"2023-10-08T07:02:23.803998+0000","last_peered":"2023-10-08T07:02:23.803998+0000","last_clean":"2023-10-08T07:02:23.803998+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:02:23.803998+0000","last_undegraded":"2023-10-08T07:02:23.803998+0000","last_fullsized":"2023-10-08T07:02:23.803998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.803862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:53:23.043385+0000","scrub_duration":0.001807763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:51.695353+0000","last_change":"2023-10-08T07:01:51.695353+0000","last_active":"2023-10-08T07:01:51.695353+0000","last_peered":"2023-10-08T07:01:51.695353+0000","last_clean":"2023-10-08T07:01:51.695353+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:51.695353+0000","last_undegraded":"2023-10-08T07:01:51.695353+0000","last_fullsized":"2023-10-08T07:01:51.695353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_clean_scrub_stamp":"2023-10-08T07:01:51.695202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.269000+0000","scrub_duration":0.001739123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.803673+0000","last_change":"2023-10-08T07:02:33.803718+0000","last_active":"2023-10-08T07:02:33.803673+0000","last_peered":"2023-10-08T07:02:33.803673+0000","last_clean":"2023-10-08T07:02:33.803673+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:02:33.803673+0000","last_undegraded":"2023-10-08T07:02:33.803673+0000","last_fullsized":"2023-10-08T07:02:33.803673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.803572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:15:37.351173+0000","scrub_duration":0.0015426999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:22.981405+0000","last_change":"2023-10-08T07:01:22.981449+0000","last_active":"2023-10-08T07:01:22.981405+0000","last_peered":"2023-10-08T07:01:22.981405+0000","last_clean":"2023-10-08T07:01:22.981405+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:22.981405+0000","last_undegraded":"2023-10-08T07:01:22.981405+0000","last_fullsized":"2023-10-08T07:01:22.981405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_clean_scrub_stamp":"2023-10-08T07:01:22.981312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:27.955182+0000","scrub_duration":0.0020775799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.688387+0000","last_change":"2023-10-08T07:02:04.688434+0000","last_active":"2023-10-08T07:02:04.688387+0000","last_peered":"2023-10-08T07:02:04.688387+0000","last_clean":"2023-10-08T07:02:04.688387+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:02:04.688387+0000","last_undegraded":"2023-10-08T07:02:04.688387+0000","last_fullsized":"2023-10-08T07:02:04.688387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.688267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:43.315446+0000","scrub_duration":0.0020964360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.038967+0000","last_change":"2023-10-08T07:01:39.038967+0000","last_active":"2023-10-08T07:01:39.038967+0000","last_peered":"2023-10-08T07:01:39.038967+0000","last_clean":"2023-10-08T07:01:39.038967+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:39.038967+0000","last_undegraded":"2023-10-08T07:01:39.038967+0000","last_fullsized":"2023-10-08T07:01:39.038967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.038786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:33.889107+0000","scrub_duration":0.0024023780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:49.638640+0000","last_change":"2023-10-08T07:01:49.638700+0000","last_active":"2023-10-08T07:01:49.638640+0000","last_peered":"2023-10-08T07:01:49.638640+0000","last_clean":"2023-10-08T07:01:49.638640+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:49.638640+0000","last_undegraded":"2023-10-08T07:01:49.638640+0000","last_fullsized":"2023-10-08T07:01:49.638640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_clean_scrub_stamp":"2023-10-08T07:01:49.638527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:19.403345+0000","scrub_duration":0.045952461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:23.787068+0000","last_change":"2023-10-08T07:01:23.787118+0000","last_active":"2023-10-08T07:01:23.787068+0000","last_peered":"2023-10-08T07:01:23.787068+0000","last_clean":"2023-10-08T07:01:23.787068+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:23.787068+0000","last_undegraded":"2023-10-08T07:01:23.787068+0000","last_fullsized":"2023-10-08T07:01:23.787068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_clean_scrub_stamp":"2023-10-08T07:01:23.786970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:11.680051+0000","scrub_duration":0.0020370760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.799833+0000","last_change":"2023-10-08T07:02:35.799882+0000","last_active":"2023-10-08T07:02:35.799833+0000","last_peered":"2023-10-08T07:02:35.799833+0000","last_clean":"2023-10-08T07:02:35.799833+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:02:35.799833+0000","last_undegraded":"2023-10-08T07:02:35.799833+0000","last_fullsized":"2023-10-08T07:02:35.799833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.799739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:42.966201+0000","scrub_duration":0.0016784440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.237498+0000","last_change":"2023-10-08T07:02:00.237563+0000","last_active":"2023-10-08T07:02:00.237498+0000","last_peered":"2023-10-08T07:02:00.237498+0000","last_clean":"2023-10-08T07:02:00.237498+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:02:00.237498+0000","last_undegraded":"2023-10-08T07:02:00.237498+0000","last_fullsized":"2023-10-08T07:02:00.237498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.237364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:16.425225+0000","scrub_duration":0.0020507379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:44.684847+0000","last_change":"2023-10-08T07:01:44.684911+0000","last_active":"2023-10-08T07:01:44.684847+0000","last_peered":"2023-10-08T07:01:44.684847+0000","last_clean":"2023-10-08T07:01:44.684847+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:44.684847+0000","last_undegraded":"2023-10-08T07:01:44.684847+0000","last_fullsized":"2023-10-08T07:01:44.684847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_clean_scrub_stamp":"2023-10-08T07:01:44.684726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:06.172009+0000","scrub_duration":0.0021191029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208976+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:19.208976+0000","last_peered":"2023-10-08T07:01:19.208976+0000","last_clean":"2023-10-08T07:01:19.208976+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:19.208976+0000","last_undegraded":"2023-10-08T07:01:19.208976+0000","last_fullsized":"2023-10-08T07:01:19.208976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.560363+0000","last_change":"2023-10-08T07:01:45.560412+0000","last_active":"2023-10-08T07:01:45.560363+0000","last_peered":"2023-10-08T07:01:45.560363+0000","last_clean":"2023-10-08T07:01:45.560363+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:45.560363+0000","last_undegraded":"2023-10-08T07:01:45.560363+0000","last_fullsized":"2023-10-08T07:01:45.560363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.560260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:37.159112+0000","scrub_duration":0.0017976050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:27.690641+0000","last_change":"2023-10-08T07:01:27.690692+0000","last_active":"2023-10-08T07:01:27.690641+0000","last_peered":"2023-10-08T07:01:27.690641+0000","last_clean":"2023-10-08T07:01:27.690641+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:27.690641+0000","last_undegraded":"2023-10-08T07:01:27.690641+0000","last_fullsized":"2023-10-08T07:01:27.690641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_clean_scrub_stamp":"2023-10-08T07:01:27.690553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.772607+0000","scrub_duration":0.0017559400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.178065+0000","last_change":"2023-10-08T07:02:06.178108+0000","last_active":"2023-10-08T07:02:06.178065+0000","last_peered":"2023-10-08T07:02:06.178065+0000","last_clean":"2023-10-08T07:02:06.178065+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:02:06.178065+0000","last_undegraded":"2023-10-08T07:02:06.178065+0000","last_fullsized":"2023-10-08T07:02:06.178065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.177967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:14.751766+0000","scrub_duration":0.001743947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856431+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:10.856431+0000","last_peered":"2023-10-08T07:01:10.856431+0000","last_clean":"2023-10-08T07:01:10.856431+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:10.856431+0000","last_undegraded":"2023-10-08T07:01:10.856431+0000","last_fullsized":"2023-10-08T07:01:10.856431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208866+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:19.208866+0000","last_peered":"2023-10-08T07:01:19.208866+0000","last_clean":"2023-10-08T07:01:19.208866+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:19.208866+0000","last_undegraded":"2023-10-08T07:01:19.208866+0000","last_fullsized":"2023-10-08T07:01:19.208866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"80'159","reported_seq":287,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:38.900816+0000","last_change":"2023-10-08T07:02:38.900882+0000","last_active":"2023-10-08T07:02:38.900816+0000","last_peered":"2023-10-08T07:02:38.900816+0000","last_clean":"2023-10-08T07:02:38.900816+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:02:38.900816+0000","last_undegraded":"2023-10-08T07:02:38.900816+0000","last_fullsized":"2023-10-08T07:02:38.900816+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'159","last_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_deep_scrub":"80'159","last_deep_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_clean_scrub_stamp":"2023-10-08T07:02:38.900721+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:41.487928+0000","scrub_duration":0.0061413509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.763443+0000","last_change":"2023-10-08T07:01:24.763513+0000","last_active":"2023-10-08T07:01:24.763443+0000","last_peered":"2023-10-08T07:01:24.763443+0000","last_clean":"2023-10-08T07:01:24.763443+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:24.763443+0000","last_undegraded":"2023-10-08T07:01:24.763443+0000","last_fullsized":"2023-10-08T07:01:24.763443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.763341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:32.962887+0000","scrub_duration":0.0020468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.675374+0000","last_change":"2023-10-08T07:02:16.675417+0000","last_active":"2023-10-08T07:02:16.675374+0000","last_peered":"2023-10-08T07:02:16.675374+0000","last_clean":"2023-10-08T07:02:16.675374+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:02:16.675374+0000","last_undegraded":"2023-10-08T07:02:16.675374+0000","last_fullsized":"2023-10-08T07:02:16.675374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.675273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:47:21.079374+0000","scrub_duration":0.0018053679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:14.125450+0000","last_change":"2023-10-08T06:57:11.301016+0000","last_active":"2023-10-08T07:01:14.125450+0000","last_peered":"2023-10-08T07:01:14.125450+0000","last_clean":"2023-10-08T07:01:14.125450+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:01:14.125450+0000","last_undegraded":"2023-10-08T07:01:14.125450+0000","last_fullsized":"2023-10-08T07:01:14.125450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:22.874569+0000","last_change":"2023-10-08T07:02:22.874645+0000","last_active":"2023-10-08T07:02:22.874569+0000","last_peered":"2023-10-08T07:02:22.874569+0000","last_clean":"2023-10-08T07:02:22.874569+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:02:22.874569+0000","last_undegraded":"2023-10-08T07:02:22.874569+0000","last_fullsized":"2023-10-08T07:02:22.874569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_clean_scrub_stamp":"2023-10-08T07:02:22.874455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:16.900611+0000","scrub_duration":0.001910443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726305+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:19.726305+0000","last_peered":"2023-10-08T07:01:19.726305+0000","last_clean":"2023-10-08T07:01:19.726305+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:19.726305+0000","last_undegraded":"2023-10-08T07:01:19.726305+0000","last_fullsized":"2023-10-08T07:01:19.726305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726096+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:19.726096+0000","last_peered":"2023-10-08T07:01:19.726096+0000","last_clean":"2023-10-08T07:01:19.726096+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726096+0000","last_undegraded":"2023-10-08T07:01:19.726096+0000","last_fullsized":"2023-10-08T07:01:19.726096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:58.847293+0000","last_change":"2023-10-08T07:01:58.847357+0000","last_active":"2023-10-08T07:01:58.847293+0000","last_peered":"2023-10-08T07:01:58.847293+0000","last_clean":"2023-10-08T07:01:58.847293+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:58.847293+0000","last_undegraded":"2023-10-08T07:01:58.847293+0000","last_fullsized":"2023-10-08T07:01:58.847293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_clean_scrub_stamp":"2023-10-08T07:01:58.847143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:41.440486+0000","scrub_duration":0.0019445949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726279+0000","last_change":"2023-10-08T06:57:17.337726+0000","last_active":"2023-10-08T07:01:19.726279+0000","last_peered":"2023-10-08T07:01:19.726279+0000","last_clean":"2023-10-08T07:01:19.726279+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:01:19.726279+0000","last_undegraded":"2023-10-08T07:01:19.726279+0000","last_fullsized":"2023-10-08T07:01:19.726279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.849243+0000","last_change":"2023-10-08T07:02:31.849308+0000","last_active":"2023-10-08T07:02:31.849243+0000","last_peered":"2023-10-08T07:02:31.849243+0000","last_clean":"2023-10-08T07:02:31.849243+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:02:31.849243+0000","last_undegraded":"2023-10-08T07:02:31.849243+0000","last_fullsized":"2023-10-08T07:02:31.849243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.849141+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:13.743926+0000","scrub_duration":0.0034446239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855980+0000","last_change":"2023-10-08T07:00:58.687296+0000","last_active":"2023-10-08T07:01:10.855980+0000","last_peered":"2023-10-08T07:01:10.855980+0000","last_clean":"2023-10-08T07:01:10.855980+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:01:10.855980+0000","last_undegraded":"2023-10-08T07:01:10.855980+0000","last_fullsized":"2023-10-08T07:01:10.855980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:17.892980+0000","last_change":"2023-10-08T07:02:17.893066+0000","last_active":"2023-10-08T07:02:17.892980+0000","last_peered":"2023-10-08T07:02:17.892980+0000","last_clean":"2023-10-08T07:02:17.892980+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:02:17.892980+0000","last_undegraded":"2023-10-08T07:02:17.892980+0000","last_fullsized":"2023-10-08T07:02:17.892980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_clean_scrub_stamp":"2023-10-08T07:02:17.892874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:31:18.798860+0000","scrub_duration":0.001774783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208921+0000","last_change":"2023-10-08T06:57:11.300980+0000","last_active":"2023-10-08T07:01:19.208921+0000","last_peered":"2023-10-08T07:01:19.208921+0000","last_clean":"2023-10-08T07:01:19.208921+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:01:19.208921+0000","last_undegraded":"2023-10-08T07:01:19.208921+0000","last_fullsized":"2023-10-08T07:01:19.208921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"80'2","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.576981+0000","last_change":"2023-10-08T07:01:39.577040+0000","last_active":"2023-10-08T07:01:39.576981+0000","last_peered":"2023-10-08T07:01:39.576981+0000","last_clean":"2023-10-08T07:01:39.576981+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:39.576981+0000","last_undegraded":"2023-10-08T07:01:39.576981+0000","last_fullsized":"2023-10-08T07:01:39.576981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.576897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:14.587630+0000","scrub_duration":0.0034481989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:18.216128+0000","last_change":"2023-10-08T07:02:18.216182+0000","last_active":"2023-10-08T07:02:18.216128+0000","last_peered":"2023-10-08T07:02:18.216128+0000","last_clean":"2023-10-08T07:02:18.216128+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:02:18.216128+0000","last_undegraded":"2023-10-08T07:02:18.216128+0000","last_fullsized":"2023-10-08T07:02:18.216128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_clean_scrub_stamp":"2023-10-08T07:02:18.216021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:56.843200+0000","scrub_duration":0.001736359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:28.311926+0000","last_change":"2023-10-08T07:02:28.312022+0000","last_active":"2023-10-08T07:02:28.311926+0000","last_peered":"2023-10-08T07:02:28.311926+0000","last_clean":"2023-10-08T07:02:28.311926+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:02:28.311926+0000","last_undegraded":"2023-10-08T07:02:28.311926+0000","last_fullsized":"2023-10-08T07:02:28.311926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_clean_scrub_stamp":"2023-10-08T07:02:28.311816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:45.533624+0000","scrub_duration":0.0023094650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.216225+0000","last_change":"2023-10-08T07:01:50.216225+0000","last_active":"2023-10-08T07:01:50.216225+0000","last_peered":"2023-10-08T07:01:50.216225+0000","last_clean":"2023-10-08T07:01:50.216225+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:50.216225+0000","last_undegraded":"2023-10-08T07:01:50.216225+0000","last_fullsized":"2023-10-08T07:01:50.216225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.215973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:05.464123+0000","scrub_duration":0.002109798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"80'3","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:37.613532+0000","last_change":"2023-10-08T07:01:37.613532+0000","last_active":"2023-10-08T07:01:37.613532+0000","last_peered":"2023-10-08T07:01:37.613532+0000","last_clean":"2023-10-08T07:01:37.613532+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:37.613532+0000","last_undegraded":"2023-10-08T07:01:37.613532+0000","last_fullsized":"2023-10-08T07:01:37.613532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_clean_scrub_stamp":"2023-10-08T07:01:37.613340+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:13:09.671822+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:28.609729+0000","last_change":"2023-10-08T07:01:28.609729+0000","last_active":"2023-10-08T07:01:28.609729+0000","last_peered":"2023-10-08T07:01:28.609729+0000","last_clean":"2023-10-08T07:01:28.609729+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:28.609729+0000","last_undegraded":"2023-10-08T07:01:28.609729+0000","last_fullsized":"2023-10-08T07:01:28.609729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_clean_scrub_stamp":"2023-10-08T07:01:28.609502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:34.613067+0000","scrub_duration":0.042684845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:32.267989+0000","last_change":"2023-10-08T07:02:32.268044+0000","last_active":"2023-10-08T07:02:32.267989+0000","last_peered":"2023-10-08T07:02:32.267989+0000","last_clean":"2023-10-08T07:02:32.267989+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:02:32.267989+0000","last_undegraded":"2023-10-08T07:02:32.267989+0000","last_fullsized":"2023-10-08T07:02:32.267989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_clean_scrub_stamp":"2023-10-08T07:02:32.267883+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:44.140149+0000","scrub_duration":0.0032451989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.645000+0000","last_change":"2023-10-08T07:01:50.645000+0000","last_active":"2023-10-08T07:01:50.645000+0000","last_peered":"2023-10-08T07:01:50.645000+0000","last_clean":"2023-10-08T07:01:50.645000+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:50.645000+0000","last_undegraded":"2023-10-08T07:01:50.645000+0000","last_fullsized":"2023-10-08T07:01:50.645000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:25.236202+0000","scrub_duration":0.0017188049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:55.773479+0000","last_change":"2023-10-08T07:01:55.773529+0000","last_active":"2023-10-08T07:01:55.773479+0000","last_peered":"2023-10-08T07:01:55.773479+0000","last_clean":"2023-10-08T07:01:55.773479+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:55.773479+0000","last_undegraded":"2023-10-08T07:01:55.773479+0000","last_fullsized":"2023-10-08T07:01:55.773479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_clean_scrub_stamp":"2023-10-08T07:01:55.773378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:40.743189+0000","scrub_duration":0.001795956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:35.079468+0000","last_change":"2023-10-08T07:01:35.079468+0000","last_active":"2023-10-08T07:01:35.079468+0000","last_peered":"2023-10-08T07:01:35.079468+0000","last_clean":"2023-10-08T07:01:35.079468+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:35.079468+0000","last_undegraded":"2023-10-08T07:01:35.079468+0000","last_fullsized":"2023-10-08T07:01:35.079468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_clean_scrub_stamp":"2023-10-08T07:01:35.079301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:18.577402+0000","scrub_duration":0.014529075000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:46.601700+0000","last_change":"2023-10-08T07:01:46.601759+0000","last_active":"2023-10-08T07:01:46.601700+0000","last_peered":"2023-10-08T07:01:46.601700+0000","last_clean":"2023-10-08T07:01:46.601700+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:46.601700+0000","last_undegraded":"2023-10-08T07:01:46.601700+0000","last_fullsized":"2023-10-08T07:01:46.601700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_clean_scrub_stamp":"2023-10-08T07:01:46.601588+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:47.103452+0000","scrub_duration":0.0040752189999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.870413+0000","last_change":"2023-10-08T07:02:31.870463+0000","last_active":"2023-10-08T07:02:31.870413+0000","last_peered":"2023-10-08T07:02:31.870413+0000","last_clean":"2023-10-08T07:02:31.870413+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:02:31.870413+0000","last_undegraded":"2023-10-08T07:02:31.870413+0000","last_fullsized":"2023-10-08T07:02:31.870413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.870304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:07.614244+0000","scrub_duration":0.00218046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.717435+0000","last_change":"2023-10-08T07:02:13.717480+0000","last_active":"2023-10-08T07:02:13.717435+0000","last_peered":"2023-10-08T07:02:13.717435+0000","last_clean":"2023-10-08T07:02:13.717435+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:02:13.717435+0000","last_undegraded":"2023-10-08T07:02:13.717435+0000","last_fullsized":"2023-10-08T07:02:13.717435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:25.008447+0000","scrub_duration":0.001854704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:32.686938+0000","last_change":"2023-10-08T07:01:32.687008+0000","last_active":"2023-10-08T07:01:32.686938+0000","last_peered":"2023-10-08T07:01:32.686938+0000","last_clean":"2023-10-08T07:01:32.686938+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:32.686938+0000","last_undegraded":"2023-10-08T07:01:32.686938+0000","last_fullsized":"2023-10-08T07:01:32.686938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_clean_scrub_stamp":"2023-10-08T07:01:32.686840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:36.443277+0000","scrub_duration":0.0020720539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.174655+0000","last_change":"2023-10-08T07:02:13.174730+0000","last_active":"2023-10-08T07:02:13.174655+0000","last_peered":"2023-10-08T07:02:13.174655+0000","last_clean":"2023-10-08T07:02:13.174655+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:02:13.174655+0000","last_undegraded":"2023-10-08T07:02:13.174655+0000","last_fullsized":"2023-10-08T07:02:13.174655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.174510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:00.806909+0000","scrub_duration":0.00191114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.855818+0000","last_change":"2023-10-08T07:00:58.689027+0000","last_active":"2023-10-08T07:01:10.855818+0000","last_peered":"2023-10-08T07:01:10.855818+0000","last_clean":"2023-10-08T07:01:10.855818+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:01:10.855818+0000","last_undegraded":"2023-10-08T07:01:10.855818+0000","last_fullsized":"2023-10-08T07:01:10.855818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726486+0000","last_change":"2023-10-08T06:57:17.336867+0000","last_active":"2023-10-08T07:01:19.726486+0000","last_peered":"2023-10-08T07:01:19.726486+0000","last_clean":"2023-10-08T07:01:19.726486+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:01:19.726486+0000","last_undegraded":"2023-10-08T07:01:19.726486+0000","last_fullsized":"2023-10-08T07:01:19.726486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612630,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47196,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324644,"statfs":{"total":96636764160,"available":96588435456,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Oct 8 07:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.44500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325036,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046804,"statfs":{"total":96636764160,"available":96303927296,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.157,"15min":0.157},"max":{"1min":0.70499999999999996,"5min":1.845,"15min":1.845},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.41199999999999998},"min":{"1min":0.308,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.64500000000000002,"5min":1.998,"15min":1.998},"last":0.48399999999999999}]},{"osd":2,"last update":"Sun Oct 8 07:02:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.43099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.442,"15min":0.39800000000000002},"min":{"1min":0.40600000000000003,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.66900000000000004,"5min":1.518,"15min":1.518},"last":0.437},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51200000000000001,"15min":0.442},"min":{"1min":0.42699999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.65200000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:02:42.194 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.194 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.194 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.194 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.194 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.195 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.195 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.195 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.195 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.195 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.195 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.197 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.197 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.197 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.198 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.198 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.198 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.198 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.198 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.198 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.198 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.199 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.199 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.199 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.199 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.199 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.199 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.200 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.200 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.200 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.200 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.200 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.200 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.201 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.201 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.201 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:02:42.201 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:03:02.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:03:02.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:03:02.561 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:03:02.572 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2023-10-08T07:03:01.036050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679208,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436312,"statfs":{"total":289910292480,"available":289214783488,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003634"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726586+0000","last_change":"2023-10-08T07:01:09.884263+0000","last_active":"2023-10-08T07:01:19.726586+0000","last_peered":"2023-10-08T07:01:19.726586+0000","last_clean":"2023-10-08T07:01:19.726586+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:01:19.726586+0000","last_undegraded":"2023-10-08T07:01:19.726586+0000","last_fullsized":"2023-10-08T07:01:19.726586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:26.943085+0000","last_change":"2023-10-08T07:01:26.943085+0000","last_active":"2023-10-08T07:01:26.943085+0000","last_peered":"2023-10-08T07:01:26.943085+0000","last_clean":"2023-10-08T07:01:26.943085+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:26.943085+0000","last_undegraded":"2023-10-08T07:01:26.943085+0000","last_fullsized":"2023-10-08T07:01:26.943085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_clean_scrub_stamp":"2023-10-08T07:01:26.942930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:33.364930+0000","scrub_duration":0.0017987770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:12.752541+0000","last_change":"2023-10-08T07:02:12.752610+0000","last_active":"2023-10-08T07:02:12.752541+0000","last_peered":"2023-10-08T07:02:12.752541+0000","last_clean":"2023-10-08T07:02:12.752541+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:02:12.752541+0000","last_undegraded":"2023-10-08T07:02:12.752541+0000","last_fullsized":"2023-10-08T07:02:12.752541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_clean_scrub_stamp":"2023-10-08T07:02:12.752388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.974197+0000","scrub_duration":0.0021934350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.126324+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:19.126324+0000","last_peered":"2023-10-08T07:01:19.126324+0000","last_clean":"2023-10-08T07:01:19.126324+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:19.126324+0000","last_undegraded":"2023-10-08T07:01:19.126324+0000","last_fullsized":"2023-10-08T07:01:19.126324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:21.969248+0000","last_change":"2023-10-08T07:01:21.969248+0000","last_active":"2023-10-08T07:01:21.969248+0000","last_peered":"2023-10-08T07:01:21.969248+0000","last_clean":"2023-10-08T07:01:21.969248+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:21.969248+0000","last_undegraded":"2023-10-08T07:01:21.969248+0000","last_fullsized":"2023-10-08T07:01:21.969248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_clean_scrub_stamp":"2023-10-08T07:01:21.969069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:37.695683+0000","scrub_duration":0.013488305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209422+0000","last_change":"2023-10-08T07:00:58.743605+0000","last_active":"2023-10-08T07:01:19.209422+0000","last_peered":"2023-10-08T07:01:19.209422+0000","last_clean":"2023-10-08T07:01:19.209422+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:01:19.209422+0000","last_undegraded":"2023-10-08T07:01:19.209422+0000","last_fullsized":"2023-10-08T07:01:19.209422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:57.750404+0000","last_change":"2023-10-08T07:01:57.750404+0000","last_active":"2023-10-08T07:01:57.750404+0000","last_peered":"2023-10-08T07:01:57.750404+0000","last_clean":"2023-10-08T07:01:57.750404+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:57.750404+0000","last_undegraded":"2023-10-08T07:01:57.750404+0000","last_fullsized":"2023-10-08T07:01:57.750404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_clean_scrub_stamp":"2023-10-08T07:01:57.750253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:45.382652+0000","scrub_duration":0.012901334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:56.730073+0000","last_change":"2023-10-08T07:01:56.730073+0000","last_active":"2023-10-08T07:01:56.730073+0000","last_peered":"2023-10-08T07:01:56.730073+0000","last_clean":"2023-10-08T07:01:56.730073+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:56.730073+0000","last_undegraded":"2023-10-08T07:01:56.730073+0000","last_fullsized":"2023-10-08T07:01:56.730073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_clean_scrub_stamp":"2023-10-08T07:01:56.729910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:33.646540+0000","scrub_duration":0.001731001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.961827+0000","last_change":"2023-10-08T07:02:13.961921+0000","last_active":"2023-10-08T07:02:13.961827+0000","last_peered":"2023-10-08T07:02:13.961827+0000","last_clean":"2023-10-08T07:02:13.961827+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:02:13.961827+0000","last_undegraded":"2023-10-08T07:02:13.961827+0000","last_fullsized":"2023-10-08T07:02:13.961827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.961668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:45.329692+0000","scrub_duration":0.024638136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.174431+0000","last_change":"2023-10-08T07:01:45.174431+0000","last_active":"2023-10-08T07:01:45.174431+0000","last_peered":"2023-10-08T07:01:45.174431+0000","last_clean":"2023-10-08T07:01:45.174431+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:45.174431+0000","last_undegraded":"2023-10-08T07:01:45.174431+0000","last_fullsized":"2023-10-08T07:01:45.174431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.174265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:07.913029+0000","scrub_duration":0.002167066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209380+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:19.209380+0000","last_peered":"2023-10-08T07:01:19.209380+0000","last_clean":"2023-10-08T07:01:19.209380+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:19.209380+0000","last_undegraded":"2023-10-08T07:01:19.209380+0000","last_fullsized":"2023-10-08T07:01:19.209380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887480+0000","last_change":"2023-10-08T07:01:09.882125+0000","last_active":"2023-10-08T07:01:10.887480+0000","last_peered":"2023-10-08T07:01:10.887480+0000","last_clean":"2023-10-08T07:01:10.887480+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:01:10.887480+0000","last_undegraded":"2023-10-08T07:01:10.887480+0000","last_fullsized":"2023-10-08T07:01:10.887480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:21.230827+0000","last_change":"2023-10-08T07:02:21.230881+0000","last_active":"2023-10-08T07:02:21.230827+0000","last_peered":"2023-10-08T07:02:21.230827+0000","last_clean":"2023-10-08T07:02:21.230827+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:02:21.230827+0000","last_undegraded":"2023-10-08T07:02:21.230827+0000","last_fullsized":"2023-10-08T07:02:21.230827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_clean_scrub_stamp":"2023-10-08T07:02:21.229837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:05.860581+0000","scrub_duration":0.013675958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209365+0000","last_change":"2023-10-08T06:57:17.331702+0000","last_active":"2023-10-08T07:01:19.209365+0000","last_peered":"2023-10-08T07:01:19.209365+0000","last_clean":"2023-10-08T07:01:19.209365+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:01:19.209365+0000","last_undegraded":"2023-10-08T07:01:19.209365+0000","last_fullsized":"2023-10-08T07:01:19.209365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:25.791594+0000","last_change":"2023-10-08T07:02:25.791642+0000","last_active":"2023-10-08T07:02:25.791594+0000","last_peered":"2023-10-08T07:02:25.791594+0000","last_clean":"2023-10-08T07:02:25.791594+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:02:25.791594+0000","last_undegraded":"2023-10-08T07:02:25.791594+0000","last_fullsized":"2023-10-08T07:02:25.791594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_clean_scrub_stamp":"2023-10-08T07:02:25.791498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:18.470455+0000","scrub_duration":0.0022261389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.693294+0000","last_change":"2023-10-08T07:02:06.693347+0000","last_active":"2023-10-08T07:02:06.693294+0000","last_peered":"2023-10-08T07:02:06.693294+0000","last_clean":"2023-10-08T07:02:06.693294+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:02:06.693294+0000","last_undegraded":"2023-10-08T07:02:06.693294+0000","last_fullsized":"2023-10-08T07:02:06.693294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.693202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:51.323946+0000","scrub_duration":0.001534101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.688380+0000","last_change":"2023-10-08T07:01:50.688440+0000","last_active":"2023-10-08T07:01:50.688380+0000","last_peered":"2023-10-08T07:01:50.688380+0000","last_clean":"2023-10-08T07:01:50.688380+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:50.688380+0000","last_undegraded":"2023-10-08T07:01:50.688380+0000","last_fullsized":"2023-10-08T07:01:50.688380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.688235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:07.345735+0000","scrub_duration":0.058960934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.178032+0000","last_change":"2023-10-08T07:02:04.178077+0000","last_active":"2023-10-08T07:02:04.178032+0000","last_peered":"2023-10-08T07:02:04.178032+0000","last_clean":"2023-10-08T07:02:04.178032+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:02:04.178032+0000","last_undegraded":"2023-10-08T07:02:04.178032+0000","last_fullsized":"2023-10-08T07:02:04.178032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.177926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.809779+0000","scrub_duration":0.001839074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:09.853908+0000","last_change":"2023-10-08T07:02:09.853986+0000","last_active":"2023-10-08T07:02:09.853908+0000","last_peered":"2023-10-08T07:02:09.853908+0000","last_clean":"2023-10-08T07:02:09.853908+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:02:09.853908+0000","last_undegraded":"2023-10-08T07:02:09.853908+0000","last_fullsized":"2023-10-08T07:02:09.853908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_clean_scrub_stamp":"2023-10-08T07:02:09.853744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:31:03.195743+0000","scrub_duration":0.02129166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209296+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:19.209296+0000","last_peered":"2023-10-08T07:01:19.209296+0000","last_clean":"2023-10-08T07:01:19.209296+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:19.209296+0000","last_undegraded":"2023-10-08T07:01:19.209296+0000","last_fullsized":"2023-10-08T07:01:19.209296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:31.610403+0000","last_change":"2023-10-08T07:01:31.610403+0000","last_active":"2023-10-08T07:01:31.610403+0000","last_peered":"2023-10-08T07:01:31.610403+0000","last_clean":"2023-10-08T07:01:31.610403+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:31.610403+0000","last_undegraded":"2023-10-08T07:01:31.610403+0000","last_fullsized":"2023-10-08T07:01:31.610403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_clean_scrub_stamp":"2023-10-08T07:01:31.610144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:26.179749+0000","scrub_duration":0.024703487999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.887318+0000","last_change":"2023-10-08T07:01:09.882331+0000","last_active":"2023-10-08T07:01:10.887318+0000","last_peered":"2023-10-08T07:01:10.887318+0000","last_clean":"2023-10-08T07:01:10.887318+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:01:10.887318+0000","last_undegraded":"2023-10-08T07:01:10.887318+0000","last_fullsized":"2023-10-08T07:01:10.887318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.817152+0000","last_change":"2023-10-08T07:02:00.817194+0000","last_active":"2023-10-08T07:02:00.817152+0000","last_peered":"2023-10-08T07:02:00.817152+0000","last_clean":"2023-10-08T07:02:00.817152+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:02:00.817152+0000","last_undegraded":"2023-10-08T07:02:00.817152+0000","last_fullsized":"2023-10-08T07:02:00.817152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.817055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:43.652542+0000","scrub_duration":0.0020658320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.987480+0000","last_change":"2023-10-08T07:01:24.987480+0000","last_active":"2023-10-08T07:01:24.987480+0000","last_peered":"2023-10-08T07:01:24.987480+0000","last_clean":"2023-10-08T07:01:24.987480+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:24.987480+0000","last_undegraded":"2023-10-08T07:01:24.987480+0000","last_fullsized":"2023-10-08T07:01:24.987480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.987290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:07.099956+0000","scrub_duration":0.0019193140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.234880+0000","last_change":"2023-10-08T07:02:23.234951+0000","last_active":"2023-10-08T07:02:23.234880+0000","last_peered":"2023-10-08T07:02:23.234880+0000","last_clean":"2023-10-08T07:02:23.234880+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:02:23.234880+0000","last_undegraded":"2023-10-08T07:02:23.234880+0000","last_fullsized":"2023-10-08T07:02:23.234880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.234752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:30.102430+0000","scrub_duration":0.037375644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:52.717184+0000","last_change":"2023-10-08T07:02:52.717261+0000","last_active":"2023-10-08T07:02:52.717184+0000","last_peered":"2023-10-08T07:02:52.717184+0000","last_clean":"2023-10-08T07:02:52.717184+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:02:52.717184+0000","last_undegraded":"2023-10-08T07:02:52.717184+0000","last_fullsized":"2023-10-08T07:02:52.717184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:52.717060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:52.717060+0000","last_clean_scrub_stamp":"2023-10-08T07:02:52.717060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:25.752353+0000","scrub_duration":0.0020455719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:08.671486+0000","last_change":"2023-10-08T07:02:08.671550+0000","last_active":"2023-10-08T07:02:08.671486+0000","last_peered":"2023-10-08T07:02:08.671486+0000","last_clean":"2023-10-08T07:02:08.671486+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:02:08.671486+0000","last_undegraded":"2023-10-08T07:02:08.671486+0000","last_fullsized":"2023-10-08T07:02:08.671486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_clean_scrub_stamp":"2023-10-08T07:02:08.671339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:29.879286+0000","scrub_duration":0.001757886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726163+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:19.726163+0000","last_peered":"2023-10-08T07:01:19.726163+0000","last_clean":"2023-10-08T07:01:19.726163+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726163+0000","last_undegraded":"2023-10-08T07:01:19.726163+0000","last_fullsized":"2023-10-08T07:01:19.726163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:05.217103+0000","last_change":"2023-10-08T07:02:05.217103+0000","last_active":"2023-10-08T07:02:05.217103+0000","last_peered":"2023-10-08T07:02:05.217103+0000","last_clean":"2023-10-08T07:02:05.217103+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:02:05.217103+0000","last_undegraded":"2023-10-08T07:02:05.217103+0000","last_fullsized":"2023-10-08T07:02:05.217103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_clean_scrub_stamp":"2023-10-08T07:02:05.216949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:39.808310+0000","scrub_duration":0.0020402969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.931817+0000","last_change":"2023-10-08T07:02:33.931866+0000","last_active":"2023-10-08T07:02:33.931817+0000","last_peered":"2023-10-08T07:02:33.931817+0000","last_clean":"2023-10-08T07:02:33.931817+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:02:33.931817+0000","last_undegraded":"2023-10-08T07:02:33.931817+0000","last_fullsized":"2023-10-08T07:02:33.931817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.931709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:41.216079+0000","scrub_duration":0.0019470710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:20.240397+0000","last_change":"2023-10-08T07:00:58.674910+0000","last_active":"2023-10-08T07:01:20.240397+0000","last_peered":"2023-10-08T07:01:20.240397+0000","last_clean":"2023-10-08T07:01:20.240397+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:01:20.240397+0000","last_undegraded":"2023-10-08T07:01:20.240397+0000","last_fullsized":"2023-10-08T07:01:20.240397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:59.853347+0000","last_change":"2023-10-08T07:01:59.853394+0000","last_active":"2023-10-08T07:01:59.853347+0000","last_peered":"2023-10-08T07:01:59.853347+0000","last_clean":"2023-10-08T07:01:59.853347+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:59.853347+0000","last_undegraded":"2023-10-08T07:01:59.853347+0000","last_fullsized":"2023-10-08T07:01:59.853347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_clean_scrub_stamp":"2023-10-08T07:01:59.853244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:32.293985+0000","scrub_duration":0.002167183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:11.225174+0000","last_change":"2023-10-08T07:02:11.225253+0000","last_active":"2023-10-08T07:02:11.225174+0000","last_peered":"2023-10-08T07:02:11.225174+0000","last_clean":"2023-10-08T07:02:11.225174+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:02:11.225174+0000","last_undegraded":"2023-10-08T07:02:11.225174+0000","last_fullsized":"2023-10-08T07:02:11.225174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_clean_scrub_stamp":"2023-10-08T07:02:11.225019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:48.141649+0000","scrub_duration":0.067035265999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:51.713000+0000","last_change":"2023-10-08T07:02:51.713047+0000","last_active":"2023-10-08T07:02:51.713000+0000","last_peered":"2023-10-08T07:02:51.713000+0000","last_clean":"2023-10-08T07:02:51.713000+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:02:51.713000+0000","last_undegraded":"2023-10-08T07:02:51.713000+0000","last_fullsized":"2023-10-08T07:02:51.713000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:51.712903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:51.712903+0000","last_clean_scrub_stamp":"2023-10-08T07:02:51.712903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:19.973256+0000","scrub_duration":0.0021159619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:27.796617+0000","last_change":"2023-10-08T07:02:27.796666+0000","last_active":"2023-10-08T07:02:27.796617+0000","last_peered":"2023-10-08T07:02:27.796617+0000","last_clean":"2023-10-08T07:02:27.796617+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:02:27.796617+0000","last_undegraded":"2023-10-08T07:02:27.796617+0000","last_fullsized":"2023-10-08T07:02:27.796617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_clean_scrub_stamp":"2023-10-08T07:02:27.796523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:56.809518+0000","scrub_duration":0.0019890369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:30.574748+0000","last_change":"2023-10-08T07:01:30.574748+0000","last_active":"2023-10-08T07:01:30.574748+0000","last_peered":"2023-10-08T07:01:30.574748+0000","last_clean":"2023-10-08T07:01:30.574748+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:30.574748+0000","last_undegraded":"2023-10-08T07:01:30.574748+0000","last_fullsized":"2023-10-08T07:01:30.574748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_clean_scrub_stamp":"2023-10-08T07:01:30.574594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:52.811528+0000","scrub_duration":0.0024001500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:50.716303+0000","last_change":"2023-10-08T07:02:50.716353+0000","last_active":"2023-10-08T07:02:50.716303+0000","last_peered":"2023-10-08T07:02:50.716303+0000","last_clean":"2023-10-08T07:02:50.716303+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:02:50.716303+0000","last_undegraded":"2023-10-08T07:02:50.716303+0000","last_fullsized":"2023-10-08T07:02:50.716303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:50.716192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:50.716192+0000","last_clean_scrub_stamp":"2023-10-08T07:02:50.716192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:12.681382+0000","scrub_duration":0.0020375620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"80'5","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:29.272021+0000","last_change":"2023-10-08T07:02:29.272082+0000","last_active":"2023-10-08T07:02:29.272021+0000","last_peered":"2023-10-08T07:02:29.272021+0000","last_clean":"2023-10-08T07:02:29.272021+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:02:29.272021+0000","last_undegraded":"2023-10-08T07:02:29.272021+0000","last_fullsized":"2023-10-08T07:02:29.272021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_clean_scrub_stamp":"2023-10-08T07:02:29.271932+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:17.488172+0000","scrub_duration":0.0039090369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.838802+0000","last_change":"2023-10-08T07:02:23.838844+0000","last_active":"2023-10-08T07:02:23.838802+0000","last_peered":"2023-10-08T07:02:23.838802+0000","last_clean":"2023-10-08T07:02:23.838802+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:02:23.838802+0000","last_undegraded":"2023-10-08T07:02:23.838802+0000","last_fullsized":"2023-10-08T07:02:23.838802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.838707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:40.234311+0000","scrub_duration":0.0019657749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"80'10","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:50.795841+0000","last_change":"2023-10-08T07:02:50.795896+0000","last_active":"2023-10-08T07:02:50.795841+0000","last_peered":"2023-10-08T07:02:50.795841+0000","last_clean":"2023-10-08T07:02:50.795841+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:02:50.795841+0000","last_undegraded":"2023-10-08T07:02:50.795841+0000","last_fullsized":"2023-10-08T07:02:50.795841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2023-10-08T07:02:50.795745+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2023-10-08T07:02:50.795745+0000","last_clean_scrub_stamp":"2023-10-08T07:02:50.795745+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:46:23.869486+0000","scrub_duration":0.0072464310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:37.862068+0000","last_change":"2023-10-08T07:02:37.862114+0000","last_active":"2023-10-08T07:02:37.862068+0000","last_peered":"2023-10-08T07:02:37.862068+0000","last_clean":"2023-10-08T07:02:37.862068+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:02:37.862068+0000","last_undegraded":"2023-10-08T07:02:37.862068+0000","last_fullsized":"2023-10-08T07:02:37.862068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_clean_scrub_stamp":"2023-10-08T07:02:37.861974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:59.365584+0000","scrub_duration":0.001729883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209043+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:19.209043+0000","last_peered":"2023-10-08T07:01:19.209043+0000","last_clean":"2023-10-08T07:01:19.209043+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:19.209043+0000","last_undegraded":"2023-10-08T07:01:19.209043+0000","last_fullsized":"2023-10-08T07:01:19.209043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726352+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:19.726352+0000","last_peered":"2023-10-08T07:01:19.726352+0000","last_clean":"2023-10-08T07:01:19.726352+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:19.726352+0000","last_undegraded":"2023-10-08T07:01:19.726352+0000","last_fullsized":"2023-10-08T07:01:19.726352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.873305+0000","last_change":"2023-10-08T07:02:16.873360+0000","last_active":"2023-10-08T07:02:16.873305+0000","last_peered":"2023-10-08T07:02:16.873305+0000","last_clean":"2023-10-08T07:02:16.873305+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:02:16.873305+0000","last_undegraded":"2023-10-08T07:02:16.873305+0000","last_fullsized":"2023-10-08T07:02:16.873305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.873196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:35.207672+0000","scrub_duration":0.0021297239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726354+0000","last_change":"2023-10-08T07:01:09.882139+0000","last_active":"2023-10-08T07:01:19.726354+0000","last_peered":"2023-10-08T07:01:19.726354+0000","last_clean":"2023-10-08T07:01:19.726354+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:01:19.726354+0000","last_undegraded":"2023-10-08T07:01:19.726354+0000","last_fullsized":"2023-10-08T07:01:19.726354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:40.351235+0000","last_change":"2023-10-08T07:02:40.351294+0000","last_active":"2023-10-08T07:02:40.351235+0000","last_peered":"2023-10-08T07:02:40.351235+0000","last_clean":"2023-10-08T07:02:40.351235+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:02:40.351235+0000","last_undegraded":"2023-10-08T07:02:40.351235+0000","last_fullsized":"2023-10-08T07:02:40.351235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:40.351137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:40.351137+0000","last_clean_scrub_stamp":"2023-10-08T07:02:40.351137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:06.577610+0000","scrub_duration":0.0020890739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:55.691775+0000","last_change":"2023-10-08T07:02:55.691820+0000","last_active":"2023-10-08T07:02:55.691775+0000","last_peered":"2023-10-08T07:02:55.691775+0000","last_clean":"2023-10-08T07:02:55.691775+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:02:55.691775+0000","last_undegraded":"2023-10-08T07:02:55.691775+0000","last_fullsized":"2023-10-08T07:02:55.691775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:55.691688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:55.691688+0000","last_clean_scrub_stamp":"2023-10-08T07:02:55.691688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:54.277341+0000","scrub_duration":0.001779648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"80'12","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:58.765122+0000","last_change":"2023-10-08T07:02:58.765189+0000","last_active":"2023-10-08T07:02:58.765122+0000","last_peered":"2023-10-08T07:02:58.765122+0000","last_clean":"2023-10-08T07:02:58.765122+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:02:58.765122+0000","last_undegraded":"2023-10-08T07:02:58.765122+0000","last_fullsized":"2023-10-08T07:02:58.765122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2023-10-08T07:02:58.765028+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2023-10-08T07:02:58.765028+0000","last_clean_scrub_stamp":"2023-10-08T07:02:58.765028+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:58.956075+0000","scrub_duration":0.0045723480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856459+0000","last_change":"2023-10-08T07:00:58.675269+0000","last_active":"2023-10-08T07:01:10.856459+0000","last_peered":"2023-10-08T07:01:10.856459+0000","last_clean":"2023-10-08T07:01:10.856459+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:01:10.856459+0000","last_undegraded":"2023-10-08T07:01:10.856459+0000","last_fullsized":"2023-10-08T07:01:10.856459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"80'2","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:53.783782+0000","last_change":"2023-10-08T07:02:53.783833+0000","last_active":"2023-10-08T07:02:53.783782+0000","last_peered":"2023-10-08T07:02:53.783782+0000","last_clean":"2023-10-08T07:02:53.783782+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:02:53.783782+0000","last_undegraded":"2023-10-08T07:02:53.783782+0000","last_fullsized":"2023-10-08T07:02:53.783782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:02:53.783686+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:02:53.783686+0000","last_clean_scrub_stamp":"2023-10-08T07:02:53.783686+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:27.748260+0000","scrub_duration":0.00336974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:41.305921+0000","last_change":"2023-10-08T07:02:41.306003+0000","last_active":"2023-10-08T07:02:41.305921+0000","last_peered":"2023-10-08T07:02:41.305921+0000","last_clean":"2023-10-08T07:02:41.305921+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:02:41.305921+0000","last_undegraded":"2023-10-08T07:02:41.305921+0000","last_fullsized":"2023-10-08T07:02:41.305921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:41.305820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:41.305820+0000","last_clean_scrub_stamp":"2023-10-08T07:02:41.305820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:49.119162+0000","scrub_duration":0.001850464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.306868+0000","last_change":"2023-10-08T07:02:35.306939+0000","last_active":"2023-10-08T07:02:35.306868+0000","last_peered":"2023-10-08T07:02:35.306868+0000","last_clean":"2023-10-08T07:02:35.306868+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:02:35.306868+0000","last_undegraded":"2023-10-08T07:02:35.306868+0000","last_fullsized":"2023-10-08T07:02:35.306868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.306760+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:26.941872+0000","scrub_duration":0.0033496849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:48.225570+0000","last_change":"2023-10-08T07:01:48.225616+0000","last_active":"2023-10-08T07:01:48.225570+0000","last_peered":"2023-10-08T07:01:48.225570+0000","last_clean":"2023-10-08T07:01:48.225570+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:48.225570+0000","last_undegraded":"2023-10-08T07:01:48.225570+0000","last_fullsized":"2023-10-08T07:01:48.225570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_clean_scrub_stamp":"2023-10-08T07:01:48.225481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:42.795086+0000","scrub_duration":0.001625563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209001+0000","last_change":"2023-10-08T06:57:16.321379+0000","last_active":"2023-10-08T07:01:19.209001+0000","last_peered":"2023-10-08T07:01:19.209001+0000","last_clean":"2023-10-08T07:01:19.209001+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:01:19.209001+0000","last_undegraded":"2023-10-08T07:01:19.209001+0000","last_fullsized":"2023-10-08T07:01:19.209001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209124+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:19.209124+0000","last_peered":"2023-10-08T07:01:19.209124+0000","last_clean":"2023-10-08T07:01:19.209124+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:19.209124+0000","last_undegraded":"2023-10-08T07:01:19.209124+0000","last_fullsized":"2023-10-08T07:01:19.209124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:10.762620+0000","last_change":"2023-10-08T07:02:10.762696+0000","last_active":"2023-10-08T07:02:10.762620+0000","last_peered":"2023-10-08T07:02:10.762620+0000","last_clean":"2023-10-08T07:02:10.762620+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:02:10.762620+0000","last_undegraded":"2023-10-08T07:02:10.762620+0000","last_fullsized":"2023-10-08T07:02:10.762620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_clean_scrub_stamp":"2023-10-08T07:02:10.762509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:26.540080+0000","scrub_duration":0.001712603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:01.817759+0000","last_change":"2023-10-08T07:02:01.817861+0000","last_active":"2023-10-08T07:02:01.817759+0000","last_peered":"2023-10-08T07:02:01.817759+0000","last_clean":"2023-10-08T07:02:01.817759+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:02:01.817759+0000","last_undegraded":"2023-10-08T07:02:01.817759+0000","last_fullsized":"2023-10-08T07:02:01.817759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_clean_scrub_stamp":"2023-10-08T07:02:01.817590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:34.561641+0000","scrub_duration":0.020576817000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:26.843345+0000","last_change":"2023-10-08T07:02:26.843409+0000","last_active":"2023-10-08T07:02:26.843345+0000","last_peered":"2023-10-08T07:02:26.843345+0000","last_clean":"2023-10-08T07:02:26.843345+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:02:26.843345+0000","last_undegraded":"2023-10-08T07:02:26.843345+0000","last_fullsized":"2023-10-08T07:02:26.843345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_clean_scrub_stamp":"2023-10-08T07:02:26.843242+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:19.529204+0000","scrub_duration":0.003535131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.803998+0000","last_change":"2023-10-08T07:02:23.804050+0000","last_active":"2023-10-08T07:02:23.803998+0000","last_peered":"2023-10-08T07:02:23.803998+0000","last_clean":"2023-10-08T07:02:23.803998+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:02:23.803998+0000","last_undegraded":"2023-10-08T07:02:23.803998+0000","last_fullsized":"2023-10-08T07:02:23.803998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.803862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:53:23.043385+0000","scrub_duration":0.001807763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:51.695353+0000","last_change":"2023-10-08T07:01:51.695353+0000","last_active":"2023-10-08T07:01:51.695353+0000","last_peered":"2023-10-08T07:01:51.695353+0000","last_clean":"2023-10-08T07:01:51.695353+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:51.695353+0000","last_undegraded":"2023-10-08T07:01:51.695353+0000","last_fullsized":"2023-10-08T07:01:51.695353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_clean_scrub_stamp":"2023-10-08T07:01:51.695202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.269000+0000","scrub_duration":0.001739123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.803673+0000","last_change":"2023-10-08T07:02:33.803718+0000","last_active":"2023-10-08T07:02:33.803673+0000","last_peered":"2023-10-08T07:02:33.803673+0000","last_clean":"2023-10-08T07:02:33.803673+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:02:33.803673+0000","last_undegraded":"2023-10-08T07:02:33.803673+0000","last_fullsized":"2023-10-08T07:02:33.803673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.803572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:15:37.351173+0000","scrub_duration":0.0015426999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:22.981405+0000","last_change":"2023-10-08T07:01:22.981449+0000","last_active":"2023-10-08T07:01:22.981405+0000","last_peered":"2023-10-08T07:01:22.981405+0000","last_clean":"2023-10-08T07:01:22.981405+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:22.981405+0000","last_undegraded":"2023-10-08T07:01:22.981405+0000","last_fullsized":"2023-10-08T07:01:22.981405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_clean_scrub_stamp":"2023-10-08T07:01:22.981312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:27.955182+0000","scrub_duration":0.0020775799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.688387+0000","last_change":"2023-10-08T07:02:04.688434+0000","last_active":"2023-10-08T07:02:04.688387+0000","last_peered":"2023-10-08T07:02:04.688387+0000","last_clean":"2023-10-08T07:02:04.688387+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:02:04.688387+0000","last_undegraded":"2023-10-08T07:02:04.688387+0000","last_fullsized":"2023-10-08T07:02:04.688387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.688267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:43.315446+0000","scrub_duration":0.0020964360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.038967+0000","last_change":"2023-10-08T07:01:39.038967+0000","last_active":"2023-10-08T07:01:39.038967+0000","last_peered":"2023-10-08T07:01:39.038967+0000","last_clean":"2023-10-08T07:01:39.038967+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:39.038967+0000","last_undegraded":"2023-10-08T07:01:39.038967+0000","last_fullsized":"2023-10-08T07:01:39.038967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.038786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:33.889107+0000","scrub_duration":0.0024023780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:49.638640+0000","last_change":"2023-10-08T07:01:49.638700+0000","last_active":"2023-10-08T07:01:49.638640+0000","last_peered":"2023-10-08T07:01:49.638640+0000","last_clean":"2023-10-08T07:01:49.638640+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:49.638640+0000","last_undegraded":"2023-10-08T07:01:49.638640+0000","last_fullsized":"2023-10-08T07:01:49.638640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_clean_scrub_stamp":"2023-10-08T07:01:49.638527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:19.403345+0000","scrub_duration":0.045952461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:23.787068+0000","last_change":"2023-10-08T07:01:23.787118+0000","last_active":"2023-10-08T07:01:23.787068+0000","last_peered":"2023-10-08T07:01:23.787068+0000","last_clean":"2023-10-08T07:01:23.787068+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:23.787068+0000","last_undegraded":"2023-10-08T07:01:23.787068+0000","last_fullsized":"2023-10-08T07:01:23.787068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_clean_scrub_stamp":"2023-10-08T07:01:23.786970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:11.680051+0000","scrub_duration":0.0020370760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.799833+0000","last_change":"2023-10-08T07:02:35.799882+0000","last_active":"2023-10-08T07:02:35.799833+0000","last_peered":"2023-10-08T07:02:35.799833+0000","last_clean":"2023-10-08T07:02:35.799833+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:02:35.799833+0000","last_undegraded":"2023-10-08T07:02:35.799833+0000","last_fullsized":"2023-10-08T07:02:35.799833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.799739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:42.966201+0000","scrub_duration":0.0016784440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.237498+0000","last_change":"2023-10-08T07:02:00.237563+0000","last_active":"2023-10-08T07:02:00.237498+0000","last_peered":"2023-10-08T07:02:00.237498+0000","last_clean":"2023-10-08T07:02:00.237498+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:02:00.237498+0000","last_undegraded":"2023-10-08T07:02:00.237498+0000","last_fullsized":"2023-10-08T07:02:00.237498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.237364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:16.425225+0000","scrub_duration":0.0020507379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:44.684847+0000","last_change":"2023-10-08T07:01:44.684911+0000","last_active":"2023-10-08T07:01:44.684847+0000","last_peered":"2023-10-08T07:01:44.684847+0000","last_clean":"2023-10-08T07:01:44.684847+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:44.684847+0000","last_undegraded":"2023-10-08T07:01:44.684847+0000","last_fullsized":"2023-10-08T07:01:44.684847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_clean_scrub_stamp":"2023-10-08T07:01:44.684726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:06.172009+0000","scrub_duration":0.0021191029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208976+0000","last_change":"2023-10-08T07:00:58.742323+0000","last_active":"2023-10-08T07:01:19.208976+0000","last_peered":"2023-10-08T07:01:19.208976+0000","last_clean":"2023-10-08T07:01:19.208976+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:01:19.208976+0000","last_undegraded":"2023-10-08T07:01:19.208976+0000","last_fullsized":"2023-10-08T07:01:19.208976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.560363+0000","last_change":"2023-10-08T07:01:45.560412+0000","last_active":"2023-10-08T07:01:45.560363+0000","last_peered":"2023-10-08T07:01:45.560363+0000","last_clean":"2023-10-08T07:01:45.560363+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:45.560363+0000","last_undegraded":"2023-10-08T07:01:45.560363+0000","last_fullsized":"2023-10-08T07:01:45.560363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.560260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:37.159112+0000","scrub_duration":0.0017976050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:27.690641+0000","last_change":"2023-10-08T07:01:27.690692+0000","last_active":"2023-10-08T07:01:27.690641+0000","last_peered":"2023-10-08T07:01:27.690641+0000","last_clean":"2023-10-08T07:01:27.690641+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:27.690641+0000","last_undegraded":"2023-10-08T07:01:27.690641+0000","last_fullsized":"2023-10-08T07:01:27.690641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_clean_scrub_stamp":"2023-10-08T07:01:27.690553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.772607+0000","scrub_duration":0.0017559400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.178065+0000","last_change":"2023-10-08T07:02:06.178108+0000","last_active":"2023-10-08T07:02:06.178065+0000","last_peered":"2023-10-08T07:02:06.178065+0000","last_clean":"2023-10-08T07:02:06.178065+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:02:06.178065+0000","last_undegraded":"2023-10-08T07:02:06.178065+0000","last_fullsized":"2023-10-08T07:02:06.178065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.177967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:14.751766+0000","scrub_duration":0.001743947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:10.856431+0000","last_change":"2023-10-08T07:00:58.690361+0000","last_active":"2023-10-08T07:01:10.856431+0000","last_peered":"2023-10-08T07:01:10.856431+0000","last_clean":"2023-10-08T07:01:10.856431+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:01:10.856431+0000","last_undegraded":"2023-10-08T07:01:10.856431+0000","last_fullsized":"2023-10-08T07:01:10.856431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208866+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:19.208866+0000","last_peered":"2023-10-08T07:01:19.208866+0000","last_clean":"2023-10-08T07:01:19.208866+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:19.208866+0000","last_undegraded":"2023-10-08T07:01:19.208866+0000","last_fullsized":"2023-10-08T07:01:19.208866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"80'159","reported_seq":287,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:38.900816+0000","last_change":"2023-10-08T07:02:38.900882+0000","last_active":"2023-10-08T07:02:38.900816+0000","last_peered":"2023-10-08T07:02:38.900816+0000","last_clean":"2023-10-08T07:02:38.900816+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:02:38.900816+0000","last_undegraded":"2023-10-08T07:02:38.900816+0000","last_fullsized":"2023-10-08T07:02:38.900816+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'159","last_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_deep_scrub":"80'159","last_deep_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_clean_scrub_stamp":"2023-10-08T07:02:38.900721+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:41.487928+0000","scrub_duration":0.0061413509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.763443+0000","last_change":"2023-10-08T07:01:24.763513+0000","last_active":"2023-10-08T07:01:24.763443+0000","last_peered":"2023-10-08T07:01:24.763443+0000","last_clean":"2023-10-08T07:01:24.763443+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:24.763443+0000","last_undegraded":"2023-10-08T07:01:24.763443+0000","last_fullsized":"2023-10-08T07:01:24.763443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.763341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:32.962887+0000","scrub_duration":0.0020468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.675374+0000","last_change":"2023-10-08T07:02:16.675417+0000","last_active":"2023-10-08T07:02:16.675374+0000","last_peered":"2023-10-08T07:02:16.675374+0000","last_clean":"2023-10-08T07:02:16.675374+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:02:16.675374+0000","last_undegraded":"2023-10-08T07:02:16.675374+0000","last_fullsized":"2023-10-08T07:02:16.675374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.675273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:47:21.079374+0000","scrub_duration":0.0018053679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:44.847461+0000","last_change":"2023-10-08T07:02:44.847506+0000","last_active":"2023-10-08T07:02:44.847461+0000","last_peered":"2023-10-08T07:02:44.847461+0000","last_clean":"2023-10-08T07:02:44.847461+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:02:44.847461+0000","last_undegraded":"2023-10-08T07:02:44.847461+0000","last_fullsized":"2023-10-08T07:02:44.847461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:44.847358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:44.847358+0000","last_clean_scrub_stamp":"2023-10-08T07:02:44.847358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:07.319083+0000","scrub_duration":0.0019174610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:22.874569+0000","last_change":"2023-10-08T07:02:22.874645+0000","last_active":"2023-10-08T07:02:22.874569+0000","last_peered":"2023-10-08T07:02:22.874569+0000","last_clean":"2023-10-08T07:02:22.874569+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:02:22.874569+0000","last_undegraded":"2023-10-08T07:02:22.874569+0000","last_fullsized":"2023-10-08T07:02:22.874569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_clean_scrub_stamp":"2023-10-08T07:02:22.874455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:16.900611+0000","scrub_duration":0.001910443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726305+0000","last_change":"2023-10-08T07:01:09.881475+0000","last_active":"2023-10-08T07:01:19.726305+0000","last_peered":"2023-10-08T07:01:19.726305+0000","last_clean":"2023-10-08T07:01:19.726305+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:01:19.726305+0000","last_undegraded":"2023-10-08T07:01:19.726305+0000","last_fullsized":"2023-10-08T07:01:19.726305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726096+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:19.726096+0000","last_peered":"2023-10-08T07:01:19.726096+0000","last_clean":"2023-10-08T07:01:19.726096+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726096+0000","last_undegraded":"2023-10-08T07:01:19.726096+0000","last_fullsized":"2023-10-08T07:01:19.726096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:58.847293+0000","last_change":"2023-10-08T07:01:58.847357+0000","last_active":"2023-10-08T07:01:58.847293+0000","last_peered":"2023-10-08T07:01:58.847293+0000","last_clean":"2023-10-08T07:01:58.847293+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:58.847293+0000","last_undegraded":"2023-10-08T07:01:58.847293+0000","last_fullsized":"2023-10-08T07:01:58.847293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_clean_scrub_stamp":"2023-10-08T07:01:58.847143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:41.440486+0000","scrub_duration":0.0019445949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:43.278902+0000","last_change":"2023-10-08T07:02:43.278982+0000","last_active":"2023-10-08T07:02:43.278902+0000","last_peered":"2023-10-08T07:02:43.278902+0000","last_clean":"2023-10-08T07:02:43.278902+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:02:43.278902+0000","last_undegraded":"2023-10-08T07:02:43.278902+0000","last_fullsized":"2023-10-08T07:02:43.278902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:43.278776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:43.278776+0000","last_clean_scrub_stamp":"2023-10-08T07:02:43.278776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:04.279739+0000","scrub_duration":0.001922834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.849243+0000","last_change":"2023-10-08T07:02:31.849308+0000","last_active":"2023-10-08T07:02:31.849243+0000","last_peered":"2023-10-08T07:02:31.849243+0000","last_clean":"2023-10-08T07:02:31.849243+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:02:31.849243+0000","last_undegraded":"2023-10-08T07:02:31.849243+0000","last_fullsized":"2023-10-08T07:02:31.849243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.849141+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:13.743926+0000","scrub_duration":0.0034446239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:38.915300+0000","last_change":"2023-10-08T07:02:38.915346+0000","last_active":"2023-10-08T07:02:38.915300+0000","last_peered":"2023-10-08T07:02:38.915300+0000","last_clean":"2023-10-08T07:02:38.915300+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:02:38.915300+0000","last_undegraded":"2023-10-08T07:02:38.915300+0000","last_fullsized":"2023-10-08T07:02:38.915300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:38.915193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:38.915193+0000","last_clean_scrub_stamp":"2023-10-08T07:02:38.915193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:40:05.802847+0000","scrub_duration":0.002041204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:17.893066+0000","last_change":"2023-10-08T07:02:17.893066+0000","last_active":"2023-10-08T07:02:17.893066+0000","last_peered":"2023-10-08T07:02:17.893066+0000","last_clean":"2023-10-08T07:02:17.893066+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:02:17.893066+0000","last_undegraded":"2023-10-08T07:02:17.893066+0000","last_fullsized":"2023-10-08T07:02:17.893066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_clean_scrub_stamp":"2023-10-08T07:02:17.892874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:31:18.798860+0000","scrub_duration":0.001774783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:41.856635+0000","last_change":"2023-10-08T07:02:41.856694+0000","last_active":"2023-10-08T07:02:41.856635+0000","last_peered":"2023-10-08T07:02:41.856635+0000","last_clean":"2023-10-08T07:02:41.856635+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:02:41.856635+0000","last_undegraded":"2023-10-08T07:02:41.856635+0000","last_fullsized":"2023-10-08T07:02:41.856635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:41.856528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:41.856528+0000","last_clean_scrub_stamp":"2023-10-08T07:02:41.856528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:20.615490+0000","scrub_duration":0.0018036809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"80'2","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.576981+0000","last_change":"2023-10-08T07:01:39.577040+0000","last_active":"2023-10-08T07:01:39.576981+0000","last_peered":"2023-10-08T07:01:39.576981+0000","last_clean":"2023-10-08T07:01:39.576981+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:39.576981+0000","last_undegraded":"2023-10-08T07:01:39.576981+0000","last_fullsized":"2023-10-08T07:01:39.576981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.576897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:14.587630+0000","scrub_duration":0.0034481989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:18.216128+0000","last_change":"2023-10-08T07:02:18.216182+0000","last_active":"2023-10-08T07:02:18.216128+0000","last_peered":"2023-10-08T07:02:18.216128+0000","last_clean":"2023-10-08T07:02:18.216128+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:02:18.216128+0000","last_undegraded":"2023-10-08T07:02:18.216128+0000","last_fullsized":"2023-10-08T07:02:18.216128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_clean_scrub_stamp":"2023-10-08T07:02:18.216021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:56.843200+0000","scrub_duration":0.001736359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:28.311926+0000","last_change":"2023-10-08T07:02:28.312022+0000","last_active":"2023-10-08T07:02:28.311926+0000","last_peered":"2023-10-08T07:02:28.311926+0000","last_clean":"2023-10-08T07:02:28.311926+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:02:28.311926+0000","last_undegraded":"2023-10-08T07:02:28.311926+0000","last_fullsized":"2023-10-08T07:02:28.311926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_clean_scrub_stamp":"2023-10-08T07:02:28.311816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:45.533624+0000","scrub_duration":0.0023094650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.216225+0000","last_change":"2023-10-08T07:01:50.216225+0000","last_active":"2023-10-08T07:01:50.216225+0000","last_peered":"2023-10-08T07:01:50.216225+0000","last_clean":"2023-10-08T07:01:50.216225+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:50.216225+0000","last_undegraded":"2023-10-08T07:01:50.216225+0000","last_fullsized":"2023-10-08T07:01:50.216225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.215973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:05.464123+0000","scrub_duration":0.002109798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"80'3","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:37.613532+0000","last_change":"2023-10-08T07:01:37.613532+0000","last_active":"2023-10-08T07:01:37.613532+0000","last_peered":"2023-10-08T07:01:37.613532+0000","last_clean":"2023-10-08T07:01:37.613532+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:37.613532+0000","last_undegraded":"2023-10-08T07:01:37.613532+0000","last_fullsized":"2023-10-08T07:01:37.613532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_clean_scrub_stamp":"2023-10-08T07:01:37.613340+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:13:09.671822+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:28.609729+0000","last_change":"2023-10-08T07:01:28.609729+0000","last_active":"2023-10-08T07:01:28.609729+0000","last_peered":"2023-10-08T07:01:28.609729+0000","last_clean":"2023-10-08T07:01:28.609729+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:28.609729+0000","last_undegraded":"2023-10-08T07:01:28.609729+0000","last_fullsized":"2023-10-08T07:01:28.609729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_clean_scrub_stamp":"2023-10-08T07:01:28.609502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:34.613067+0000","scrub_duration":0.042684845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:32.267989+0000","last_change":"2023-10-08T07:02:32.268044+0000","last_active":"2023-10-08T07:02:32.267989+0000","last_peered":"2023-10-08T07:02:32.267989+0000","last_clean":"2023-10-08T07:02:32.267989+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:02:32.267989+0000","last_undegraded":"2023-10-08T07:02:32.267989+0000","last_fullsized":"2023-10-08T07:02:32.267989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_clean_scrub_stamp":"2023-10-08T07:02:32.267883+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:44.140149+0000","scrub_duration":0.0032451989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.645000+0000","last_change":"2023-10-08T07:01:50.645000+0000","last_active":"2023-10-08T07:01:50.645000+0000","last_peered":"2023-10-08T07:01:50.645000+0000","last_clean":"2023-10-08T07:01:50.645000+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:50.645000+0000","last_undegraded":"2023-10-08T07:01:50.645000+0000","last_fullsized":"2023-10-08T07:01:50.645000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:25.236202+0000","scrub_duration":0.0017188049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:55.773529+0000","last_change":"2023-10-08T07:01:55.773529+0000","last_active":"2023-10-08T07:01:55.773529+0000","last_peered":"2023-10-08T07:01:55.773529+0000","last_clean":"2023-10-08T07:01:55.773529+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:55.773529+0000","last_undegraded":"2023-10-08T07:01:55.773529+0000","last_fullsized":"2023-10-08T07:01:55.773529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_clean_scrub_stamp":"2023-10-08T07:01:55.773378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:40.743189+0000","scrub_duration":0.001795956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:35.079468+0000","last_change":"2023-10-08T07:01:35.079468+0000","last_active":"2023-10-08T07:01:35.079468+0000","last_peered":"2023-10-08T07:01:35.079468+0000","last_clean":"2023-10-08T07:01:35.079468+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:35.079468+0000","last_undegraded":"2023-10-08T07:01:35.079468+0000","last_fullsized":"2023-10-08T07:01:35.079468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_clean_scrub_stamp":"2023-10-08T07:01:35.079301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:18.577402+0000","scrub_duration":0.014529075000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:46.601700+0000","last_change":"2023-10-08T07:01:46.601759+0000","last_active":"2023-10-08T07:01:46.601700+0000","last_peered":"2023-10-08T07:01:46.601700+0000","last_clean":"2023-10-08T07:01:46.601700+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:46.601700+0000","last_undegraded":"2023-10-08T07:01:46.601700+0000","last_fullsized":"2023-10-08T07:01:46.601700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_clean_scrub_stamp":"2023-10-08T07:01:46.601588+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:47.103452+0000","scrub_duration":0.0040752189999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.870413+0000","last_change":"2023-10-08T07:02:31.870463+0000","last_active":"2023-10-08T07:02:31.870413+0000","last_peered":"2023-10-08T07:02:31.870413+0000","last_clean":"2023-10-08T07:02:31.870413+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:02:31.870413+0000","last_undegraded":"2023-10-08T07:02:31.870413+0000","last_fullsized":"2023-10-08T07:02:31.870413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.870304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:07.614244+0000","scrub_duration":0.00218046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.717435+0000","last_change":"2023-10-08T07:02:13.717480+0000","last_active":"2023-10-08T07:02:13.717435+0000","last_peered":"2023-10-08T07:02:13.717435+0000","last_clean":"2023-10-08T07:02:13.717435+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:02:13.717435+0000","last_undegraded":"2023-10-08T07:02:13.717435+0000","last_fullsized":"2023-10-08T07:02:13.717435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:25.008447+0000","scrub_duration":0.001854704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:32.686938+0000","last_change":"2023-10-08T07:01:32.687008+0000","last_active":"2023-10-08T07:01:32.686938+0000","last_peered":"2023-10-08T07:01:32.686938+0000","last_clean":"2023-10-08T07:01:32.686938+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:32.686938+0000","last_undegraded":"2023-10-08T07:01:32.686938+0000","last_fullsized":"2023-10-08T07:01:32.686938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_clean_scrub_stamp":"2023-10-08T07:01:32.686840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:36.443277+0000","scrub_duration":0.0020720539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.174655+0000","last_change":"2023-10-08T07:02:13.174730+0000","last_active":"2023-10-08T07:02:13.174655+0000","last_peered":"2023-10-08T07:02:13.174655+0000","last_clean":"2023-10-08T07:02:13.174655+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:02:13.174655+0000","last_undegraded":"2023-10-08T07:02:13.174655+0000","last_fullsized":"2023-10-08T07:02:13.174655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.174510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:00.806909+0000","scrub_duration":0.00191114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:53.694249+0000","last_change":"2023-10-08T07:02:53.694314+0000","last_active":"2023-10-08T07:02:53.694249+0000","last_peered":"2023-10-08T07:02:53.694249+0000","last_clean":"2023-10-08T07:02:53.694249+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:02:53.694249+0000","last_undegraded":"2023-10-08T07:02:53.694249+0000","last_fullsized":"2023-10-08T07:02:53.694249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:53.694128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:53.694128+0000","last_clean_scrub_stamp":"2023-10-08T07:02:53.694128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:20.755558+0000","scrub_duration":0.021687867999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:48.161251+0000","last_change":"2023-10-08T07:02:48.161299+0000","last_active":"2023-10-08T07:02:48.161251+0000","last_peered":"2023-10-08T07:02:48.161251+0000","last_clean":"2023-10-08T07:02:48.161251+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:02:48.161251+0000","last_undegraded":"2023-10-08T07:02:48.161251+0000","last_fullsized":"2023-10-08T07:02:48.161251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:48.161150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:48.161150+0000","last_clean_scrub_stamp":"2023-10-08T07:02:48.161150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.346935+0000","scrub_duration":0.001946281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":58,"ondisk_log_size":58,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612634,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47196,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324644,"statfs":{"total":96636764160,"available":96588435456,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.38700000000000001}]},{"osd":1,"last update":"Sun Oct 8 07:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325036,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046804,"statfs":{"total":96636764160,"available":96303927296,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.157,"15min":0.157},"max":{"1min":0.70499999999999996,"5min":1.845,"15min":1.845},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.41199999999999998},"min":{"1min":0.308,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.64500000000000002,"5min":1.998,"15min":1.998},"last":0.32900000000000001}]},{"osd":2,"last update":"Sun Oct 8 07:02:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.42799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738443,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.442,"15min":0.39800000000000002},"min":{"1min":0.40600000000000003,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.66900000000000004,"5min":1.518,"15min":1.518},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51200000000000001,"15min":0.442},"min":{"1min":0.42699999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.65200000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66300000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.626,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:03:02.579 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.579 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.580 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.580 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.580 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.580 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.580 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.580 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.581 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.581 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.581 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.581 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.581 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.581 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.582 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.582 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.582 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.582 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.582 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.583 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.583 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:02.583 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:03:22.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:03:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:03:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:03:22.951 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2023-10-08T07:03:21.041102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679208,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436312,"statfs":{"total":289910292480,"available":289214783488,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002955"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:15.087377+0000","last_change":"2023-10-08T07:03:15.087428+0000","last_active":"2023-10-08T07:03:15.087377+0000","last_peered":"2023-10-08T07:03:15.087377+0000","last_clean":"2023-10-08T07:03:15.087377+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:03:15.087377+0000","last_undegraded":"2023-10-08T07:03:15.087377+0000","last_fullsized":"2023-10-08T07:03:15.087377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:15.087259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:15.087259+0000","last_clean_scrub_stamp":"2023-10-08T07:03:15.087259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:20.939370+0000","scrub_duration":0.064892219000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:26.943085+0000","last_change":"2023-10-08T07:01:26.943085+0000","last_active":"2023-10-08T07:01:26.943085+0000","last_peered":"2023-10-08T07:01:26.943085+0000","last_clean":"2023-10-08T07:01:26.943085+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:26.943085+0000","last_undegraded":"2023-10-08T07:01:26.943085+0000","last_fullsized":"2023-10-08T07:01:26.943085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_clean_scrub_stamp":"2023-10-08T07:01:26.942930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:33.364930+0000","scrub_duration":0.0017987770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:12.752541+0000","last_change":"2023-10-08T07:02:12.752610+0000","last_active":"2023-10-08T07:02:12.752541+0000","last_peered":"2023-10-08T07:02:12.752541+0000","last_clean":"2023-10-08T07:02:12.752541+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:02:12.752541+0000","last_undegraded":"2023-10-08T07:02:12.752541+0000","last_fullsized":"2023-10-08T07:02:12.752541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_clean_scrub_stamp":"2023-10-08T07:02:12.752388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.974197+0000","scrub_duration":0.0021934350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209459+0000","last_change":"2023-10-08T07:00:58.743086+0000","last_active":"2023-10-08T07:01:19.209459+0000","last_peered":"2023-10-08T07:01:19.209459+0000","last_clean":"2023-10-08T07:01:19.209459+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:01:19.209459+0000","last_undegraded":"2023-10-08T07:01:19.209459+0000","last_fullsized":"2023-10-08T07:01:19.209459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:21.969248+0000","last_change":"2023-10-08T07:01:21.969248+0000","last_active":"2023-10-08T07:01:21.969248+0000","last_peered":"2023-10-08T07:01:21.969248+0000","last_clean":"2023-10-08T07:01:21.969248+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:21.969248+0000","last_undegraded":"2023-10-08T07:01:21.969248+0000","last_fullsized":"2023-10-08T07:01:21.969248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_clean_scrub_stamp":"2023-10-08T07:01:21.969069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:37.695683+0000","scrub_duration":0.013488305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:17.761122+0000","last_change":"2023-10-08T07:03:17.761170+0000","last_active":"2023-10-08T07:03:17.761122+0000","last_peered":"2023-10-08T07:03:17.761122+0000","last_clean":"2023-10-08T07:03:17.761122+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:03:17.761122+0000","last_undegraded":"2023-10-08T07:03:17.761122+0000","last_fullsized":"2023-10-08T07:03:17.761122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:17.760994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:17.760994+0000","last_clean_scrub_stamp":"2023-10-08T07:03:17.760994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:47.560796+0000","scrub_duration":0.0020523730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:57.750404+0000","last_change":"2023-10-08T07:01:57.750404+0000","last_active":"2023-10-08T07:01:57.750404+0000","last_peered":"2023-10-08T07:01:57.750404+0000","last_clean":"2023-10-08T07:01:57.750404+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:57.750404+0000","last_undegraded":"2023-10-08T07:01:57.750404+0000","last_fullsized":"2023-10-08T07:01:57.750404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_clean_scrub_stamp":"2023-10-08T07:01:57.750253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:45.382652+0000","scrub_duration":0.012901334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:56.730073+0000","last_change":"2023-10-08T07:01:56.730073+0000","last_active":"2023-10-08T07:01:56.730073+0000","last_peered":"2023-10-08T07:01:56.730073+0000","last_clean":"2023-10-08T07:01:56.730073+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:56.730073+0000","last_undegraded":"2023-10-08T07:01:56.730073+0000","last_fullsized":"2023-10-08T07:01:56.730073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_clean_scrub_stamp":"2023-10-08T07:01:56.729910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:33.646540+0000","scrub_duration":0.001731001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.961827+0000","last_change":"2023-10-08T07:02:13.961921+0000","last_active":"2023-10-08T07:02:13.961827+0000","last_peered":"2023-10-08T07:02:13.961827+0000","last_clean":"2023-10-08T07:02:13.961827+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:02:13.961827+0000","last_undegraded":"2023-10-08T07:02:13.961827+0000","last_fullsized":"2023-10-08T07:02:13.961827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.961668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:45.329692+0000","scrub_duration":0.024638136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.174431+0000","last_change":"2023-10-08T07:01:45.174431+0000","last_active":"2023-10-08T07:01:45.174431+0000","last_peered":"2023-10-08T07:01:45.174431+0000","last_clean":"2023-10-08T07:01:45.174431+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:45.174431+0000","last_undegraded":"2023-10-08T07:01:45.174431+0000","last_fullsized":"2023-10-08T07:01:45.174431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.174265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:07.913029+0000","scrub_duration":0.002167066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209380+0000","last_change":"2023-10-08T07:00:58.744412+0000","last_active":"2023-10-08T07:01:19.209380+0000","last_peered":"2023-10-08T07:01:19.209380+0000","last_clean":"2023-10-08T07:01:19.209380+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:01:19.209380+0000","last_undegraded":"2023-10-08T07:01:19.209380+0000","last_fullsized":"2023-10-08T07:01:19.209380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:04.003038+0000","last_change":"2023-10-08T07:03:04.003088+0000","last_active":"2023-10-08T07:03:04.003038+0000","last_peered":"2023-10-08T07:03:04.003038+0000","last_clean":"2023-10-08T07:03:04.003038+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:03:04.003038+0000","last_undegraded":"2023-10-08T07:03:04.003038+0000","last_fullsized":"2023-10-08T07:03:04.003038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:04.002931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:04.002931+0000","last_clean_scrub_stamp":"2023-10-08T07:03:04.002931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:42.761893+0000","scrub_duration":0.001867676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:21.230827+0000","last_change":"2023-10-08T07:02:21.230881+0000","last_active":"2023-10-08T07:02:21.230827+0000","last_peered":"2023-10-08T07:02:21.230827+0000","last_clean":"2023-10-08T07:02:21.230827+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:02:21.230827+0000","last_undegraded":"2023-10-08T07:02:21.230827+0000","last_fullsized":"2023-10-08T07:02:21.230827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_clean_scrub_stamp":"2023-10-08T07:02:21.229837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:05.860581+0000","scrub_duration":0.013675958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:07.706313+0000","last_change":"2023-10-08T07:03:07.706367+0000","last_active":"2023-10-08T07:03:07.706313+0000","last_peered":"2023-10-08T07:03:07.706313+0000","last_clean":"2023-10-08T07:03:07.706313+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:03:07.706313+0000","last_undegraded":"2023-10-08T07:03:07.706313+0000","last_fullsized":"2023-10-08T07:03:07.706313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:07.706208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:07.706208+0000","last_clean_scrub_stamp":"2023-10-08T07:03:07.706208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:44.522736+0000","scrub_duration":0.001879209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:25.791594+0000","last_change":"2023-10-08T07:02:25.791642+0000","last_active":"2023-10-08T07:02:25.791594+0000","last_peered":"2023-10-08T07:02:25.791594+0000","last_clean":"2023-10-08T07:02:25.791594+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:02:25.791594+0000","last_undegraded":"2023-10-08T07:02:25.791594+0000","last_fullsized":"2023-10-08T07:02:25.791594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_clean_scrub_stamp":"2023-10-08T07:02:25.791498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:18.470455+0000","scrub_duration":0.0022261389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.693294+0000","last_change":"2023-10-08T07:02:06.693347+0000","last_active":"2023-10-08T07:02:06.693294+0000","last_peered":"2023-10-08T07:02:06.693294+0000","last_clean":"2023-10-08T07:02:06.693294+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:02:06.693294+0000","last_undegraded":"2023-10-08T07:02:06.693294+0000","last_fullsized":"2023-10-08T07:02:06.693294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.693202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:51.323946+0000","scrub_duration":0.001534101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.688440+0000","last_change":"2023-10-08T07:01:50.688440+0000","last_active":"2023-10-08T07:01:50.688440+0000","last_peered":"2023-10-08T07:01:50.688440+0000","last_clean":"2023-10-08T07:01:50.688440+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:50.688440+0000","last_undegraded":"2023-10-08T07:01:50.688440+0000","last_fullsized":"2023-10-08T07:01:50.688440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.688235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:07.345735+0000","scrub_duration":0.058960934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.178032+0000","last_change":"2023-10-08T07:02:04.178077+0000","last_active":"2023-10-08T07:02:04.178032+0000","last_peered":"2023-10-08T07:02:04.178032+0000","last_clean":"2023-10-08T07:02:04.178032+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:02:04.178032+0000","last_undegraded":"2023-10-08T07:02:04.178032+0000","last_fullsized":"2023-10-08T07:02:04.178032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.177926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.809779+0000","scrub_duration":0.001839074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:09.853986+0000","last_change":"2023-10-08T07:02:09.853986+0000","last_active":"2023-10-08T07:02:09.853986+0000","last_peered":"2023-10-08T07:02:09.853986+0000","last_clean":"2023-10-08T07:02:09.853986+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:02:09.853986+0000","last_undegraded":"2023-10-08T07:02:09.853986+0000","last_fullsized":"2023-10-08T07:02:09.853986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_clean_scrub_stamp":"2023-10-08T07:02:09.853744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:31:03.195743+0000","scrub_duration":0.02129166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209296+0000","last_change":"2023-10-08T07:00:58.743619+0000","last_active":"2023-10-08T07:01:19.209296+0000","last_peered":"2023-10-08T07:01:19.209296+0000","last_clean":"2023-10-08T07:01:19.209296+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:01:19.209296+0000","last_undegraded":"2023-10-08T07:01:19.209296+0000","last_fullsized":"2023-10-08T07:01:19.209296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:31.610403+0000","last_change":"2023-10-08T07:01:31.610403+0000","last_active":"2023-10-08T07:01:31.610403+0000","last_peered":"2023-10-08T07:01:31.610403+0000","last_clean":"2023-10-08T07:01:31.610403+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:31.610403+0000","last_undegraded":"2023-10-08T07:01:31.610403+0000","last_fullsized":"2023-10-08T07:01:31.610403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_clean_scrub_stamp":"2023-10-08T07:01:31.610144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:26.179749+0000","scrub_duration":0.024703487999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:07.985849+0000","last_change":"2023-10-08T07:03:07.985906+0000","last_active":"2023-10-08T07:03:07.985849+0000","last_peered":"2023-10-08T07:03:07.985849+0000","last_clean":"2023-10-08T07:03:07.985849+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:03:07.985849+0000","last_undegraded":"2023-10-08T07:03:07.985849+0000","last_fullsized":"2023-10-08T07:03:07.985849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:07.985732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:07.985732+0000","last_clean_scrub_stamp":"2023-10-08T07:03:07.985732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:38.442929+0000","scrub_duration":0.001845539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.817194+0000","last_change":"2023-10-08T07:02:00.817194+0000","last_active":"2023-10-08T07:02:00.817194+0000","last_peered":"2023-10-08T07:02:00.817194+0000","last_clean":"2023-10-08T07:02:00.817194+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:02:00.817194+0000","last_undegraded":"2023-10-08T07:02:00.817194+0000","last_fullsized":"2023-10-08T07:02:00.817194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.817055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:43.652542+0000","scrub_duration":0.0020658320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.987480+0000","last_change":"2023-10-08T07:01:24.987480+0000","last_active":"2023-10-08T07:01:24.987480+0000","last_peered":"2023-10-08T07:01:24.987480+0000","last_clean":"2023-10-08T07:01:24.987480+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:24.987480+0000","last_undegraded":"2023-10-08T07:01:24.987480+0000","last_fullsized":"2023-10-08T07:01:24.987480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.987290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:07.099956+0000","scrub_duration":0.0019193140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.234880+0000","last_change":"2023-10-08T07:02:23.234951+0000","last_active":"2023-10-08T07:02:23.234880+0000","last_peered":"2023-10-08T07:02:23.234880+0000","last_clean":"2023-10-08T07:02:23.234880+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:02:23.234880+0000","last_undegraded":"2023-10-08T07:02:23.234880+0000","last_fullsized":"2023-10-08T07:02:23.234880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.234752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:30.102430+0000","scrub_duration":0.037375644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:52.717261+0000","last_change":"2023-10-08T07:02:52.717261+0000","last_active":"2023-10-08T07:02:52.717261+0000","last_peered":"2023-10-08T07:02:52.717261+0000","last_clean":"2023-10-08T07:02:52.717261+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:02:52.717261+0000","last_undegraded":"2023-10-08T07:02:52.717261+0000","last_fullsized":"2023-10-08T07:02:52.717261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:52.717060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:52.717060+0000","last_clean_scrub_stamp":"2023-10-08T07:02:52.717060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:25.752353+0000","scrub_duration":0.0020455719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:08.671486+0000","last_change":"2023-10-08T07:02:08.671550+0000","last_active":"2023-10-08T07:02:08.671486+0000","last_peered":"2023-10-08T07:02:08.671486+0000","last_clean":"2023-10-08T07:02:08.671486+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:02:08.671486+0000","last_undegraded":"2023-10-08T07:02:08.671486+0000","last_fullsized":"2023-10-08T07:02:08.671486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_clean_scrub_stamp":"2023-10-08T07:02:08.671339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:29.879286+0000","scrub_duration":0.001757886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726163+0000","last_change":"2023-10-08T07:01:09.884312+0000","last_active":"2023-10-08T07:01:19.726163+0000","last_peered":"2023-10-08T07:01:19.726163+0000","last_clean":"2023-10-08T07:01:19.726163+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726163+0000","last_undegraded":"2023-10-08T07:01:19.726163+0000","last_fullsized":"2023-10-08T07:01:19.726163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:05.217103+0000","last_change":"2023-10-08T07:02:05.217103+0000","last_active":"2023-10-08T07:02:05.217103+0000","last_peered":"2023-10-08T07:02:05.217103+0000","last_clean":"2023-10-08T07:02:05.217103+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:02:05.217103+0000","last_undegraded":"2023-10-08T07:02:05.217103+0000","last_fullsized":"2023-10-08T07:02:05.217103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_clean_scrub_stamp":"2023-10-08T07:02:05.216949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:39.808310+0000","scrub_duration":0.0020402969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.931817+0000","last_change":"2023-10-08T07:02:33.931866+0000","last_active":"2023-10-08T07:02:33.931817+0000","last_peered":"2023-10-08T07:02:33.931817+0000","last_clean":"2023-10-08T07:02:33.931817+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:02:33.931817+0000","last_undegraded":"2023-10-08T07:02:33.931817+0000","last_fullsized":"2023-10-08T07:02:33.931817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.931709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:41.216079+0000","scrub_duration":0.0019470710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:05.607430+0000","last_change":"2023-10-08T07:03:05.607491+0000","last_active":"2023-10-08T07:03:05.607430+0000","last_peered":"2023-10-08T07:03:05.607430+0000","last_clean":"2023-10-08T07:03:05.607430+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:03:05.607430+0000","last_undegraded":"2023-10-08T07:03:05.607430+0000","last_fullsized":"2023-10-08T07:03:05.607430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:05.607292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:05.607292+0000","last_clean_scrub_stamp":"2023-10-08T07:03:05.607292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:31.955704+0000","scrub_duration":0.0020200050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:59.853347+0000","last_change":"2023-10-08T07:01:59.853394+0000","last_active":"2023-10-08T07:01:59.853347+0000","last_peered":"2023-10-08T07:01:59.853347+0000","last_clean":"2023-10-08T07:01:59.853347+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:59.853347+0000","last_undegraded":"2023-10-08T07:01:59.853347+0000","last_fullsized":"2023-10-08T07:01:59.853347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_clean_scrub_stamp":"2023-10-08T07:01:59.853244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:32.293985+0000","scrub_duration":0.002167183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:11.225174+0000","last_change":"2023-10-08T07:02:11.225253+0000","last_active":"2023-10-08T07:02:11.225174+0000","last_peered":"2023-10-08T07:02:11.225174+0000","last_clean":"2023-10-08T07:02:11.225174+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:02:11.225174+0000","last_undegraded":"2023-10-08T07:02:11.225174+0000","last_fullsized":"2023-10-08T07:02:11.225174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_clean_scrub_stamp":"2023-10-08T07:02:11.225019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:48.141649+0000","scrub_duration":0.067035265999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:51.713000+0000","last_change":"2023-10-08T07:02:51.713047+0000","last_active":"2023-10-08T07:02:51.713000+0000","last_peered":"2023-10-08T07:02:51.713000+0000","last_clean":"2023-10-08T07:02:51.713000+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:02:51.713000+0000","last_undegraded":"2023-10-08T07:02:51.713000+0000","last_fullsized":"2023-10-08T07:02:51.713000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:51.712903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:51.712903+0000","last_clean_scrub_stamp":"2023-10-08T07:02:51.712903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:19.973256+0000","scrub_duration":0.0021159619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:27.796666+0000","last_change":"2023-10-08T07:02:27.796666+0000","last_active":"2023-10-08T07:02:27.796666+0000","last_peered":"2023-10-08T07:02:27.796666+0000","last_clean":"2023-10-08T07:02:27.796666+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:02:27.796666+0000","last_undegraded":"2023-10-08T07:02:27.796666+0000","last_fullsized":"2023-10-08T07:02:27.796666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_clean_scrub_stamp":"2023-10-08T07:02:27.796523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:56.809518+0000","scrub_duration":0.0019890369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:30.574748+0000","last_change":"2023-10-08T07:01:30.574748+0000","last_active":"2023-10-08T07:01:30.574748+0000","last_peered":"2023-10-08T07:01:30.574748+0000","last_clean":"2023-10-08T07:01:30.574748+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:30.574748+0000","last_undegraded":"2023-10-08T07:01:30.574748+0000","last_fullsized":"2023-10-08T07:01:30.574748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_clean_scrub_stamp":"2023-10-08T07:01:30.574594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:52.811528+0000","scrub_duration":0.0024001500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:50.716353+0000","last_change":"2023-10-08T07:02:50.716353+0000","last_active":"2023-10-08T07:02:50.716353+0000","last_peered":"2023-10-08T07:02:50.716353+0000","last_clean":"2023-10-08T07:02:50.716353+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:02:50.716353+0000","last_undegraded":"2023-10-08T07:02:50.716353+0000","last_fullsized":"2023-10-08T07:02:50.716353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:50.716192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:50.716192+0000","last_clean_scrub_stamp":"2023-10-08T07:02:50.716192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:12.681382+0000","scrub_duration":0.0020375620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"80'5","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:29.272021+0000","last_change":"2023-10-08T07:02:29.272082+0000","last_active":"2023-10-08T07:02:29.272021+0000","last_peered":"2023-10-08T07:02:29.272021+0000","last_clean":"2023-10-08T07:02:29.272021+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:02:29.272021+0000","last_undegraded":"2023-10-08T07:02:29.272021+0000","last_fullsized":"2023-10-08T07:02:29.272021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_clean_scrub_stamp":"2023-10-08T07:02:29.271932+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:17.488172+0000","scrub_duration":0.0039090369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.838844+0000","last_change":"2023-10-08T07:02:23.838844+0000","last_active":"2023-10-08T07:02:23.838844+0000","last_peered":"2023-10-08T07:02:23.838844+0000","last_clean":"2023-10-08T07:02:23.838844+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:02:23.838844+0000","last_undegraded":"2023-10-08T07:02:23.838844+0000","last_fullsized":"2023-10-08T07:02:23.838844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.838707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:40.234311+0000","scrub_duration":0.0019657749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"80'10","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:50.795841+0000","last_change":"2023-10-08T07:02:50.795896+0000","last_active":"2023-10-08T07:02:50.795841+0000","last_peered":"2023-10-08T07:02:50.795841+0000","last_clean":"2023-10-08T07:02:50.795841+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:02:50.795841+0000","last_undegraded":"2023-10-08T07:02:50.795841+0000","last_fullsized":"2023-10-08T07:02:50.795841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2023-10-08T07:02:50.795745+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2023-10-08T07:02:50.795745+0000","last_clean_scrub_stamp":"2023-10-08T07:02:50.795745+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:46:23.869486+0000","scrub_duration":0.0072464310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:37.862068+0000","last_change":"2023-10-08T07:02:37.862114+0000","last_active":"2023-10-08T07:02:37.862068+0000","last_peered":"2023-10-08T07:02:37.862068+0000","last_clean":"2023-10-08T07:02:37.862068+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:02:37.862068+0000","last_undegraded":"2023-10-08T07:02:37.862068+0000","last_fullsized":"2023-10-08T07:02:37.862068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_clean_scrub_stamp":"2023-10-08T07:02:37.861974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:59.365584+0000","scrub_duration":0.001729883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209043+0000","last_change":"2023-10-08T07:00:58.743486+0000","last_active":"2023-10-08T07:01:19.209043+0000","last_peered":"2023-10-08T07:01:19.209043+0000","last_clean":"2023-10-08T07:01:19.209043+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:01:19.209043+0000","last_undegraded":"2023-10-08T07:01:19.209043+0000","last_fullsized":"2023-10-08T07:01:19.209043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:15.298730+0000","last_clean_scrub_stamp":"2023-10-08T06:57:15.298730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726352+0000","last_change":"2023-10-08T07:01:09.882348+0000","last_active":"2023-10-08T07:01:19.726352+0000","last_peered":"2023-10-08T07:01:19.726352+0000","last_clean":"2023-10-08T07:01:19.726352+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:01:19.726352+0000","last_undegraded":"2023-10-08T07:01:19.726352+0000","last_fullsized":"2023-10-08T07:01:19.726352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.873360+0000","last_change":"2023-10-08T07:02:16.873360+0000","last_active":"2023-10-08T07:02:16.873360+0000","last_peered":"2023-10-08T07:02:16.873360+0000","last_clean":"2023-10-08T07:02:16.873360+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:02:16.873360+0000","last_undegraded":"2023-10-08T07:02:16.873360+0000","last_fullsized":"2023-10-08T07:02:16.873360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.873196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:35.207672+0000","scrub_duration":0.0021297239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:06.012571+0000","last_change":"2023-10-08T07:03:06.012657+0000","last_active":"2023-10-08T07:03:06.012571+0000","last_peered":"2023-10-08T07:03:06.012571+0000","last_clean":"2023-10-08T07:03:06.012571+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:03:06.012571+0000","last_undegraded":"2023-10-08T07:03:06.012571+0000","last_fullsized":"2023-10-08T07:03:06.012571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:06.012462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:06.012462+0000","last_clean_scrub_stamp":"2023-10-08T07:03:06.012462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:28.484187+0000","scrub_duration":0.014583298999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:40.351235+0000","last_change":"2023-10-08T07:02:40.351294+0000","last_active":"2023-10-08T07:02:40.351235+0000","last_peered":"2023-10-08T07:02:40.351235+0000","last_clean":"2023-10-08T07:02:40.351235+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:02:40.351235+0000","last_undegraded":"2023-10-08T07:02:40.351235+0000","last_fullsized":"2023-10-08T07:02:40.351235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:40.351137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:40.351137+0000","last_clean_scrub_stamp":"2023-10-08T07:02:40.351137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:06.577610+0000","scrub_duration":0.0020890739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:55.691775+0000","last_change":"2023-10-08T07:02:55.691820+0000","last_active":"2023-10-08T07:02:55.691775+0000","last_peered":"2023-10-08T07:02:55.691775+0000","last_clean":"2023-10-08T07:02:55.691775+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:02:55.691775+0000","last_undegraded":"2023-10-08T07:02:55.691775+0000","last_fullsized":"2023-10-08T07:02:55.691775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:55.691688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:55.691688+0000","last_clean_scrub_stamp":"2023-10-08T07:02:55.691688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:54.277341+0000","scrub_duration":0.001779648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"80'12","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:58.765122+0000","last_change":"2023-10-08T07:02:58.765189+0000","last_active":"2023-10-08T07:02:58.765122+0000","last_peered":"2023-10-08T07:02:58.765122+0000","last_clean":"2023-10-08T07:02:58.765122+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:02:58.765122+0000","last_undegraded":"2023-10-08T07:02:58.765122+0000","last_fullsized":"2023-10-08T07:02:58.765122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2023-10-08T07:02:58.765028+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2023-10-08T07:02:58.765028+0000","last_clean_scrub_stamp":"2023-10-08T07:02:58.765028+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:58.956075+0000","scrub_duration":0.0045723480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:06.669117+0000","last_change":"2023-10-08T07:03:06.669179+0000","last_active":"2023-10-08T07:03:06.669117+0000","last_peered":"2023-10-08T07:03:06.669117+0000","last_clean":"2023-10-08T07:03:06.669117+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:03:06.669117+0000","last_undegraded":"2023-10-08T07:03:06.669117+0000","last_fullsized":"2023-10-08T07:03:06.669117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:06.669001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:06.669001+0000","last_clean_scrub_stamp":"2023-10-08T07:03:06.669001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:35.603957+0000","scrub_duration":0.047189749000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"80'2","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:53.783782+0000","last_change":"2023-10-08T07:02:53.783833+0000","last_active":"2023-10-08T07:02:53.783782+0000","last_peered":"2023-10-08T07:02:53.783782+0000","last_clean":"2023-10-08T07:02:53.783782+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:02:53.783782+0000","last_undegraded":"2023-10-08T07:02:53.783782+0000","last_fullsized":"2023-10-08T07:02:53.783782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:02:53.783686+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:02:53.783686+0000","last_clean_scrub_stamp":"2023-10-08T07:02:53.783686+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:27.748260+0000","scrub_duration":0.00336974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:41.305921+0000","last_change":"2023-10-08T07:02:41.306003+0000","last_active":"2023-10-08T07:02:41.305921+0000","last_peered":"2023-10-08T07:02:41.305921+0000","last_clean":"2023-10-08T07:02:41.305921+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:02:41.305921+0000","last_undegraded":"2023-10-08T07:02:41.305921+0000","last_fullsized":"2023-10-08T07:02:41.305921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:41.305820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:41.305820+0000","last_clean_scrub_stamp":"2023-10-08T07:02:41.305820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:49.119162+0000","scrub_duration":0.001850464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.306868+0000","last_change":"2023-10-08T07:02:35.306939+0000","last_active":"2023-10-08T07:02:35.306868+0000","last_peered":"2023-10-08T07:02:35.306868+0000","last_clean":"2023-10-08T07:02:35.306868+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:02:35.306868+0000","last_undegraded":"2023-10-08T07:02:35.306868+0000","last_fullsized":"2023-10-08T07:02:35.306868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.306760+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:26.941872+0000","scrub_duration":0.0033496849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:48.225570+0000","last_change":"2023-10-08T07:01:48.225616+0000","last_active":"2023-10-08T07:01:48.225570+0000","last_peered":"2023-10-08T07:01:48.225570+0000","last_clean":"2023-10-08T07:01:48.225570+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:48.225570+0000","last_undegraded":"2023-10-08T07:01:48.225570+0000","last_fullsized":"2023-10-08T07:01:48.225570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_clean_scrub_stamp":"2023-10-08T07:01:48.225481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:42.795086+0000","scrub_duration":0.001625563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"80'2","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:01.751134+0000","last_change":"2023-10-08T07:03:01.751190+0000","last_active":"2023-10-08T07:03:01.751134+0000","last_peered":"2023-10-08T07:03:01.751134+0000","last_clean":"2023-10-08T07:03:01.751134+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:03:01.751134+0000","last_undegraded":"2023-10-08T07:03:01.751134+0000","last_fullsized":"2023-10-08T07:03:01.751134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:03:01.751040+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:03:01.751040+0000","last_clean_scrub_stamp":"2023-10-08T07:03:01.751040+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:40:31.796513+0000","scrub_duration":0.0035994170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.209124+0000","last_change":"2023-10-08T07:00:58.744709+0000","last_active":"2023-10-08T07:01:19.209124+0000","last_peered":"2023-10-08T07:01:19.209124+0000","last_clean":"2023-10-08T07:01:19.209124+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:01:19.209124+0000","last_undegraded":"2023-10-08T07:01:19.209124+0000","last_fullsized":"2023-10-08T07:01:19.209124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:16.304401+0000","last_clean_scrub_stamp":"2023-10-08T06:57:16.304401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:10.762620+0000","last_change":"2023-10-08T07:02:10.762696+0000","last_active":"2023-10-08T07:02:10.762620+0000","last_peered":"2023-10-08T07:02:10.762620+0000","last_clean":"2023-10-08T07:02:10.762620+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:02:10.762620+0000","last_undegraded":"2023-10-08T07:02:10.762620+0000","last_fullsized":"2023-10-08T07:02:10.762620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_clean_scrub_stamp":"2023-10-08T07:02:10.762509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:26.540080+0000","scrub_duration":0.001712603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:01.817861+0000","last_change":"2023-10-08T07:02:01.817861+0000","last_active":"2023-10-08T07:02:01.817861+0000","last_peered":"2023-10-08T07:02:01.817861+0000","last_clean":"2023-10-08T07:02:01.817861+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:02:01.817861+0000","last_undegraded":"2023-10-08T07:02:01.817861+0000","last_fullsized":"2023-10-08T07:02:01.817861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_clean_scrub_stamp":"2023-10-08T07:02:01.817590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:34.561641+0000","scrub_duration":0.020576817000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'3","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:26.843409+0000","last_change":"2023-10-08T07:02:26.843409+0000","last_active":"2023-10-08T07:02:26.843409+0000","last_peered":"2023-10-08T07:02:26.843409+0000","last_clean":"2023-10-08T07:02:26.843409+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:02:26.843409+0000","last_undegraded":"2023-10-08T07:02:26.843409+0000","last_fullsized":"2023-10-08T07:02:26.843409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_clean_scrub_stamp":"2023-10-08T07:02:26.843242+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:19.529204+0000","scrub_duration":0.003535131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.803998+0000","last_change":"2023-10-08T07:02:23.804050+0000","last_active":"2023-10-08T07:02:23.803998+0000","last_peered":"2023-10-08T07:02:23.803998+0000","last_clean":"2023-10-08T07:02:23.803998+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:02:23.803998+0000","last_undegraded":"2023-10-08T07:02:23.803998+0000","last_fullsized":"2023-10-08T07:02:23.803998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.803862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:53:23.043385+0000","scrub_duration":0.001807763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:51.695353+0000","last_change":"2023-10-08T07:01:51.695353+0000","last_active":"2023-10-08T07:01:51.695353+0000","last_peered":"2023-10-08T07:01:51.695353+0000","last_clean":"2023-10-08T07:01:51.695353+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:51.695353+0000","last_undegraded":"2023-10-08T07:01:51.695353+0000","last_fullsized":"2023-10-08T07:01:51.695353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_clean_scrub_stamp":"2023-10-08T07:01:51.695202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.269000+0000","scrub_duration":0.001739123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.803673+0000","last_change":"2023-10-08T07:02:33.803718+0000","last_active":"2023-10-08T07:02:33.803673+0000","last_peered":"2023-10-08T07:02:33.803673+0000","last_clean":"2023-10-08T07:02:33.803673+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:02:33.803673+0000","last_undegraded":"2023-10-08T07:02:33.803673+0000","last_fullsized":"2023-10-08T07:02:33.803673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.803572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:15:37.351173+0000","scrub_duration":0.0015426999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:22.981449+0000","last_change":"2023-10-08T07:01:22.981449+0000","last_active":"2023-10-08T07:01:22.981449+0000","last_peered":"2023-10-08T07:01:22.981449+0000","last_clean":"2023-10-08T07:01:22.981449+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:22.981449+0000","last_undegraded":"2023-10-08T07:01:22.981449+0000","last_fullsized":"2023-10-08T07:01:22.981449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_clean_scrub_stamp":"2023-10-08T07:01:22.981312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:27.955182+0000","scrub_duration":0.0020775799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.688387+0000","last_change":"2023-10-08T07:02:04.688434+0000","last_active":"2023-10-08T07:02:04.688387+0000","last_peered":"2023-10-08T07:02:04.688387+0000","last_clean":"2023-10-08T07:02:04.688387+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:02:04.688387+0000","last_undegraded":"2023-10-08T07:02:04.688387+0000","last_fullsized":"2023-10-08T07:02:04.688387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.688267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:43.315446+0000","scrub_duration":0.0020964360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.038967+0000","last_change":"2023-10-08T07:01:39.038967+0000","last_active":"2023-10-08T07:01:39.038967+0000","last_peered":"2023-10-08T07:01:39.038967+0000","last_clean":"2023-10-08T07:01:39.038967+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:39.038967+0000","last_undegraded":"2023-10-08T07:01:39.038967+0000","last_fullsized":"2023-10-08T07:01:39.038967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.038786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:33.889107+0000","scrub_duration":0.0024023780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:49.638700+0000","last_change":"2023-10-08T07:01:49.638700+0000","last_active":"2023-10-08T07:01:49.638700+0000","last_peered":"2023-10-08T07:01:49.638700+0000","last_clean":"2023-10-08T07:01:49.638700+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:49.638700+0000","last_undegraded":"2023-10-08T07:01:49.638700+0000","last_fullsized":"2023-10-08T07:01:49.638700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_clean_scrub_stamp":"2023-10-08T07:01:49.638527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:19.403345+0000","scrub_duration":0.045952461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:23.787118+0000","last_change":"2023-10-08T07:01:23.787118+0000","last_active":"2023-10-08T07:01:23.787118+0000","last_peered":"2023-10-08T07:01:23.787118+0000","last_clean":"2023-10-08T07:01:23.787118+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:23.787118+0000","last_undegraded":"2023-10-08T07:01:23.787118+0000","last_fullsized":"2023-10-08T07:01:23.787118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_clean_scrub_stamp":"2023-10-08T07:01:23.786970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:11.680051+0000","scrub_duration":0.0020370760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.799833+0000","last_change":"2023-10-08T07:02:35.799882+0000","last_active":"2023-10-08T07:02:35.799833+0000","last_peered":"2023-10-08T07:02:35.799833+0000","last_clean":"2023-10-08T07:02:35.799833+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:02:35.799833+0000","last_undegraded":"2023-10-08T07:02:35.799833+0000","last_fullsized":"2023-10-08T07:02:35.799833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.799739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:42.966201+0000","scrub_duration":0.0016784440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.237498+0000","last_change":"2023-10-08T07:02:00.237563+0000","last_active":"2023-10-08T07:02:00.237498+0000","last_peered":"2023-10-08T07:02:00.237498+0000","last_clean":"2023-10-08T07:02:00.237498+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:02:00.237498+0000","last_undegraded":"2023-10-08T07:02:00.237498+0000","last_fullsized":"2023-10-08T07:02:00.237498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.237364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:16.425225+0000","scrub_duration":0.0020507379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:44.684847+0000","last_change":"2023-10-08T07:01:44.684911+0000","last_active":"2023-10-08T07:01:44.684847+0000","last_peered":"2023-10-08T07:01:44.684847+0000","last_clean":"2023-10-08T07:01:44.684847+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:44.684847+0000","last_undegraded":"2023-10-08T07:01:44.684847+0000","last_fullsized":"2023-10-08T07:01:44.684847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_clean_scrub_stamp":"2023-10-08T07:01:44.684726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:06.172009+0000","scrub_duration":0.0021191029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:18.751797+0000","last_change":"2023-10-08T07:03:18.751861+0000","last_active":"2023-10-08T07:03:18.751797+0000","last_peered":"2023-10-08T07:03:18.751797+0000","last_clean":"2023-10-08T07:03:18.751797+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:03:18.751797+0000","last_undegraded":"2023-10-08T07:03:18.751797+0000","last_fullsized":"2023-10-08T07:03:18.751797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:18.751699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:18.751699+0000","last_clean_scrub_stamp":"2023-10-08T07:03:18.751699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:18:34.652284+0000","scrub_duration":0.0017849910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.560412+0000","last_change":"2023-10-08T07:01:45.560412+0000","last_active":"2023-10-08T07:01:45.560412+0000","last_peered":"2023-10-08T07:01:45.560412+0000","last_clean":"2023-10-08T07:01:45.560412+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:45.560412+0000","last_undegraded":"2023-10-08T07:01:45.560412+0000","last_fullsized":"2023-10-08T07:01:45.560412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.560260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:37.159112+0000","scrub_duration":0.0017976050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:27.690692+0000","last_change":"2023-10-08T07:01:27.690692+0000","last_active":"2023-10-08T07:01:27.690692+0000","last_peered":"2023-10-08T07:01:27.690692+0000","last_clean":"2023-10-08T07:01:27.690692+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:27.690692+0000","last_undegraded":"2023-10-08T07:01:27.690692+0000","last_fullsized":"2023-10-08T07:01:27.690692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_clean_scrub_stamp":"2023-10-08T07:01:27.690553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.772607+0000","scrub_duration":0.0017559400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.178108+0000","last_change":"2023-10-08T07:02:06.178108+0000","last_active":"2023-10-08T07:02:06.178108+0000","last_peered":"2023-10-08T07:02:06.178108+0000","last_clean":"2023-10-08T07:02:06.178108+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:02:06.178108+0000","last_undegraded":"2023-10-08T07:02:06.178108+0000","last_fullsized":"2023-10-08T07:02:06.178108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.177967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:14.751766+0000","scrub_duration":0.001743947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:57.694877+0000","last_change":"2023-10-08T07:02:57.694877+0000","last_active":"2023-10-08T07:02:57.694877+0000","last_peered":"2023-10-08T07:02:57.694877+0000","last_clean":"2023-10-08T07:02:57.694877+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:02:57.694877+0000","last_undegraded":"2023-10-08T07:02:57.694877+0000","last_fullsized":"2023-10-08T07:02:57.694877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:57.694675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:57.694675+0000","last_clean_scrub_stamp":"2023-10-08T07:02:57.694675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:38.567861+0000","scrub_duration":0.024052681999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.208866+0000","last_change":"2023-10-08T07:00:58.741978+0000","last_active":"2023-10-08T07:01:19.208866+0000","last_peered":"2023-10-08T07:01:19.208866+0000","last_clean":"2023-10-08T07:01:19.208866+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:01:19.208866+0000","last_undegraded":"2023-10-08T07:01:19.208866+0000","last_fullsized":"2023-10-08T07:01:19.208866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"80'159","reported_seq":288,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:38.900882+0000","last_change":"2023-10-08T07:02:38.900882+0000","last_active":"2023-10-08T07:02:38.900882+0000","last_peered":"2023-10-08T07:02:38.900882+0000","last_clean":"2023-10-08T07:02:38.900882+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:02:38.900882+0000","last_undegraded":"2023-10-08T07:02:38.900882+0000","last_fullsized":"2023-10-08T07:02:38.900882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'159","last_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_deep_scrub":"80'159","last_deep_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_clean_scrub_stamp":"2023-10-08T07:02:38.900721+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:41.487928+0000","scrub_duration":0.0061413509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.763513+0000","last_change":"2023-10-08T07:01:24.763513+0000","last_active":"2023-10-08T07:01:24.763513+0000","last_peered":"2023-10-08T07:01:24.763513+0000","last_clean":"2023-10-08T07:01:24.763513+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:24.763513+0000","last_undegraded":"2023-10-08T07:01:24.763513+0000","last_fullsized":"2023-10-08T07:01:24.763513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.763341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:32.962887+0000","scrub_duration":0.0020468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.675374+0000","last_change":"2023-10-08T07:02:16.675417+0000","last_active":"2023-10-08T07:02:16.675374+0000","last_peered":"2023-10-08T07:02:16.675374+0000","last_clean":"2023-10-08T07:02:16.675374+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:02:16.675374+0000","last_undegraded":"2023-10-08T07:02:16.675374+0000","last_fullsized":"2023-10-08T07:02:16.675374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.675273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:47:21.079374+0000","scrub_duration":0.0018053679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:44.847506+0000","last_change":"2023-10-08T07:02:44.847506+0000","last_active":"2023-10-08T07:02:44.847506+0000","last_peered":"2023-10-08T07:02:44.847506+0000","last_clean":"2023-10-08T07:02:44.847506+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:02:44.847506+0000","last_undegraded":"2023-10-08T07:02:44.847506+0000","last_fullsized":"2023-10-08T07:02:44.847506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:44.847358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:44.847358+0000","last_clean_scrub_stamp":"2023-10-08T07:02:44.847358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:07.319083+0000","scrub_duration":0.0019174610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:22.874645+0000","last_change":"2023-10-08T07:02:22.874645+0000","last_active":"2023-10-08T07:02:22.874645+0000","last_peered":"2023-10-08T07:02:22.874645+0000","last_clean":"2023-10-08T07:02:22.874645+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:02:22.874645+0000","last_undegraded":"2023-10-08T07:02:22.874645+0000","last_fullsized":"2023-10-08T07:02:22.874645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_clean_scrub_stamp":"2023-10-08T07:02:22.874455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:16.900611+0000","scrub_duration":0.001910443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:02.002405+0000","last_change":"2023-10-08T07:03:02.002455+0000","last_active":"2023-10-08T07:03:02.002405+0000","last_peered":"2023-10-08T07:03:02.002405+0000","last_clean":"2023-10-08T07:03:02.002405+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:03:02.002405+0000","last_undegraded":"2023-10-08T07:03:02.002405+0000","last_fullsized":"2023-10-08T07:03:02.002405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:02.002305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:02.002305+0000","last_clean_scrub_stamp":"2023-10-08T07:03:02.002305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:33.893589+0000","scrub_duration":0.0018476129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:19.726096+0000","last_change":"2023-10-08T07:01:09.884358+0000","last_active":"2023-10-08T07:01:19.726096+0000","last_peered":"2023-10-08T07:01:19.726096+0000","last_clean":"2023-10-08T07:01:19.726096+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:01:19.726096+0000","last_undegraded":"2023-10-08T07:01:19.726096+0000","last_fullsized":"2023-10-08T07:01:19.726096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:57:10.278471+0000","last_clean_scrub_stamp":"2023-10-08T06:57:10.278471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:58.847357+0000","last_change":"2023-10-08T07:01:58.847357+0000","last_active":"2023-10-08T07:01:58.847357+0000","last_peered":"2023-10-08T07:01:58.847357+0000","last_clean":"2023-10-08T07:01:58.847357+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:58.847357+0000","last_undegraded":"2023-10-08T07:01:58.847357+0000","last_fullsized":"2023-10-08T07:01:58.847357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_clean_scrub_stamp":"2023-10-08T07:01:58.847143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:41.440486+0000","scrub_duration":0.0019445949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:43.278902+0000","last_change":"2023-10-08T07:02:43.278982+0000","last_active":"2023-10-08T07:02:43.278902+0000","last_peered":"2023-10-08T07:02:43.278902+0000","last_clean":"2023-10-08T07:02:43.278902+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:02:43.278902+0000","last_undegraded":"2023-10-08T07:02:43.278902+0000","last_fullsized":"2023-10-08T07:02:43.278902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:43.278776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:43.278776+0000","last_clean_scrub_stamp":"2023-10-08T07:02:43.278776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:04.279739+0000","scrub_duration":0.001922834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'3","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.849308+0000","last_change":"2023-10-08T07:02:31.849308+0000","last_active":"2023-10-08T07:02:31.849308+0000","last_peered":"2023-10-08T07:02:31.849308+0000","last_clean":"2023-10-08T07:02:31.849308+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:02:31.849308+0000","last_undegraded":"2023-10-08T07:02:31.849308+0000","last_fullsized":"2023-10-08T07:02:31.849308+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.849141+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:13.743926+0000","scrub_duration":0.0034446239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:38.915346+0000","last_change":"2023-10-08T07:02:38.915346+0000","last_active":"2023-10-08T07:02:38.915346+0000","last_peered":"2023-10-08T07:02:38.915346+0000","last_clean":"2023-10-08T07:02:38.915346+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:02:38.915346+0000","last_undegraded":"2023-10-08T07:02:38.915346+0000","last_fullsized":"2023-10-08T07:02:38.915346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:38.915193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:38.915193+0000","last_clean_scrub_stamp":"2023-10-08T07:02:38.915193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:40:05.802847+0000","scrub_duration":0.002041204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:17.893066+0000","last_change":"2023-10-08T07:02:17.893066+0000","last_active":"2023-10-08T07:02:17.893066+0000","last_peered":"2023-10-08T07:02:17.893066+0000","last_clean":"2023-10-08T07:02:17.893066+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:02:17.893066+0000","last_undegraded":"2023-10-08T07:02:17.893066+0000","last_fullsized":"2023-10-08T07:02:17.893066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_clean_scrub_stamp":"2023-10-08T07:02:17.892874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:31:18.798860+0000","scrub_duration":0.001774783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:41.856635+0000","last_change":"2023-10-08T07:02:41.856694+0000","last_active":"2023-10-08T07:02:41.856635+0000","last_peered":"2023-10-08T07:02:41.856635+0000","last_clean":"2023-10-08T07:02:41.856635+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:02:41.856635+0000","last_undegraded":"2023-10-08T07:02:41.856635+0000","last_fullsized":"2023-10-08T07:02:41.856635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:41.856528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:41.856528+0000","last_clean_scrub_stamp":"2023-10-08T07:02:41.856528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:20.615490+0000","scrub_duration":0.0018036809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"80'2","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.577040+0000","last_change":"2023-10-08T07:01:39.577040+0000","last_active":"2023-10-08T07:01:39.577040+0000","last_peered":"2023-10-08T07:01:39.577040+0000","last_clean":"2023-10-08T07:01:39.577040+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:39.577040+0000","last_undegraded":"2023-10-08T07:01:39.577040+0000","last_fullsized":"2023-10-08T07:01:39.577040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.576897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:14.587630+0000","scrub_duration":0.0034481989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:18.216128+0000","last_change":"2023-10-08T07:02:18.216182+0000","last_active":"2023-10-08T07:02:18.216128+0000","last_peered":"2023-10-08T07:02:18.216128+0000","last_clean":"2023-10-08T07:02:18.216128+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:02:18.216128+0000","last_undegraded":"2023-10-08T07:02:18.216128+0000","last_fullsized":"2023-10-08T07:02:18.216128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_clean_scrub_stamp":"2023-10-08T07:02:18.216021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:56.843200+0000","scrub_duration":0.001736359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:28.311926+0000","last_change":"2023-10-08T07:02:28.312022+0000","last_active":"2023-10-08T07:02:28.311926+0000","last_peered":"2023-10-08T07:02:28.311926+0000","last_clean":"2023-10-08T07:02:28.311926+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:02:28.311926+0000","last_undegraded":"2023-10-08T07:02:28.311926+0000","last_fullsized":"2023-10-08T07:02:28.311926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_clean_scrub_stamp":"2023-10-08T07:02:28.311816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:45.533624+0000","scrub_duration":0.0023094650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.216225+0000","last_change":"2023-10-08T07:01:50.216225+0000","last_active":"2023-10-08T07:01:50.216225+0000","last_peered":"2023-10-08T07:01:50.216225+0000","last_clean":"2023-10-08T07:01:50.216225+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:50.216225+0000","last_undegraded":"2023-10-08T07:01:50.216225+0000","last_fullsized":"2023-10-08T07:01:50.216225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.215973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:05.464123+0000","scrub_duration":0.002109798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"80'3","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:37.613532+0000","last_change":"2023-10-08T07:01:37.613532+0000","last_active":"2023-10-08T07:01:37.613532+0000","last_peered":"2023-10-08T07:01:37.613532+0000","last_clean":"2023-10-08T07:01:37.613532+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:37.613532+0000","last_undegraded":"2023-10-08T07:01:37.613532+0000","last_fullsized":"2023-10-08T07:01:37.613532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_clean_scrub_stamp":"2023-10-08T07:01:37.613340+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:13:09.671822+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:28.609729+0000","last_change":"2023-10-08T07:01:28.609729+0000","last_active":"2023-10-08T07:01:28.609729+0000","last_peered":"2023-10-08T07:01:28.609729+0000","last_clean":"2023-10-08T07:01:28.609729+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:28.609729+0000","last_undegraded":"2023-10-08T07:01:28.609729+0000","last_fullsized":"2023-10-08T07:01:28.609729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_clean_scrub_stamp":"2023-10-08T07:01:28.609502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:34.613067+0000","scrub_duration":0.042684845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:32.267989+0000","last_change":"2023-10-08T07:02:32.268044+0000","last_active":"2023-10-08T07:02:32.267989+0000","last_peered":"2023-10-08T07:02:32.267989+0000","last_clean":"2023-10-08T07:02:32.267989+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:02:32.267989+0000","last_undegraded":"2023-10-08T07:02:32.267989+0000","last_fullsized":"2023-10-08T07:02:32.267989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_clean_scrub_stamp":"2023-10-08T07:02:32.267883+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:44.140149+0000","scrub_duration":0.0032451989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.645000+0000","last_change":"2023-10-08T07:01:50.645000+0000","last_active":"2023-10-08T07:01:50.645000+0000","last_peered":"2023-10-08T07:01:50.645000+0000","last_clean":"2023-10-08T07:01:50.645000+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:50.645000+0000","last_undegraded":"2023-10-08T07:01:50.645000+0000","last_fullsized":"2023-10-08T07:01:50.645000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:25.236202+0000","scrub_duration":0.0017188049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:55.773529+0000","last_change":"2023-10-08T07:01:55.773529+0000","last_active":"2023-10-08T07:01:55.773529+0000","last_peered":"2023-10-08T07:01:55.773529+0000","last_clean":"2023-10-08T07:01:55.773529+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:55.773529+0000","last_undegraded":"2023-10-08T07:01:55.773529+0000","last_fullsized":"2023-10-08T07:01:55.773529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_clean_scrub_stamp":"2023-10-08T07:01:55.773378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:40.743189+0000","scrub_duration":0.001795956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:35.079468+0000","last_change":"2023-10-08T07:01:35.079468+0000","last_active":"2023-10-08T07:01:35.079468+0000","last_peered":"2023-10-08T07:01:35.079468+0000","last_clean":"2023-10-08T07:01:35.079468+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:35.079468+0000","last_undegraded":"2023-10-08T07:01:35.079468+0000","last_fullsized":"2023-10-08T07:01:35.079468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_clean_scrub_stamp":"2023-10-08T07:01:35.079301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:18.577402+0000","scrub_duration":0.014529075000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:46.601759+0000","last_change":"2023-10-08T07:01:46.601759+0000","last_active":"2023-10-08T07:01:46.601759+0000","last_peered":"2023-10-08T07:01:46.601759+0000","last_clean":"2023-10-08T07:01:46.601759+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:46.601759+0000","last_undegraded":"2023-10-08T07:01:46.601759+0000","last_fullsized":"2023-10-08T07:01:46.601759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_clean_scrub_stamp":"2023-10-08T07:01:46.601588+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:47.103452+0000","scrub_duration":0.0040752189999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.870413+0000","last_change":"2023-10-08T07:02:31.870463+0000","last_active":"2023-10-08T07:02:31.870413+0000","last_peered":"2023-10-08T07:02:31.870413+0000","last_clean":"2023-10-08T07:02:31.870413+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:02:31.870413+0000","last_undegraded":"2023-10-08T07:02:31.870413+0000","last_fullsized":"2023-10-08T07:02:31.870413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.870304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:07.614244+0000","scrub_duration":0.00218046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.717435+0000","last_change":"2023-10-08T07:02:13.717480+0000","last_active":"2023-10-08T07:02:13.717435+0000","last_peered":"2023-10-08T07:02:13.717435+0000","last_clean":"2023-10-08T07:02:13.717435+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:02:13.717435+0000","last_undegraded":"2023-10-08T07:02:13.717435+0000","last_fullsized":"2023-10-08T07:02:13.717435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:25.008447+0000","scrub_duration":0.001854704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:32.687008+0000","last_change":"2023-10-08T07:01:32.687008+0000","last_active":"2023-10-08T07:01:32.687008+0000","last_peered":"2023-10-08T07:01:32.687008+0000","last_clean":"2023-10-08T07:01:32.687008+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:32.687008+0000","last_undegraded":"2023-10-08T07:01:32.687008+0000","last_fullsized":"2023-10-08T07:01:32.687008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_clean_scrub_stamp":"2023-10-08T07:01:32.686840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:36.443277+0000","scrub_duration":0.0020720539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.174730+0000","last_change":"2023-10-08T07:02:13.174730+0000","last_active":"2023-10-08T07:02:13.174730+0000","last_peered":"2023-10-08T07:02:13.174730+0000","last_clean":"2023-10-08T07:02:13.174730+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:02:13.174730+0000","last_undegraded":"2023-10-08T07:02:13.174730+0000","last_fullsized":"2023-10-08T07:02:13.174730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.174510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:00.806909+0000","scrub_duration":0.00191114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:53.694314+0000","last_change":"2023-10-08T07:02:53.694314+0000","last_active":"2023-10-08T07:02:53.694314+0000","last_peered":"2023-10-08T07:02:53.694314+0000","last_clean":"2023-10-08T07:02:53.694314+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:02:53.694314+0000","last_undegraded":"2023-10-08T07:02:53.694314+0000","last_fullsized":"2023-10-08T07:02:53.694314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:53.694128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:53.694128+0000","last_clean_scrub_stamp":"2023-10-08T07:02:53.694128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:20.755558+0000","scrub_duration":0.021687867999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:48.161251+0000","last_change":"2023-10-08T07:02:48.161299+0000","last_active":"2023-10-08T07:02:48.161251+0000","last_peered":"2023-10-08T07:02:48.161251+0000","last_clean":"2023-10-08T07:02:48.161251+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:02:48.161251+0000","last_undegraded":"2023-10-08T07:02:48.161251+0000","last_fullsized":"2023-10-08T07:02:48.161251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:48.161150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:48.161150+0000","last_clean_scrub_stamp":"2023-10-08T07:02:48.161150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.346935+0000","scrub_duration":0.001946281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":59,"ondisk_log_size":59,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612638,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47196,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324644,"statfs":{"total":96636764160,"available":96588435456,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.626,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60899999999999999,"5min":0.622,"15min":0.622},"last":0.501}]},{"osd":1,"last update":"Sun Oct 8 07:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.55900000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325036,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046804,"statfs":{"total":96636764160,"available":96303927296,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:03:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.375},"min":{"1min":0.29199999999999998,"5min":0.157,"15min":0.157},"max":{"1min":0.59699999999999998,"5min":1.845,"15min":1.845},"last":0.503},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.442,"15min":0.41599999999999998},"min":{"1min":0.32900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.58199999999999996,"5min":1.998,"15min":1.998},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Oct 8 07:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.63100000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57199999999999995,"5min":0.629,"15min":0.629},"last":0.46200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.40799999999999997},"min":{"1min":0.42999999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.71399999999999997,"5min":1.518,"15min":1.518},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.45000000000000001},"min":{"1min":0.39600000000000002,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.73999999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.42799999999999999}]},{"osd":2,"last update":"Sun Oct 8 07:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66300000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.626,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.34300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:03:22.958 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.958 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.959 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.959 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.959 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T06:57:15.298730+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.959 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.960 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T06:57:16.304401+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.960 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.960 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T06:57:10.278471+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=57, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=1, tm_sec=17, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:03:22.961 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:03:42.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:03:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:03:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-08T07:03:43.330 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2023-10-08T07:03:43.047131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":679208,"kb_used_data":2704,"kb_used_omap":9,"kb_used_meta":676470,"kb_avail":282436312,"statfs":{"total":289910292480,"available":289214783488,"internally_reserved":0,"allocated":2768896,"data_stored":2201196,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10057,"internal_metadata":692705463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003179"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:15.087428+0000","last_change":"2023-10-08T07:03:15.087428+0000","last_active":"2023-10-08T07:03:15.087428+0000","last_peered":"2023-10-08T07:03:15.087428+0000","last_clean":"2023-10-08T07:03:15.087428+0000","last_became_active":"2023-10-08T07:01:09.883995+0000","last_became_peered":"2023-10-08T07:01:09.883995+0000","last_unstale":"2023-10-08T07:03:15.087428+0000","last_undegraded":"2023-10-08T07:03:15.087428+0000","last_fullsized":"2023-10-08T07:03:15.087428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:15.087259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:15.087259+0000","last_clean_scrub_stamp":"2023-10-08T07:03:15.087259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:20.939370+0000","scrub_duration":0.064892219000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:29.128848+0000","last_change":"2023-10-08T07:01:26.943085+0000","last_active":"2023-10-08T07:01:29.128848+0000","last_peered":"2023-10-08T07:01:29.128848+0000","last_clean":"2023-10-08T07:01:29.128848+0000","last_became_active":"2023-10-08T07:00:58.756530+0000","last_became_peered":"2023-10-08T07:00:58.756530+0000","last_unstale":"2023-10-08T07:01:29.128848+0000","last_undegraded":"2023-10-08T07:01:29.128848+0000","last_fullsized":"2023-10-08T07:01:29.128848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:26.942930+0000","last_clean_scrub_stamp":"2023-10-08T07:01:26.942930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:33.364930+0000","scrub_duration":0.0017987770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:12.752610+0000","last_change":"2023-10-08T07:02:12.752610+0000","last_active":"2023-10-08T07:02:12.752610+0000","last_peered":"2023-10-08T07:02:12.752610+0000","last_clean":"2023-10-08T07:02:12.752610+0000","last_became_active":"2023-10-08T06:57:17.336664+0000","last_became_peered":"2023-10-08T06:57:17.336664+0000","last_unstale":"2023-10-08T07:02:12.752610+0000","last_undegraded":"2023-10-08T07:02:12.752610+0000","last_fullsized":"2023-10-08T07:02:12.752610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:12.752388+0000","last_clean_scrub_stamp":"2023-10-08T07:02:12.752388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:29.974197+0000","scrub_duration":0.0021934350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:21.746066+0000","last_change":"2023-10-08T07:03:21.746110+0000","last_active":"2023-10-08T07:03:21.746066+0000","last_peered":"2023-10-08T07:03:21.746066+0000","last_clean":"2023-10-08T07:03:21.746066+0000","last_became_active":"2023-10-08T07:00:58.742015+0000","last_became_peered":"2023-10-08T07:00:58.742015+0000","last_unstale":"2023-10-08T07:03:21.746066+0000","last_undegraded":"2023-10-08T07:03:21.746066+0000","last_fullsized":"2023-10-08T07:03:21.746066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:21.745973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:21.745973+0000","last_clean_scrub_stamp":"2023-10-08T07:03:21.745973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:54.399949+0000","scrub_duration":0.0016676919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:21.969248+0000","last_change":"2023-10-08T07:01:21.969248+0000","last_active":"2023-10-08T07:01:21.969248+0000","last_peered":"2023-10-08T07:01:21.969248+0000","last_clean":"2023-10-08T07:01:21.969248+0000","last_became_active":"2023-10-08T07:01:09.881198+0000","last_became_peered":"2023-10-08T07:01:09.881198+0000","last_unstale":"2023-10-08T07:01:21.969248+0000","last_undegraded":"2023-10-08T07:01:21.969248+0000","last_fullsized":"2023-10-08T07:01:21.969248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:21.969069+0000","last_clean_scrub_stamp":"2023-10-08T07:01:21.969069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:37.695683+0000","scrub_duration":0.013488305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:17.761122+0000","last_change":"2023-10-08T07:03:17.761170+0000","last_active":"2023-10-08T07:03:17.761122+0000","last_peered":"2023-10-08T07:03:17.761122+0000","last_clean":"2023-10-08T07:03:17.761122+0000","last_became_active":"2023-10-08T07:00:58.742291+0000","last_became_peered":"2023-10-08T07:00:58.742291+0000","last_unstale":"2023-10-08T07:03:17.761122+0000","last_undegraded":"2023-10-08T07:03:17.761122+0000","last_fullsized":"2023-10-08T07:03:17.761122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:17.760994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:17.760994+0000","last_clean_scrub_stamp":"2023-10-08T07:03:17.760994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:47.560796+0000","scrub_duration":0.0020523730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:57.750404+0000","last_change":"2023-10-08T07:01:57.750404+0000","last_active":"2023-10-08T07:01:57.750404+0000","last_peered":"2023-10-08T07:01:57.750404+0000","last_clean":"2023-10-08T07:01:57.750404+0000","last_became_active":"2023-10-08T07:00:58.741248+0000","last_became_peered":"2023-10-08T07:00:58.741248+0000","last_unstale":"2023-10-08T07:01:57.750404+0000","last_undegraded":"2023-10-08T07:01:57.750404+0000","last_fullsized":"2023-10-08T07:01:57.750404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:57.750253+0000","last_clean_scrub_stamp":"2023-10-08T07:01:57.750253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:45.382652+0000","scrub_duration":0.012901334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:56.730073+0000","last_change":"2023-10-08T07:01:56.730073+0000","last_active":"2023-10-08T07:01:56.730073+0000","last_peered":"2023-10-08T07:01:56.730073+0000","last_clean":"2023-10-08T07:01:56.730073+0000","last_became_active":"2023-10-08T07:00:58.741552+0000","last_became_peered":"2023-10-08T07:00:58.741552+0000","last_unstale":"2023-10-08T07:01:56.730073+0000","last_undegraded":"2023-10-08T07:01:56.730073+0000","last_fullsized":"2023-10-08T07:01:56.730073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:56.729910+0000","last_clean_scrub_stamp":"2023-10-08T07:01:56.729910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:33.646540+0000","scrub_duration":0.001731001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.961921+0000","last_change":"2023-10-08T07:02:13.961921+0000","last_active":"2023-10-08T07:02:13.961921+0000","last_peered":"2023-10-08T07:02:13.961921+0000","last_clean":"2023-10-08T07:02:13.961921+0000","last_became_active":"2023-10-08T07:00:58.689206+0000","last_became_peered":"2023-10-08T07:00:58.689206+0000","last_unstale":"2023-10-08T07:02:13.961921+0000","last_undegraded":"2023-10-08T07:02:13.961921+0000","last_fullsized":"2023-10-08T07:02:13.961921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.961668+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.961668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:45.329692+0000","scrub_duration":0.024638136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.174431+0000","last_change":"2023-10-08T07:01:45.174431+0000","last_active":"2023-10-08T07:01:45.174431+0000","last_peered":"2023-10-08T07:01:45.174431+0000","last_clean":"2023-10-08T07:01:45.174431+0000","last_became_active":"2023-10-08T07:00:58.756544+0000","last_became_peered":"2023-10-08T07:00:58.756544+0000","last_unstale":"2023-10-08T07:01:45.174431+0000","last_undegraded":"2023-10-08T07:01:45.174431+0000","last_fullsized":"2023-10-08T07:01:45.174431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.174265+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.174265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:07.913029+0000","scrub_duration":0.002167066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:19.718398+0000","last_change":"2023-10-08T07:03:19.718482+0000","last_active":"2023-10-08T07:03:19.718398+0000","last_peered":"2023-10-08T07:03:19.718398+0000","last_clean":"2023-10-08T07:03:19.718398+0000","last_became_active":"2023-10-08T07:00:58.743464+0000","last_became_peered":"2023-10-08T07:00:58.743464+0000","last_unstale":"2023-10-08T07:03:19.718398+0000","last_undegraded":"2023-10-08T07:03:19.718398+0000","last_fullsized":"2023-10-08T07:03:19.718398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:19.718261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:19.718261+0000","last_clean_scrub_stamp":"2023-10-08T07:03:19.718261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:21:02.462457+0000","scrub_duration":0.013572267000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:04.003088+0000","last_change":"2023-10-08T07:03:04.003088+0000","last_active":"2023-10-08T07:03:04.003088+0000","last_peered":"2023-10-08T07:03:04.003088+0000","last_clean":"2023-10-08T07:03:04.003088+0000","last_became_active":"2023-10-08T07:01:09.881165+0000","last_became_peered":"2023-10-08T07:01:09.881165+0000","last_unstale":"2023-10-08T07:03:04.003088+0000","last_undegraded":"2023-10-08T07:03:04.003088+0000","last_fullsized":"2023-10-08T07:03:04.003088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:04.002931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:04.002931+0000","last_clean_scrub_stamp":"2023-10-08T07:03:04.002931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:42.761893+0000","scrub_duration":0.001867676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:21.230827+0000","last_change":"2023-10-08T07:02:21.230881+0000","last_active":"2023-10-08T07:02:21.230827+0000","last_peered":"2023-10-08T07:02:21.230827+0000","last_clean":"2023-10-08T07:02:21.230827+0000","last_became_active":"2023-10-08T07:01:09.879462+0000","last_became_peered":"2023-10-08T07:01:09.879462+0000","last_unstale":"2023-10-08T07:02:21.230827+0000","last_undegraded":"2023-10-08T07:02:21.230827+0000","last_fullsized":"2023-10-08T07:02:21.230827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:21.229837+0000","last_clean_scrub_stamp":"2023-10-08T07:02:21.229837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:05.860581+0000","scrub_duration":0.013675958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:07.706313+0000","last_change":"2023-10-08T07:03:07.706367+0000","last_active":"2023-10-08T07:03:07.706313+0000","last_peered":"2023-10-08T07:03:07.706313+0000","last_clean":"2023-10-08T07:03:07.706313+0000","last_became_active":"2023-10-08T06:57:17.330182+0000","last_became_peered":"2023-10-08T06:57:17.330182+0000","last_unstale":"2023-10-08T07:03:07.706313+0000","last_undegraded":"2023-10-08T07:03:07.706313+0000","last_fullsized":"2023-10-08T07:03:07.706313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:07.706208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:07.706208+0000","last_clean_scrub_stamp":"2023-10-08T07:03:07.706208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:44.522736+0000","scrub_duration":0.001879209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:25.791594+0000","last_change":"2023-10-08T07:02:25.791642+0000","last_active":"2023-10-08T07:02:25.791594+0000","last_peered":"2023-10-08T07:02:25.791594+0000","last_clean":"2023-10-08T07:02:25.791594+0000","last_became_active":"2023-10-08T06:57:17.333217+0000","last_became_peered":"2023-10-08T06:57:17.333217+0000","last_unstale":"2023-10-08T07:02:25.791594+0000","last_undegraded":"2023-10-08T07:02:25.791594+0000","last_fullsized":"2023-10-08T07:02:25.791594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:25.791498+0000","last_clean_scrub_stamp":"2023-10-08T07:02:25.791498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:18.470455+0000","scrub_duration":0.0022261389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.693294+0000","last_change":"2023-10-08T07:02:06.693347+0000","last_active":"2023-10-08T07:02:06.693294+0000","last_peered":"2023-10-08T07:02:06.693294+0000","last_clean":"2023-10-08T07:02:06.693294+0000","last_became_active":"2023-10-08T07:00:58.741403+0000","last_became_peered":"2023-10-08T07:00:58.741403+0000","last_unstale":"2023-10-08T07:02:06.693294+0000","last_undegraded":"2023-10-08T07:02:06.693294+0000","last_fullsized":"2023-10-08T07:02:06.693294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.693202+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.693202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:51.323946+0000","scrub_duration":0.001534101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.688440+0000","last_change":"2023-10-08T07:01:50.688440+0000","last_active":"2023-10-08T07:01:50.688440+0000","last_peered":"2023-10-08T07:01:50.688440+0000","last_clean":"2023-10-08T07:01:50.688440+0000","last_became_active":"2023-10-08T07:00:58.688299+0000","last_became_peered":"2023-10-08T07:00:58.688299+0000","last_unstale":"2023-10-08T07:01:50.688440+0000","last_undegraded":"2023-10-08T07:01:50.688440+0000","last_fullsized":"2023-10-08T07:01:50.688440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.688235+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.688235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:07.345735+0000","scrub_duration":0.058960934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.178032+0000","last_change":"2023-10-08T07:02:04.178077+0000","last_active":"2023-10-08T07:02:04.178032+0000","last_peered":"2023-10-08T07:02:04.178032+0000","last_clean":"2023-10-08T07:02:04.178032+0000","last_became_active":"2023-10-08T07:00:58.756916+0000","last_became_peered":"2023-10-08T07:00:58.756916+0000","last_unstale":"2023-10-08T07:02:04.178032+0000","last_undegraded":"2023-10-08T07:02:04.178032+0000","last_fullsized":"2023-10-08T07:02:04.178032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.177926+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.177926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.809779+0000","scrub_duration":0.001839074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:09.853986+0000","last_change":"2023-10-08T07:02:09.853986+0000","last_active":"2023-10-08T07:02:09.853986+0000","last_peered":"2023-10-08T07:02:09.853986+0000","last_clean":"2023-10-08T07:02:09.853986+0000","last_became_active":"2023-10-08T07:00:58.687537+0000","last_became_peered":"2023-10-08T07:00:58.687537+0000","last_unstale":"2023-10-08T07:02:09.853986+0000","last_undegraded":"2023-10-08T07:02:09.853986+0000","last_fullsized":"2023-10-08T07:02:09.853986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:09.853744+0000","last_clean_scrub_stamp":"2023-10-08T07:02:09.853744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:31:03.195743+0000","scrub_duration":0.02129166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:27.894202+0000","last_change":"2023-10-08T07:03:27.894272+0000","last_active":"2023-10-08T07:03:27.894202+0000","last_peered":"2023-10-08T07:03:27.894202+0000","last_clean":"2023-10-08T07:03:27.894202+0000","last_became_active":"2023-10-08T07:00:58.743047+0000","last_became_peered":"2023-10-08T07:00:58.743047+0000","last_unstale":"2023-10-08T07:03:27.894202+0000","last_undegraded":"2023-10-08T07:03:27.894202+0000","last_fullsized":"2023-10-08T07:03:27.894202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:27.894107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:27.894107+0000","last_clean_scrub_stamp":"2023-10-08T07:03:27.894107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:40.010718+0000","scrub_duration":0.0019738939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:31.610403+0000","last_change":"2023-10-08T07:01:31.610403+0000","last_active":"2023-10-08T07:01:31.610403+0000","last_peered":"2023-10-08T07:01:31.610403+0000","last_clean":"2023-10-08T07:01:31.610403+0000","last_became_active":"2023-10-08T07:00:58.743025+0000","last_became_peered":"2023-10-08T07:00:58.743025+0000","last_unstale":"2023-10-08T07:01:31.610403+0000","last_undegraded":"2023-10-08T07:01:31.610403+0000","last_fullsized":"2023-10-08T07:01:31.610403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:31.610144+0000","last_clean_scrub_stamp":"2023-10-08T07:01:31.610144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:26.179749+0000","scrub_duration":0.024703487999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:07.985906+0000","last_change":"2023-10-08T07:03:07.985906+0000","last_active":"2023-10-08T07:03:07.985906+0000","last_peered":"2023-10-08T07:03:07.985906+0000","last_clean":"2023-10-08T07:03:07.985906+0000","last_became_active":"2023-10-08T07:01:09.881994+0000","last_became_peered":"2023-10-08T07:01:09.881994+0000","last_unstale":"2023-10-08T07:03:07.985906+0000","last_undegraded":"2023-10-08T07:03:07.985906+0000","last_fullsized":"2023-10-08T07:03:07.985906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:07.985732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:07.985732+0000","last_clean_scrub_stamp":"2023-10-08T07:03:07.985732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:38.442929+0000","scrub_duration":0.001845539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.817194+0000","last_change":"2023-10-08T07:02:00.817194+0000","last_active":"2023-10-08T07:02:00.817194+0000","last_peered":"2023-10-08T07:02:00.817194+0000","last_clean":"2023-10-08T07:02:00.817194+0000","last_became_active":"2023-10-08T07:00:58.668599+0000","last_became_peered":"2023-10-08T07:00:58.668599+0000","last_unstale":"2023-10-08T07:02:00.817194+0000","last_undegraded":"2023-10-08T07:02:00.817194+0000","last_fullsized":"2023-10-08T07:02:00.817194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.817055+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.817055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:43.652542+0000","scrub_duration":0.0020658320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.987480+0000","last_change":"2023-10-08T07:01:24.987480+0000","last_active":"2023-10-08T07:01:24.987480+0000","last_peered":"2023-10-08T07:01:24.987480+0000","last_clean":"2023-10-08T07:01:24.987480+0000","last_became_active":"2023-10-08T07:00:58.756888+0000","last_became_peered":"2023-10-08T07:00:58.756888+0000","last_unstale":"2023-10-08T07:01:24.987480+0000","last_undegraded":"2023-10-08T07:01:24.987480+0000","last_fullsized":"2023-10-08T07:01:24.987480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.987290+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.987290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:07.099956+0000","scrub_duration":0.0019193140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.234880+0000","last_change":"2023-10-08T07:02:23.234951+0000","last_active":"2023-10-08T07:02:23.234880+0000","last_peered":"2023-10-08T07:02:23.234880+0000","last_clean":"2023-10-08T07:02:23.234880+0000","last_became_active":"2023-10-08T06:57:17.333597+0000","last_became_peered":"2023-10-08T06:57:17.333597+0000","last_unstale":"2023-10-08T07:02:23.234880+0000","last_undegraded":"2023-10-08T07:02:23.234880+0000","last_fullsized":"2023-10-08T07:02:23.234880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.234752+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.234752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:30.102430+0000","scrub_duration":0.037375644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:52.717261+0000","last_change":"2023-10-08T07:02:52.717261+0000","last_active":"2023-10-08T07:02:52.717261+0000","last_peered":"2023-10-08T07:02:52.717261+0000","last_clean":"2023-10-08T07:02:52.717261+0000","last_became_active":"2023-10-08T07:00:58.674779+0000","last_became_peered":"2023-10-08T07:00:58.674779+0000","last_unstale":"2023-10-08T07:02:52.717261+0000","last_undegraded":"2023-10-08T07:02:52.717261+0000","last_fullsized":"2023-10-08T07:02:52.717261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:52.717060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:52.717060+0000","last_clean_scrub_stamp":"2023-10-08T07:02:52.717060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:25.752353+0000","scrub_duration":0.0020455719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:08.671486+0000","last_change":"2023-10-08T07:02:08.671550+0000","last_active":"2023-10-08T07:02:08.671486+0000","last_peered":"2023-10-08T07:02:08.671486+0000","last_clean":"2023-10-08T07:02:08.671486+0000","last_became_active":"2023-10-08T06:57:17.338484+0000","last_became_peered":"2023-10-08T06:57:17.338484+0000","last_unstale":"2023-10-08T07:02:08.671486+0000","last_undegraded":"2023-10-08T07:02:08.671486+0000","last_fullsized":"2023-10-08T07:02:08.671486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:08.671339+0000","last_clean_scrub_stamp":"2023-10-08T07:02:08.671339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:29.879286+0000","scrub_duration":0.001757886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:27.008678+0000","last_change":"2023-10-08T07:03:27.008729+0000","last_active":"2023-10-08T07:03:27.008678+0000","last_peered":"2023-10-08T07:03:27.008678+0000","last_clean":"2023-10-08T07:03:27.008678+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:03:27.008678+0000","last_undegraded":"2023-10-08T07:03:27.008678+0000","last_fullsized":"2023-10-08T07:03:27.008678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:03:27.008575+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:03:27.008575+0000","last_clean_scrub_stamp":"2023-10-08T07:03:27.008575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:00.914495+0000","scrub_duration":0.0017313599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:05.217103+0000","last_change":"2023-10-08T07:02:05.217103+0000","last_active":"2023-10-08T07:02:05.217103+0000","last_peered":"2023-10-08T07:02:05.217103+0000","last_clean":"2023-10-08T07:02:05.217103+0000","last_became_active":"2023-10-08T06:57:17.341920+0000","last_became_peered":"2023-10-08T06:57:17.341920+0000","last_unstale":"2023-10-08T07:02:05.217103+0000","last_undegraded":"2023-10-08T07:02:05.217103+0000","last_fullsized":"2023-10-08T07:02:05.217103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:05.216949+0000","last_clean_scrub_stamp":"2023-10-08T07:02:05.216949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:39.808310+0000","scrub_duration":0.0020402969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.931866+0000","last_change":"2023-10-08T07:02:33.931866+0000","last_active":"2023-10-08T07:02:33.931866+0000","last_peered":"2023-10-08T07:02:33.931866+0000","last_clean":"2023-10-08T07:02:33.931866+0000","last_became_active":"2023-10-08T07:00:58.667309+0000","last_became_peered":"2023-10-08T07:00:58.667309+0000","last_unstale":"2023-10-08T07:02:33.931866+0000","last_undegraded":"2023-10-08T07:02:33.931866+0000","last_fullsized":"2023-10-08T07:02:33.931866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.931709+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.931709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:41.216079+0000","scrub_duration":0.0019470710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:05.607430+0000","last_change":"2023-10-08T07:03:05.607491+0000","last_active":"2023-10-08T07:03:05.607430+0000","last_peered":"2023-10-08T07:03:05.607430+0000","last_clean":"2023-10-08T07:03:05.607430+0000","last_became_active":"2023-10-08T07:00:58.674525+0000","last_became_peered":"2023-10-08T07:00:58.674525+0000","last_unstale":"2023-10-08T07:03:05.607430+0000","last_undegraded":"2023-10-08T07:03:05.607430+0000","last_fullsized":"2023-10-08T07:03:05.607430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:05.607292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:05.607292+0000","last_clean_scrub_stamp":"2023-10-08T07:03:05.607292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:31.955704+0000","scrub_duration":0.0020200050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:59.853394+0000","last_change":"2023-10-08T07:01:59.853394+0000","last_active":"2023-10-08T07:01:59.853394+0000","last_peered":"2023-10-08T07:01:59.853394+0000","last_clean":"2023-10-08T07:01:59.853394+0000","last_became_active":"2023-10-08T07:00:58.686417+0000","last_became_peered":"2023-10-08T07:00:58.686417+0000","last_unstale":"2023-10-08T07:01:59.853394+0000","last_undegraded":"2023-10-08T07:01:59.853394+0000","last_fullsized":"2023-10-08T07:01:59.853394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:59.853244+0000","last_clean_scrub_stamp":"2023-10-08T07:01:59.853244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:32.293985+0000","scrub_duration":0.002167183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:11.225253+0000","last_change":"2023-10-08T07:02:11.225253+0000","last_active":"2023-10-08T07:02:11.225253+0000","last_peered":"2023-10-08T07:02:11.225253+0000","last_clean":"2023-10-08T07:02:11.225253+0000","last_became_active":"2023-10-08T06:57:17.336057+0000","last_became_peered":"2023-10-08T06:57:17.336057+0000","last_unstale":"2023-10-08T07:02:11.225253+0000","last_undegraded":"2023-10-08T07:02:11.225253+0000","last_fullsized":"2023-10-08T07:02:11.225253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:11.225019+0000","last_clean_scrub_stamp":"2023-10-08T07:02:11.225019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:48.141649+0000","scrub_duration":0.067035265999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:51.713047+0000","last_change":"2023-10-08T07:02:51.713047+0000","last_active":"2023-10-08T07:02:51.713047+0000","last_peered":"2023-10-08T07:02:51.713047+0000","last_clean":"2023-10-08T07:02:51.713047+0000","last_became_active":"2023-10-08T07:00:58.673987+0000","last_became_peered":"2023-10-08T07:00:58.673987+0000","last_unstale":"2023-10-08T07:02:51.713047+0000","last_undegraded":"2023-10-08T07:02:51.713047+0000","last_fullsized":"2023-10-08T07:02:51.713047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:51.712903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:51.712903+0000","last_clean_scrub_stamp":"2023-10-08T07:02:51.712903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:19.973256+0000","scrub_duration":0.0021159619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:27.796666+0000","last_change":"2023-10-08T07:02:27.796666+0000","last_active":"2023-10-08T07:02:27.796666+0000","last_peered":"2023-10-08T07:02:27.796666+0000","last_clean":"2023-10-08T07:02:27.796666+0000","last_became_active":"2023-10-08T07:00:58.667365+0000","last_became_peered":"2023-10-08T07:00:58.667365+0000","last_unstale":"2023-10-08T07:02:27.796666+0000","last_undegraded":"2023-10-08T07:02:27.796666+0000","last_fullsized":"2023-10-08T07:02:27.796666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:27.796523+0000","last_clean_scrub_stamp":"2023-10-08T07:02:27.796523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:56.809518+0000","scrub_duration":0.0019890369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:30.574748+0000","last_change":"2023-10-08T07:01:30.574748+0000","last_active":"2023-10-08T07:01:30.574748+0000","last_peered":"2023-10-08T07:01:30.574748+0000","last_clean":"2023-10-08T07:01:30.574748+0000","last_became_active":"2023-10-08T07:00:58.741238+0000","last_became_peered":"2023-10-08T07:00:58.741238+0000","last_unstale":"2023-10-08T07:01:30.574748+0000","last_undegraded":"2023-10-08T07:01:30.574748+0000","last_fullsized":"2023-10-08T07:01:30.574748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:30.574594+0000","last_clean_scrub_stamp":"2023-10-08T07:01:30.574594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:52.811528+0000","scrub_duration":0.0024001500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:50.716353+0000","last_change":"2023-10-08T07:02:50.716353+0000","last_active":"2023-10-08T07:02:50.716353+0000","last_peered":"2023-10-08T07:02:50.716353+0000","last_clean":"2023-10-08T07:02:50.716353+0000","last_became_active":"2023-10-08T07:00:58.672033+0000","last_became_peered":"2023-10-08T07:00:58.672033+0000","last_unstale":"2023-10-08T07:02:50.716353+0000","last_undegraded":"2023-10-08T07:02:50.716353+0000","last_fullsized":"2023-10-08T07:02:50.716353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:50.716192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:50.716192+0000","last_clean_scrub_stamp":"2023-10-08T07:02:50.716192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:12.681382+0000","scrub_duration":0.0020375620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"80'5","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:29.272021+0000","last_change":"2023-10-08T07:02:29.272082+0000","last_active":"2023-10-08T07:02:29.272021+0000","last_peered":"2023-10-08T07:02:29.272021+0000","last_clean":"2023-10-08T07:02:29.272021+0000","last_became_active":"2023-10-08T06:57:16.321869+0000","last_became_peered":"2023-10-08T06:57:16.321869+0000","last_unstale":"2023-10-08T07:02:29.272021+0000","last_undegraded":"2023-10-08T07:02:29.272021+0000","last_fullsized":"2023-10-08T07:02:29.272021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2023-10-08T07:02:29.271932+0000","last_clean_scrub_stamp":"2023-10-08T07:02:29.271932+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:17.488172+0000","scrub_duration":0.0039090369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.838844+0000","last_change":"2023-10-08T07:02:23.838844+0000","last_active":"2023-10-08T07:02:23.838844+0000","last_peered":"2023-10-08T07:02:23.838844+0000","last_clean":"2023-10-08T07:02:23.838844+0000","last_became_active":"2023-10-08T07:00:58.667751+0000","last_became_peered":"2023-10-08T07:00:58.667751+0000","last_unstale":"2023-10-08T07:02:23.838844+0000","last_undegraded":"2023-10-08T07:02:23.838844+0000","last_fullsized":"2023-10-08T07:02:23.838844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.838707+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.838707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:40.234311+0000","scrub_duration":0.0019657749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"80'10","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:50.795841+0000","last_change":"2023-10-08T07:02:50.795896+0000","last_active":"2023-10-08T07:02:50.795841+0000","last_peered":"2023-10-08T07:02:50.795841+0000","last_clean":"2023-10-08T07:02:50.795841+0000","last_became_active":"2023-10-08T06:57:16.320645+0000","last_became_peered":"2023-10-08T06:57:16.320645+0000","last_unstale":"2023-10-08T07:02:50.795841+0000","last_undegraded":"2023-10-08T07:02:50.795841+0000","last_fullsized":"2023-10-08T07:02:50.795841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2023-10-08T07:02:50.795745+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2023-10-08T07:02:50.795745+0000","last_clean_scrub_stamp":"2023-10-08T07:02:50.795745+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:46:23.869486+0000","scrub_duration":0.0072464310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:37.862068+0000","last_change":"2023-10-08T07:02:37.862114+0000","last_active":"2023-10-08T07:02:37.862068+0000","last_peered":"2023-10-08T07:02:37.862068+0000","last_clean":"2023-10-08T07:02:37.862068+0000","last_became_active":"2023-10-08T06:57:17.332948+0000","last_became_peered":"2023-10-08T06:57:17.332948+0000","last_unstale":"2023-10-08T07:02:37.862068+0000","last_undegraded":"2023-10-08T07:02:37.862068+0000","last_fullsized":"2023-10-08T07:02:37.862068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:37.861974+0000","last_clean_scrub_stamp":"2023-10-08T07:02:37.861974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:59.365584+0000","scrub_duration":0.001729883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"80'4","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:22.796513+0000","last_change":"2023-10-08T07:03:22.796566+0000","last_active":"2023-10-08T07:03:22.796513+0000","last_peered":"2023-10-08T07:03:22.796513+0000","last_clean":"2023-10-08T07:03:22.796513+0000","last_became_active":"2023-10-08T07:00:58.741958+0000","last_became_peered":"2023-10-08T07:00:58.741958+0000","last_unstale":"2023-10-08T07:03:22.796513+0000","last_undegraded":"2023-10-08T07:03:22.796513+0000","last_fullsized":"2023-10-08T07:03:22.796513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2023-10-08T07:03:22.796396+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2023-10-08T07:03:22.796396+0000","last_clean_scrub_stamp":"2023-10-08T07:03:22.796396+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:25.718129+0000","scrub_duration":0.003898884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:22.983509+0000","last_change":"2023-10-08T07:03:22.983557+0000","last_active":"2023-10-08T07:03:22.983509+0000","last_peered":"2023-10-08T07:03:22.983509+0000","last_clean":"2023-10-08T07:03:22.983509+0000","last_became_active":"2023-10-08T07:01:09.882033+0000","last_became_peered":"2023-10-08T07:01:09.882033+0000","last_unstale":"2023-10-08T07:03:22.983509+0000","last_undegraded":"2023-10-08T07:03:22.983509+0000","last_fullsized":"2023-10-08T07:03:22.983509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:22.983397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:22.983397+0000","last_clean_scrub_stamp":"2023-10-08T07:03:22.983397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:23.174444+0000","scrub_duration":0.001719237,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.873360+0000","last_change":"2023-10-08T07:02:16.873360+0000","last_active":"2023-10-08T07:02:16.873360+0000","last_peered":"2023-10-08T07:02:16.873360+0000","last_clean":"2023-10-08T07:02:16.873360+0000","last_became_active":"2023-10-08T07:00:58.668656+0000","last_became_peered":"2023-10-08T07:00:58.668656+0000","last_unstale":"2023-10-08T07:02:16.873360+0000","last_undegraded":"2023-10-08T07:02:16.873360+0000","last_fullsized":"2023-10-08T07:02:16.873360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.873196+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.873196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:35.207672+0000","scrub_duration":0.0021297239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:06.012571+0000","last_change":"2023-10-08T07:03:06.012657+0000","last_active":"2023-10-08T07:03:06.012571+0000","last_peered":"2023-10-08T07:03:06.012571+0000","last_clean":"2023-10-08T07:03:06.012571+0000","last_became_active":"2023-10-08T07:01:09.881237+0000","last_became_peered":"2023-10-08T07:01:09.881237+0000","last_unstale":"2023-10-08T07:03:06.012571+0000","last_undegraded":"2023-10-08T07:03:06.012571+0000","last_fullsized":"2023-10-08T07:03:06.012571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:06.012462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:06.012462+0000","last_clean_scrub_stamp":"2023-10-08T07:03:06.012462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:28.484187+0000","scrub_duration":0.014583298999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:40.351235+0000","last_change":"2023-10-08T07:02:40.351294+0000","last_active":"2023-10-08T07:02:40.351235+0000","last_peered":"2023-10-08T07:02:40.351235+0000","last_clean":"2023-10-08T07:02:40.351235+0000","last_became_active":"2023-10-08T06:57:16.321991+0000","last_became_peered":"2023-10-08T06:57:16.321991+0000","last_unstale":"2023-10-08T07:02:40.351235+0000","last_undegraded":"2023-10-08T07:02:40.351235+0000","last_fullsized":"2023-10-08T07:02:40.351235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:40.351137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:40.351137+0000","last_clean_scrub_stamp":"2023-10-08T07:02:40.351137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:06.577610+0000","scrub_duration":0.0020890739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:55.691820+0000","last_change":"2023-10-08T07:02:55.691820+0000","last_active":"2023-10-08T07:02:55.691820+0000","last_peered":"2023-10-08T07:02:55.691820+0000","last_clean":"2023-10-08T07:02:55.691820+0000","last_became_active":"2023-10-08T07:00:58.674474+0000","last_became_peered":"2023-10-08T07:00:58.674474+0000","last_unstale":"2023-10-08T07:02:55.691820+0000","last_undegraded":"2023-10-08T07:02:55.691820+0000","last_fullsized":"2023-10-08T07:02:55.691820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:55.691688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:55.691688+0000","last_clean_scrub_stamp":"2023-10-08T07:02:55.691688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:54.277341+0000","scrub_duration":0.001779648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"80'12","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:58.765122+0000","last_change":"2023-10-08T07:02:58.765189+0000","last_active":"2023-10-08T07:02:58.765122+0000","last_peered":"2023-10-08T07:02:58.765122+0000","last_clean":"2023-10-08T07:02:58.765122+0000","last_became_active":"2023-10-08T06:57:16.320985+0000","last_became_peered":"2023-10-08T06:57:16.320985+0000","last_unstale":"2023-10-08T07:02:58.765122+0000","last_undegraded":"2023-10-08T07:02:58.765122+0000","last_fullsized":"2023-10-08T07:02:58.765122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2023-10-08T07:02:58.765028+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2023-10-08T07:02:58.765028+0000","last_clean_scrub_stamp":"2023-10-08T07:02:58.765028+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:58.956075+0000","scrub_duration":0.0045723480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:06.669179+0000","last_change":"2023-10-08T07:03:06.669179+0000","last_active":"2023-10-08T07:03:06.669179+0000","last_peered":"2023-10-08T07:03:06.669179+0000","last_clean":"2023-10-08T07:03:06.669179+0000","last_became_active":"2023-10-08T07:00:58.675006+0000","last_became_peered":"2023-10-08T07:00:58.675006+0000","last_unstale":"2023-10-08T07:03:06.669179+0000","last_undegraded":"2023-10-08T07:03:06.669179+0000","last_fullsized":"2023-10-08T07:03:06.669179+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:06.669001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:06.669001+0000","last_clean_scrub_stamp":"2023-10-08T07:03:06.669001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:35.603957+0000","scrub_duration":0.047189749000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"80'2","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:53.783782+0000","last_change":"2023-10-08T07:02:53.783833+0000","last_active":"2023-10-08T07:02:53.783782+0000","last_peered":"2023-10-08T07:02:53.783782+0000","last_clean":"2023-10-08T07:02:53.783782+0000","last_became_active":"2023-10-08T06:57:16.320413+0000","last_became_peered":"2023-10-08T06:57:16.320413+0000","last_unstale":"2023-10-08T07:02:53.783782+0000","last_undegraded":"2023-10-08T07:02:53.783782+0000","last_fullsized":"2023-10-08T07:02:53.783782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:02:53.783686+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:02:53.783686+0000","last_clean_scrub_stamp":"2023-10-08T07:02:53.783686+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:27.748260+0000","scrub_duration":0.00336974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:41.305921+0000","last_change":"2023-10-08T07:02:41.306003+0000","last_active":"2023-10-08T07:02:41.305921+0000","last_peered":"2023-10-08T07:02:41.305921+0000","last_clean":"2023-10-08T07:02:41.305921+0000","last_became_active":"2023-10-08T06:57:17.341699+0000","last_became_peered":"2023-10-08T06:57:17.341699+0000","last_unstale":"2023-10-08T07:02:41.305921+0000","last_undegraded":"2023-10-08T07:02:41.305921+0000","last_fullsized":"2023-10-08T07:02:41.305921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:41.305820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:41.305820+0000","last_clean_scrub_stamp":"2023-10-08T07:02:41.305820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:49.119162+0000","scrub_duration":0.001850464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.306868+0000","last_change":"2023-10-08T07:02:35.306939+0000","last_active":"2023-10-08T07:02:35.306868+0000","last_peered":"2023-10-08T07:02:35.306868+0000","last_clean":"2023-10-08T07:02:35.306868+0000","last_became_active":"2023-10-08T06:57:16.321434+0000","last_became_peered":"2023-10-08T06:57:16.321434+0000","last_unstale":"2023-10-08T07:02:35.306868+0000","last_undegraded":"2023-10-08T07:02:35.306868+0000","last_fullsized":"2023-10-08T07:02:35.306868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:35.306760+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.306760+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:26.941872+0000","scrub_duration":0.0033496849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:48.225570+0000","last_change":"2023-10-08T07:01:48.225616+0000","last_active":"2023-10-08T07:01:48.225570+0000","last_peered":"2023-10-08T07:01:48.225570+0000","last_clean":"2023-10-08T07:01:48.225570+0000","last_became_active":"2023-10-08T07:00:58.741931+0000","last_became_peered":"2023-10-08T07:00:58.741931+0000","last_unstale":"2023-10-08T07:01:48.225570+0000","last_undegraded":"2023-10-08T07:01:48.225570+0000","last_fullsized":"2023-10-08T07:01:48.225570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:48.225481+0000","last_clean_scrub_stamp":"2023-10-08T07:01:48.225481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:17:42.795086+0000","scrub_duration":0.001625563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"80'2","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:01.751134+0000","last_change":"2023-10-08T07:03:01.751190+0000","last_active":"2023-10-08T07:03:01.751134+0000","last_peered":"2023-10-08T07:03:01.751134+0000","last_clean":"2023-10-08T07:03:01.751134+0000","last_became_active":"2023-10-08T06:57:16.320989+0000","last_became_peered":"2023-10-08T06:57:16.320989+0000","last_unstale":"2023-10-08T07:03:01.751134+0000","last_undegraded":"2023-10-08T07:03:01.751134+0000","last_fullsized":"2023-10-08T07:03:01.751134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:03:01.751040+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:03:01.751040+0000","last_clean_scrub_stamp":"2023-10-08T07:03:01.751040+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:40:31.796513+0000","scrub_duration":0.0035994170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:25.843869+0000","last_change":"2023-10-08T07:03:25.843911+0000","last_active":"2023-10-08T07:03:25.843869+0000","last_peered":"2023-10-08T07:03:25.843869+0000","last_clean":"2023-10-08T07:03:25.843869+0000","last_became_active":"2023-10-08T07:00:58.743584+0000","last_became_peered":"2023-10-08T07:00:58.743584+0000","last_unstale":"2023-10-08T07:03:25.843869+0000","last_undegraded":"2023-10-08T07:03:25.843869+0000","last_fullsized":"2023-10-08T07:03:25.843869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:25.843766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:25.843766+0000","last_clean_scrub_stamp":"2023-10-08T07:03:25.843766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:53:03.995783+0000","scrub_duration":0.0019818639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:10.762620+0000","last_change":"2023-10-08T07:02:10.762696+0000","last_active":"2023-10-08T07:02:10.762620+0000","last_peered":"2023-10-08T07:02:10.762620+0000","last_clean":"2023-10-08T07:02:10.762620+0000","last_became_active":"2023-10-08T07:00:58.742298+0000","last_became_peered":"2023-10-08T07:00:58.742298+0000","last_unstale":"2023-10-08T07:02:10.762620+0000","last_undegraded":"2023-10-08T07:02:10.762620+0000","last_fullsized":"2023-10-08T07:02:10.762620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:10.762509+0000","last_clean_scrub_stamp":"2023-10-08T07:02:10.762509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:26.540080+0000","scrub_duration":0.001712603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:01.817861+0000","last_change":"2023-10-08T07:02:01.817861+0000","last_active":"2023-10-08T07:02:01.817861+0000","last_peered":"2023-10-08T07:02:01.817861+0000","last_clean":"2023-10-08T07:02:01.817861+0000","last_became_active":"2023-10-08T07:00:58.671997+0000","last_became_peered":"2023-10-08T07:00:58.671997+0000","last_unstale":"2023-10-08T07:02:01.817861+0000","last_undegraded":"2023-10-08T07:02:01.817861+0000","last_fullsized":"2023-10-08T07:02:01.817861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:01.817590+0000","last_clean_scrub_stamp":"2023-10-08T07:02:01.817590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:34.561641+0000","scrub_duration":0.020576817000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'3","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:26.843409+0000","last_change":"2023-10-08T07:02:26.843409+0000","last_active":"2023-10-08T07:02:26.843409+0000","last_peered":"2023-10-08T07:02:26.843409+0000","last_clean":"2023-10-08T07:02:26.843409+0000","last_became_active":"2023-10-08T07:00:58.669279+0000","last_became_peered":"2023-10-08T07:00:58.669279+0000","last_unstale":"2023-10-08T07:02:26.843409+0000","last_undegraded":"2023-10-08T07:02:26.843409+0000","last_fullsized":"2023-10-08T07:02:26.843409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:26.843242+0000","last_clean_scrub_stamp":"2023-10-08T07:02:26.843242+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:19.529204+0000","scrub_duration":0.003535131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:23.803998+0000","last_change":"2023-10-08T07:02:23.804050+0000","last_active":"2023-10-08T07:02:23.803998+0000","last_peered":"2023-10-08T07:02:23.803998+0000","last_clean":"2023-10-08T07:02:23.803998+0000","last_became_active":"2023-10-08T07:00:58.740941+0000","last_became_peered":"2023-10-08T07:00:58.740941+0000","last_unstale":"2023-10-08T07:02:23.803998+0000","last_undegraded":"2023-10-08T07:02:23.803998+0000","last_fullsized":"2023-10-08T07:02:23.803998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:23.803862+0000","last_clean_scrub_stamp":"2023-10-08T07:02:23.803862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:53:23.043385+0000","scrub_duration":0.001807763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:51.695353+0000","last_change":"2023-10-08T07:01:51.695353+0000","last_active":"2023-10-08T07:01:51.695353+0000","last_peered":"2023-10-08T07:01:51.695353+0000","last_clean":"2023-10-08T07:01:51.695353+0000","last_became_active":"2023-10-08T07:00:58.741559+0000","last_became_peered":"2023-10-08T07:00:58.741559+0000","last_unstale":"2023-10-08T07:01:51.695353+0000","last_undegraded":"2023-10-08T07:01:51.695353+0000","last_fullsized":"2023-10-08T07:01:51.695353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:51.695202+0000","last_clean_scrub_stamp":"2023-10-08T07:01:51.695202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.269000+0000","scrub_duration":0.001739123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:33.803673+0000","last_change":"2023-10-08T07:02:33.803718+0000","last_active":"2023-10-08T07:02:33.803673+0000","last_peered":"2023-10-08T07:02:33.803673+0000","last_clean":"2023-10-08T07:02:33.803673+0000","last_became_active":"2023-10-08T06:57:17.334665+0000","last_became_peered":"2023-10-08T06:57:17.334665+0000","last_unstale":"2023-10-08T07:02:33.803673+0000","last_undegraded":"2023-10-08T07:02:33.803673+0000","last_fullsized":"2023-10-08T07:02:33.803673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:33.803572+0000","last_clean_scrub_stamp":"2023-10-08T07:02:33.803572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:15:37.351173+0000","scrub_duration":0.0015426999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:22.981449+0000","last_change":"2023-10-08T07:01:22.981449+0000","last_active":"2023-10-08T07:01:22.981449+0000","last_peered":"2023-10-08T07:01:22.981449+0000","last_clean":"2023-10-08T07:01:22.981449+0000","last_became_active":"2023-10-08T07:01:09.881169+0000","last_became_peered":"2023-10-08T07:01:09.881169+0000","last_unstale":"2023-10-08T07:01:22.981449+0000","last_undegraded":"2023-10-08T07:01:22.981449+0000","last_fullsized":"2023-10-08T07:01:22.981449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:22.981312+0000","last_clean_scrub_stamp":"2023-10-08T07:01:22.981312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:27.955182+0000","scrub_duration":0.0020775799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:04.688387+0000","last_change":"2023-10-08T07:02:04.688434+0000","last_active":"2023-10-08T07:02:04.688387+0000","last_peered":"2023-10-08T07:02:04.688387+0000","last_clean":"2023-10-08T07:02:04.688387+0000","last_became_active":"2023-10-08T06:57:17.334329+0000","last_became_peered":"2023-10-08T06:57:17.334329+0000","last_unstale":"2023-10-08T07:02:04.688387+0000","last_undegraded":"2023-10-08T07:02:04.688387+0000","last_fullsized":"2023-10-08T07:02:04.688387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:04.688267+0000","last_clean_scrub_stamp":"2023-10-08T07:02:04.688267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:43.315446+0000","scrub_duration":0.0020964360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.038967+0000","last_change":"2023-10-08T07:01:39.038967+0000","last_active":"2023-10-08T07:01:39.038967+0000","last_peered":"2023-10-08T07:01:39.038967+0000","last_clean":"2023-10-08T07:01:39.038967+0000","last_became_active":"2023-10-08T07:00:58.756754+0000","last_became_peered":"2023-10-08T07:00:58.756754+0000","last_unstale":"2023-10-08T07:01:39.038967+0000","last_undegraded":"2023-10-08T07:01:39.038967+0000","last_fullsized":"2023-10-08T07:01:39.038967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:39.038786+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.038786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:33.889107+0000","scrub_duration":0.0024023780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:49.638700+0000","last_change":"2023-10-08T07:01:49.638700+0000","last_active":"2023-10-08T07:01:49.638700+0000","last_peered":"2023-10-08T07:01:49.638700+0000","last_clean":"2023-10-08T07:01:49.638700+0000","last_became_active":"2023-10-08T07:00:58.689430+0000","last_became_peered":"2023-10-08T07:00:58.689430+0000","last_unstale":"2023-10-08T07:01:49.638700+0000","last_undegraded":"2023-10-08T07:01:49.638700+0000","last_fullsized":"2023-10-08T07:01:49.638700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:49.638527+0000","last_clean_scrub_stamp":"2023-10-08T07:01:49.638527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:19.403345+0000","scrub_duration":0.045952461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:23.787118+0000","last_change":"2023-10-08T07:01:23.787118+0000","last_active":"2023-10-08T07:01:23.787118+0000","last_peered":"2023-10-08T07:01:23.787118+0000","last_clean":"2023-10-08T07:01:23.787118+0000","last_became_active":"2023-10-08T07:00:58.688064+0000","last_became_peered":"2023-10-08T07:00:58.688064+0000","last_unstale":"2023-10-08T07:01:23.787118+0000","last_undegraded":"2023-10-08T07:01:23.787118+0000","last_fullsized":"2023-10-08T07:01:23.787118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:23.786970+0000","last_clean_scrub_stamp":"2023-10-08T07:01:23.786970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:11.680051+0000","scrub_duration":0.0020370760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:35.799882+0000","last_change":"2023-10-08T07:02:35.799882+0000","last_active":"2023-10-08T07:02:35.799882+0000","last_peered":"2023-10-08T07:02:35.799882+0000","last_clean":"2023-10-08T07:02:35.799882+0000","last_became_active":"2023-10-08T07:00:58.741183+0000","last_became_peered":"2023-10-08T07:00:58.741183+0000","last_unstale":"2023-10-08T07:02:35.799882+0000","last_undegraded":"2023-10-08T07:02:35.799882+0000","last_fullsized":"2023-10-08T07:02:35.799882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:35.799739+0000","last_clean_scrub_stamp":"2023-10-08T07:02:35.799739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:42.966201+0000","scrub_duration":0.0016784440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:00.237563+0000","last_change":"2023-10-08T07:02:00.237563+0000","last_active":"2023-10-08T07:02:00.237563+0000","last_peered":"2023-10-08T07:02:00.237563+0000","last_clean":"2023-10-08T07:02:00.237563+0000","last_became_active":"2023-10-08T06:57:17.336916+0000","last_became_peered":"2023-10-08T06:57:17.336916+0000","last_unstale":"2023-10-08T07:02:00.237563+0000","last_undegraded":"2023-10-08T07:02:00.237563+0000","last_fullsized":"2023-10-08T07:02:00.237563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:00.237364+0000","last_clean_scrub_stamp":"2023-10-08T07:02:00.237364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:16.425225+0000","scrub_duration":0.0020507379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:44.684911+0000","last_change":"2023-10-08T07:01:44.684911+0000","last_active":"2023-10-08T07:01:44.684911+0000","last_peered":"2023-10-08T07:01:44.684911+0000","last_clean":"2023-10-08T07:01:44.684911+0000","last_became_active":"2023-10-08T07:00:58.740844+0000","last_became_peered":"2023-10-08T07:00:58.740844+0000","last_unstale":"2023-10-08T07:01:44.684911+0000","last_undegraded":"2023-10-08T07:01:44.684911+0000","last_fullsized":"2023-10-08T07:01:44.684911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:44.684726+0000","last_clean_scrub_stamp":"2023-10-08T07:01:44.684726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:06.172009+0000","scrub_duration":0.0021191029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:18.751861+0000","last_change":"2023-10-08T07:03:18.751861+0000","last_active":"2023-10-08T07:03:18.751861+0000","last_peered":"2023-10-08T07:03:18.751861+0000","last_clean":"2023-10-08T07:03:18.751861+0000","last_became_active":"2023-10-08T07:00:58.741619+0000","last_became_peered":"2023-10-08T07:00:58.741619+0000","last_unstale":"2023-10-08T07:03:18.751861+0000","last_undegraded":"2023-10-08T07:03:18.751861+0000","last_fullsized":"2023-10-08T07:03:18.751861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:18.751699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:18.751699+0000","last_clean_scrub_stamp":"2023-10-08T07:03:18.751699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:18:34.652284+0000","scrub_duration":0.0017849910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:45.560412+0000","last_change":"2023-10-08T07:01:45.560412+0000","last_active":"2023-10-08T07:01:45.560412+0000","last_peered":"2023-10-08T07:01:45.560412+0000","last_clean":"2023-10-08T07:01:45.560412+0000","last_became_active":"2023-10-08T07:00:58.688213+0000","last_became_peered":"2023-10-08T07:00:58.688213+0000","last_unstale":"2023-10-08T07:01:45.560412+0000","last_undegraded":"2023-10-08T07:01:45.560412+0000","last_fullsized":"2023-10-08T07:01:45.560412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:45.560260+0000","last_clean_scrub_stamp":"2023-10-08T07:01:45.560260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:37.159112+0000","scrub_duration":0.0017976050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:27.690692+0000","last_change":"2023-10-08T07:01:27.690692+0000","last_active":"2023-10-08T07:01:27.690692+0000","last_peered":"2023-10-08T07:01:27.690692+0000","last_clean":"2023-10-08T07:01:27.690692+0000","last_became_active":"2023-10-08T07:00:58.686221+0000","last_became_peered":"2023-10-08T07:00:58.686221+0000","last_unstale":"2023-10-08T07:01:27.690692+0000","last_undegraded":"2023-10-08T07:01:27.690692+0000","last_fullsized":"2023-10-08T07:01:27.690692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:27.690553+0000","last_clean_scrub_stamp":"2023-10-08T07:01:27.690553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.772607+0000","scrub_duration":0.0017559400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:06.178108+0000","last_change":"2023-10-08T07:02:06.178108+0000","last_active":"2023-10-08T07:02:06.178108+0000","last_peered":"2023-10-08T07:02:06.178108+0000","last_clean":"2023-10-08T07:02:06.178108+0000","last_became_active":"2023-10-08T07:01:09.879714+0000","last_became_peered":"2023-10-08T07:01:09.879714+0000","last_unstale":"2023-10-08T07:02:06.178108+0000","last_undegraded":"2023-10-08T07:02:06.178108+0000","last_fullsized":"2023-10-08T07:02:06.178108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:06.177967+0000","last_clean_scrub_stamp":"2023-10-08T07:02:06.177967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:14.751766+0000","scrub_duration":0.001743947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:57.694877+0000","last_change":"2023-10-08T07:02:57.694877+0000","last_active":"2023-10-08T07:02:57.694877+0000","last_peered":"2023-10-08T07:02:57.694877+0000","last_clean":"2023-10-08T07:02:57.694877+0000","last_became_active":"2023-10-08T07:00:58.689575+0000","last_became_peered":"2023-10-08T07:00:58.689575+0000","last_unstale":"2023-10-08T07:02:57.694877+0000","last_undegraded":"2023-10-08T07:02:57.694877+0000","last_fullsized":"2023-10-08T07:02:57.694877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:57.694675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:57.694675+0000","last_clean_scrub_stamp":"2023-10-08T07:02:57.694675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:38.567861+0000","scrub_duration":0.024052681999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:24.842682+0000","last_change":"2023-10-08T07:03:24.842682+0000","last_active":"2023-10-08T07:03:24.842682+0000","last_peered":"2023-10-08T07:03:24.842682+0000","last_clean":"2023-10-08T07:03:24.842682+0000","last_became_active":"2023-10-08T07:00:58.741217+0000","last_became_peered":"2023-10-08T07:00:58.741217+0000","last_unstale":"2023-10-08T07:03:24.842682+0000","last_undegraded":"2023-10-08T07:03:24.842682+0000","last_fullsized":"2023-10-08T07:03:24.842682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:24.842536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:24.842536+0000","last_clean_scrub_stamp":"2023-10-08T07:03:24.842536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:38.452233+0000","scrub_duration":0.0015998469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"80'159","reported_seq":288,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:38.900882+0000","last_change":"2023-10-08T07:02:38.900882+0000","last_active":"2023-10-08T07:02:38.900882+0000","last_peered":"2023-10-08T07:02:38.900882+0000","last_clean":"2023-10-08T07:02:38.900882+0000","last_became_active":"2023-10-08T06:57:06.271674+0000","last_became_peered":"2023-10-08T06:57:06.271674+0000","last_unstale":"2023-10-08T07:02:38.900882+0000","last_undegraded":"2023-10-08T07:02:38.900882+0000","last_fullsized":"2023-10-08T07:02:38.900882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'159","last_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_deep_scrub":"80'159","last_deep_scrub_stamp":"2023-10-08T07:02:38.900721+0000","last_clean_scrub_stamp":"2023-10-08T07:02:38.900721+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:41.487928+0000","scrub_duration":0.0061413509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:24.763513+0000","last_change":"2023-10-08T07:01:24.763513+0000","last_active":"2023-10-08T07:01:24.763513+0000","last_peered":"2023-10-08T07:01:24.763513+0000","last_clean":"2023-10-08T07:01:24.763513+0000","last_became_active":"2023-10-08T07:00:58.686371+0000","last_became_peered":"2023-10-08T07:00:58.686371+0000","last_unstale":"2023-10-08T07:01:24.763513+0000","last_undegraded":"2023-10-08T07:01:24.763513+0000","last_fullsized":"2023-10-08T07:01:24.763513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:24.763341+0000","last_clean_scrub_stamp":"2023-10-08T07:01:24.763341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:32.962887+0000","scrub_duration":0.0020468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:16.675417+0000","last_change":"2023-10-08T07:02:16.675417+0000","last_active":"2023-10-08T07:02:16.675417+0000","last_peered":"2023-10-08T07:02:16.675417+0000","last_clean":"2023-10-08T07:02:16.675417+0000","last_became_active":"2023-10-08T06:57:17.335386+0000","last_became_peered":"2023-10-08T06:57:17.335386+0000","last_unstale":"2023-10-08T07:02:16.675417+0000","last_undegraded":"2023-10-08T07:02:16.675417+0000","last_fullsized":"2023-10-08T07:02:16.675417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:16.675273+0000","last_clean_scrub_stamp":"2023-10-08T07:02:16.675273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:47:21.079374+0000","scrub_duration":0.0018053679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:44.847506+0000","last_change":"2023-10-08T07:02:44.847506+0000","last_active":"2023-10-08T07:02:44.847506+0000","last_peered":"2023-10-08T07:02:44.847506+0000","last_clean":"2023-10-08T07:02:44.847506+0000","last_became_active":"2023-10-08T06:57:11.300663+0000","last_became_peered":"2023-10-08T06:57:11.300663+0000","last_unstale":"2023-10-08T07:02:44.847506+0000","last_undegraded":"2023-10-08T07:02:44.847506+0000","last_fullsized":"2023-10-08T07:02:44.847506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:44.847358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:44.847358+0000","last_clean_scrub_stamp":"2023-10-08T07:02:44.847358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:07.319083+0000","scrub_duration":0.0019174610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:22.874645+0000","last_change":"2023-10-08T07:02:22.874645+0000","last_active":"2023-10-08T07:02:22.874645+0000","last_peered":"2023-10-08T07:02:22.874645+0000","last_clean":"2023-10-08T07:02:22.874645+0000","last_became_active":"2023-10-08T07:00:58.668221+0000","last_became_peered":"2023-10-08T07:00:58.668221+0000","last_unstale":"2023-10-08T07:02:22.874645+0000","last_undegraded":"2023-10-08T07:02:22.874645+0000","last_fullsized":"2023-10-08T07:02:22.874645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:22.874455+0000","last_clean_scrub_stamp":"2023-10-08T07:02:22.874455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:16.900611+0000","scrub_duration":0.001910443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:02.002405+0000","last_change":"2023-10-08T07:03:02.002455+0000","last_active":"2023-10-08T07:03:02.002405+0000","last_peered":"2023-10-08T07:03:02.002405+0000","last_clean":"2023-10-08T07:03:02.002405+0000","last_became_active":"2023-10-08T07:01:09.881108+0000","last_became_peered":"2023-10-08T07:01:09.881108+0000","last_unstale":"2023-10-08T07:03:02.002405+0000","last_undegraded":"2023-10-08T07:03:02.002405+0000","last_fullsized":"2023-10-08T07:03:02.002405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:02.002305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:02.002305+0000","last_clean_scrub_stamp":"2023-10-08T07:03:02.002305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:33.893589+0000","scrub_duration":0.0018476129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:03:26.032749+0000","last_change":"2023-10-08T07:03:26.032749+0000","last_active":"2023-10-08T07:03:26.032749+0000","last_peered":"2023-10-08T07:03:26.032749+0000","last_clean":"2023-10-08T07:03:26.032749+0000","last_became_active":"2023-10-08T07:01:09.884037+0000","last_became_peered":"2023-10-08T07:01:09.884037+0000","last_unstale":"2023-10-08T07:03:26.032749+0000","last_undegraded":"2023-10-08T07:03:26.032749+0000","last_fullsized":"2023-10-08T07:03:26.032749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:03:26.032575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:03:26.032575+0000","last_clean_scrub_stamp":"2023-10-08T07:03:26.032575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:40:56.078048+0000","scrub_duration":0.001811214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:58.847357+0000","last_change":"2023-10-08T07:01:58.847357+0000","last_active":"2023-10-08T07:01:58.847357+0000","last_peered":"2023-10-08T07:01:58.847357+0000","last_clean":"2023-10-08T07:01:58.847357+0000","last_became_active":"2023-10-08T07:00:58.686967+0000","last_became_peered":"2023-10-08T07:00:58.686967+0000","last_unstale":"2023-10-08T07:01:58.847357+0000","last_undegraded":"2023-10-08T07:01:58.847357+0000","last_fullsized":"2023-10-08T07:01:58.847357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:58.847143+0000","last_clean_scrub_stamp":"2023-10-08T07:01:58.847143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:41.440486+0000","scrub_duration":0.0019445949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:43.278982+0000","last_change":"2023-10-08T07:02:43.278982+0000","last_active":"2023-10-08T07:02:43.278982+0000","last_peered":"2023-10-08T07:02:43.278982+0000","last_clean":"2023-10-08T07:02:43.278982+0000","last_became_active":"2023-10-08T06:57:17.337050+0000","last_became_peered":"2023-10-08T06:57:17.337050+0000","last_unstale":"2023-10-08T07:02:43.278982+0000","last_undegraded":"2023-10-08T07:02:43.278982+0000","last_fullsized":"2023-10-08T07:02:43.278982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:43.278776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:43.278776+0000","last_clean_scrub_stamp":"2023-10-08T07:02:43.278776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:04.279739+0000","scrub_duration":0.001922834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'3","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.849308+0000","last_change":"2023-10-08T07:02:31.849308+0000","last_active":"2023-10-08T07:02:31.849308+0000","last_peered":"2023-10-08T07:02:31.849308+0000","last_clean":"2023-10-08T07:02:31.849308+0000","last_became_active":"2023-10-08T07:00:58.688507+0000","last_became_peered":"2023-10-08T07:00:58.688507+0000","last_unstale":"2023-10-08T07:02:31.849308+0000","last_undegraded":"2023-10-08T07:02:31.849308+0000","last_fullsized":"2023-10-08T07:02:31.849308+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:31.849141+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.849141+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:13.743926+0000","scrub_duration":0.0034446239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:38.915346+0000","last_change":"2023-10-08T07:02:38.915346+0000","last_active":"2023-10-08T07:02:38.915346+0000","last_peered":"2023-10-08T07:02:38.915346+0000","last_clean":"2023-10-08T07:02:38.915346+0000","last_became_active":"2023-10-08T07:00:58.686676+0000","last_became_peered":"2023-10-08T07:00:58.686676+0000","last_unstale":"2023-10-08T07:02:38.915346+0000","last_undegraded":"2023-10-08T07:02:38.915346+0000","last_fullsized":"2023-10-08T07:02:38.915346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:38.915193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:38.915193+0000","last_clean_scrub_stamp":"2023-10-08T07:02:38.915193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:40:05.802847+0000","scrub_duration":0.002041204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:17.893066+0000","last_change":"2023-10-08T07:02:17.893066+0000","last_active":"2023-10-08T07:02:17.893066+0000","last_peered":"2023-10-08T07:02:17.893066+0000","last_clean":"2023-10-08T07:02:17.893066+0000","last_became_active":"2023-10-08T07:00:58.668641+0000","last_became_peered":"2023-10-08T07:00:58.668641+0000","last_unstale":"2023-10-08T07:02:17.893066+0000","last_undegraded":"2023-10-08T07:02:17.893066+0000","last_fullsized":"2023-10-08T07:02:17.893066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:17.892874+0000","last_clean_scrub_stamp":"2023-10-08T07:02:17.892874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:31:18.798860+0000","scrub_duration":0.001774783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:41.856635+0000","last_change":"2023-10-08T07:02:41.856694+0000","last_active":"2023-10-08T07:02:41.856635+0000","last_peered":"2023-10-08T07:02:41.856635+0000","last_clean":"2023-10-08T07:02:41.856635+0000","last_became_active":"2023-10-08T06:57:11.300661+0000","last_became_peered":"2023-10-08T06:57:11.300661+0000","last_unstale":"2023-10-08T07:02:41.856635+0000","last_undegraded":"2023-10-08T07:02:41.856635+0000","last_fullsized":"2023-10-08T07:02:41.856635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:41.856528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:41.856528+0000","last_clean_scrub_stamp":"2023-10-08T07:02:41.856528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:20.615490+0000","scrub_duration":0.0018036809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"80'2","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:39.577040+0000","last_change":"2023-10-08T07:01:39.577040+0000","last_active":"2023-10-08T07:01:39.577040+0000","last_peered":"2023-10-08T07:01:39.577040+0000","last_clean":"2023-10-08T07:01:39.577040+0000","last_became_active":"2023-10-08T07:00:58.671993+0000","last_became_peered":"2023-10-08T07:00:58.671993+0000","last_unstale":"2023-10-08T07:01:39.577040+0000","last_undegraded":"2023-10-08T07:01:39.577040+0000","last_fullsized":"2023-10-08T07:01:39.577040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2023-10-08T07:01:39.576897+0000","last_clean_scrub_stamp":"2023-10-08T07:01:39.576897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:14.587630+0000","scrub_duration":0.0034481989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:18.216182+0000","last_change":"2023-10-08T07:02:18.216182+0000","last_active":"2023-10-08T07:02:18.216182+0000","last_peered":"2023-10-08T07:02:18.216182+0000","last_clean":"2023-10-08T07:02:18.216182+0000","last_became_active":"2023-10-08T06:57:17.333699+0000","last_became_peered":"2023-10-08T06:57:17.333699+0000","last_unstale":"2023-10-08T07:02:18.216182+0000","last_undegraded":"2023-10-08T07:02:18.216182+0000","last_fullsized":"2023-10-08T07:02:18.216182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:18.216021+0000","last_clean_scrub_stamp":"2023-10-08T07:02:18.216021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:56.843200+0000","scrub_duration":0.001736359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:28.311926+0000","last_change":"2023-10-08T07:02:28.312022+0000","last_active":"2023-10-08T07:02:28.311926+0000","last_peered":"2023-10-08T07:02:28.311926+0000","last_clean":"2023-10-08T07:02:28.311926+0000","last_became_active":"2023-10-08T06:57:16.321352+0000","last_became_peered":"2023-10-08T06:57:16.321352+0000","last_unstale":"2023-10-08T07:02:28.311926+0000","last_undegraded":"2023-10-08T07:02:28.311926+0000","last_fullsized":"2023-10-08T07:02:28.311926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:02:28.311816+0000","last_clean_scrub_stamp":"2023-10-08T07:02:28.311816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:45.533624+0000","scrub_duration":0.0023094650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.216225+0000","last_change":"2023-10-08T07:01:50.216225+0000","last_active":"2023-10-08T07:01:50.216225+0000","last_peered":"2023-10-08T07:01:50.216225+0000","last_clean":"2023-10-08T07:01:50.216225+0000","last_became_active":"2023-10-08T07:00:58.756363+0000","last_became_peered":"2023-10-08T07:00:58.756363+0000","last_unstale":"2023-10-08T07:01:50.216225+0000","last_undegraded":"2023-10-08T07:01:50.216225+0000","last_fullsized":"2023-10-08T07:01:50.216225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.215973+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.215973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:05.464123+0000","scrub_duration":0.002109798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"80'3","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:37.613532+0000","last_change":"2023-10-08T07:01:37.613532+0000","last_active":"2023-10-08T07:01:37.613532+0000","last_peered":"2023-10-08T07:01:37.613532+0000","last_clean":"2023-10-08T07:01:37.613532+0000","last_became_active":"2023-10-08T07:00:58.740875+0000","last_became_peered":"2023-10-08T07:00:58.740875+0000","last_unstale":"2023-10-08T07:01:37.613532+0000","last_undegraded":"2023-10-08T07:01:37.613532+0000","last_fullsized":"2023-10-08T07:01:37.613532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:01:37.613340+0000","last_clean_scrub_stamp":"2023-10-08T07:01:37.613340+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:13:09.671822+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:28.609729+0000","last_change":"2023-10-08T07:01:28.609729+0000","last_active":"2023-10-08T07:01:28.609729+0000","last_peered":"2023-10-08T07:01:28.609729+0000","last_clean":"2023-10-08T07:01:28.609729+0000","last_became_active":"2023-10-08T07:00:58.743128+0000","last_became_peered":"2023-10-08T07:00:58.743128+0000","last_unstale":"2023-10-08T07:01:28.609729+0000","last_undegraded":"2023-10-08T07:01:28.609729+0000","last_fullsized":"2023-10-08T07:01:28.609729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:28.609502+0000","last_clean_scrub_stamp":"2023-10-08T07:01:28.609502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:34.613067+0000","scrub_duration":0.042684845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"80'3","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:32.267989+0000","last_change":"2023-10-08T07:02:32.268044+0000","last_active":"2023-10-08T07:02:32.267989+0000","last_peered":"2023-10-08T07:02:32.267989+0000","last_clean":"2023-10-08T07:02:32.267989+0000","last_became_active":"2023-10-08T06:57:16.322471+0000","last_became_peered":"2023-10-08T06:57:16.322471+0000","last_unstale":"2023-10-08T07:02:32.267989+0000","last_undegraded":"2023-10-08T07:02:32.267989+0000","last_fullsized":"2023-10-08T07:02:32.267989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2023-10-08T07:02:32.267883+0000","last_clean_scrub_stamp":"2023-10-08T07:02:32.267883+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:44.140149+0000","scrub_duration":0.0032451989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:50.645000+0000","last_change":"2023-10-08T07:01:50.645000+0000","last_active":"2023-10-08T07:01:50.645000+0000","last_peered":"2023-10-08T07:01:50.645000+0000","last_clean":"2023-10-08T07:01:50.645000+0000","last_became_active":"2023-10-08T07:00:58.742223+0000","last_became_peered":"2023-10-08T07:00:58.742223+0000","last_unstale":"2023-10-08T07:01:50.645000+0000","last_undegraded":"2023-10-08T07:01:50.645000+0000","last_fullsized":"2023-10-08T07:01:50.645000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:50.644841+0000","last_clean_scrub_stamp":"2023-10-08T07:01:50.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:25.236202+0000","scrub_duration":0.0017188049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:55.773529+0000","last_change":"2023-10-08T07:01:55.773529+0000","last_active":"2023-10-08T07:01:55.773529+0000","last_peered":"2023-10-08T07:01:55.773529+0000","last_clean":"2023-10-08T07:01:55.773529+0000","last_became_active":"2023-10-08T07:00:58.688323+0000","last_became_peered":"2023-10-08T07:00:58.688323+0000","last_unstale":"2023-10-08T07:01:55.773529+0000","last_undegraded":"2023-10-08T07:01:55.773529+0000","last_fullsized":"2023-10-08T07:01:55.773529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:01:55.773378+0000","last_clean_scrub_stamp":"2023-10-08T07:01:55.773378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:59:40.743189+0000","scrub_duration":0.001795956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:35.079468+0000","last_change":"2023-10-08T07:01:35.079468+0000","last_active":"2023-10-08T07:01:35.079468+0000","last_peered":"2023-10-08T07:01:35.079468+0000","last_clean":"2023-10-08T07:01:35.079468+0000","last_became_active":"2023-10-08T07:00:58.741601+0000","last_became_peered":"2023-10-08T07:00:58.741601+0000","last_unstale":"2023-10-08T07:01:35.079468+0000","last_undegraded":"2023-10-08T07:01:35.079468+0000","last_fullsized":"2023-10-08T07:01:35.079468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:35.079301+0000","last_clean_scrub_stamp":"2023-10-08T07:01:35.079301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:18.577402+0000","scrub_duration":0.014529075000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:46.601759+0000","last_change":"2023-10-08T07:01:46.601759+0000","last_active":"2023-10-08T07:01:46.601759+0000","last_peered":"2023-10-08T07:01:46.601759+0000","last_clean":"2023-10-08T07:01:46.601759+0000","last_became_active":"2023-10-08T07:00:58.671814+0000","last_became_peered":"2023-10-08T07:00:58.671814+0000","last_unstale":"2023-10-08T07:01:46.601759+0000","last_undegraded":"2023-10-08T07:01:46.601759+0000","last_fullsized":"2023-10-08T07:01:46.601759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2023-10-08T07:01:46.601588+0000","last_clean_scrub_stamp":"2023-10-08T07:01:46.601588+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:47.103452+0000","scrub_duration":0.0040752189999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:31.870413+0000","last_change":"2023-10-08T07:02:31.870463+0000","last_active":"2023-10-08T07:02:31.870413+0000","last_peered":"2023-10-08T07:02:31.870413+0000","last_clean":"2023-10-08T07:02:31.870413+0000","last_became_active":"2023-10-08T07:00:58.742344+0000","last_became_peered":"2023-10-08T07:00:58.742344+0000","last_unstale":"2023-10-08T07:02:31.870413+0000","last_undegraded":"2023-10-08T07:02:31.870413+0000","last_fullsized":"2023-10-08T07:02:31.870413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:31.870304+0000","last_clean_scrub_stamp":"2023-10-08T07:02:31.870304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:07.614244+0000","scrub_duration":0.00218046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.717480+0000","last_change":"2023-10-08T07:02:13.717480+0000","last_active":"2023-10-08T07:02:13.717480+0000","last_peered":"2023-10-08T07:02:13.717480+0000","last_clean":"2023-10-08T07:02:13.717480+0000","last_became_active":"2023-10-08T07:00:58.742494+0000","last_became_peered":"2023-10-08T07:00:58.742494+0000","last_unstale":"2023-10-08T07:02:13.717480+0000","last_undegraded":"2023-10-08T07:02:13.717480+0000","last_fullsized":"2023-10-08T07:02:13.717480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.717340+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.717340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:25.008447+0000","scrub_duration":0.001854704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:01:32.687008+0000","last_change":"2023-10-08T07:01:32.687008+0000","last_active":"2023-10-08T07:01:32.687008+0000","last_peered":"2023-10-08T07:01:32.687008+0000","last_clean":"2023-10-08T07:01:32.687008+0000","last_became_active":"2023-10-08T07:00:58.686922+0000","last_became_peered":"2023-10-08T07:00:58.686922+0000","last_unstale":"2023-10-08T07:01:32.687008+0000","last_undegraded":"2023-10-08T07:01:32.687008+0000","last_fullsized":"2023-10-08T07:01:32.687008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:01:32.686840+0000","last_clean_scrub_stamp":"2023-10-08T07:01:32.686840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:36.443277+0000","scrub_duration":0.0020720539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:13.174730+0000","last_change":"2023-10-08T07:02:13.174730+0000","last_active":"2023-10-08T07:02:13.174730+0000","last_peered":"2023-10-08T07:02:13.174730+0000","last_clean":"2023-10-08T07:02:13.174730+0000","last_became_active":"2023-10-08T07:01:09.881289+0000","last_became_peered":"2023-10-08T07:01:09.881289+0000","last_unstale":"2023-10-08T07:02:13.174730+0000","last_undegraded":"2023-10-08T07:02:13.174730+0000","last_fullsized":"2023-10-08T07:02:13.174730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:13.174510+0000","last_clean_scrub_stamp":"2023-10-08T07:02:13.174510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:00.806909+0000","scrub_duration":0.00191114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:53.694314+0000","last_change":"2023-10-08T07:02:53.694314+0000","last_active":"2023-10-08T07:02:53.694314+0000","last_peered":"2023-10-08T07:02:53.694314+0000","last_clean":"2023-10-08T07:02:53.694314+0000","last_became_active":"2023-10-08T07:00:58.688084+0000","last_became_peered":"2023-10-08T07:00:58.688084+0000","last_unstale":"2023-10-08T07:02:53.694314+0000","last_undegraded":"2023-10-08T07:02:53.694314+0000","last_fullsized":"2023-10-08T07:02:53.694314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:53.694128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:53.694128+0000","last_clean_scrub_stamp":"2023-10-08T07:02:53.694128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:20.755558+0000","scrub_duration":0.021687867999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-08T07:02:48.161251+0000","last_change":"2023-10-08T07:02:48.161299+0000","last_active":"2023-10-08T07:02:48.161251+0000","last_peered":"2023-10-08T07:02:48.161251+0000","last_clean":"2023-10-08T07:02:48.161251+0000","last_became_active":"2023-10-08T06:57:17.336209+0000","last_became_peered":"2023-10-08T06:57:17.336209+0000","last_unstale":"2023-10-08T07:02:48.161251+0000","last_undegraded":"2023-10-08T07:02:48.161251+0000","last_fullsized":"2023-10-08T07:02:48.161251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:02:48.161150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:02:48.161150+0000","last_clean_scrub_stamp":"2023-10-08T07:02:48.161150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:15.346935+0000","scrub_duration":0.001946281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19972,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":73,"seq":313532612643,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47196,"kb_used_data":852,"kb_used_omap":6,"kb_used_meta":46329,"kb_avail":94324644,"statfs":{"total":96636764160,"available":96588435456,"internally_reserved":0,"allocated":872448,"data_stored":339874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6870,"internal_metadata":47441194},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.626,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60899999999999999,"5min":0.622,"15min":0.622},"last":0.45800000000000002}]},{"osd":1,"last update":"Sun Oct 8 07:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.54400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325036,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94046804,"statfs":{"total":96636764160,"available":96303927296,"internally_reserved":0,"allocated":954368,"data_stored":932036,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:03:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.375},"min":{"1min":0.29199999999999998,"5min":0.157,"15min":0.157},"max":{"1min":0.59699999999999998,"5min":1.845,"15min":1.845},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.442,"15min":0.41599999999999998},"min":{"1min":0.32900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.58199999999999996,"5min":1.998,"15min":1.998},"last":0.374}]},{"osd":2,"last update":"Sun Oct 8 07:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.63100000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57199999999999995,"5min":0.629,"15min":0.629},"last":0.39600000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":942080,"data_stored":929286,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.40799999999999997},"min":{"1min":0.42999999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.71399999999999997,"5min":1.518,"15min":1.518},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.45000000000000001},"min":{"1min":0.39600000000000002,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.73999999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.41799999999999998}]},{"osd":2,"last update":"Sun Oct 8 07:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66300000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.626,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9986,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5276,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:03:43.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T07:03:43.727 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T07:03:43.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:03:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:03:44.109 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:57:16.721133+0000","modified":"2023-10-08T06:57:19.748631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6803/3692271632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3692271632},{"type":"v1","addr":"172.21.15.37:6803","nonce":3692271632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:03:44.113 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-08T07:03:44.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:03:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:03:44.503 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:57:16.721133+0000","modified":"2023-10-08T06:57:19.748631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6803/3692271632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3692271632},{"type":"v1","addr":"172.21.15.37:6803","nonce":3692271632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:03:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-08T07:03:44.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:03:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-08T07:03:44.852 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":80,"fsid":"a28386aa-6313-4530-b2e8-fd7736a43dc5","created":"2023-10-08T06:56:54.481679+0000","modified":"2023-10-08T07:01:10.881837+0000","last_up_change":"2023-10-08T07:00:57.716764+0000","last_in_change":"2023-10-08T06:56:55.385351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:57:04.997403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T06:57:09.831792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:57:14.549981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T06:57:15.701169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2b08fca-560d-4d0f-b7c9-f8f2db8c3f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6801","nonce":2190327034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6803","nonce":2190327034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6807","nonce":2190327034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2190327034},{"type":"v1","addr":"172.21.15.163:6805","nonce":2190327034}]},"public_addr":"172.21.15.163:6801/2190327034","cluster_addr":"172.21.15.163:6803/2190327034","heartbeat_back_addr":"172.21.15.163:6807/2190327034","heartbeat_front_addr":"172.21.15.163:6805/2190327034","state":["exists","up"]},{"osd":1,"uuid":"da732e65-55c2-489e-bec4-ce4124704896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6801","nonce":3772527464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6803","nonce":3772527464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6807","nonce":3772527464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3772527464},{"type":"v1","addr":"172.21.15.169:6805","nonce":3772527464}]},"public_addr":"172.21.15.169:6801/3772527464","cluster_addr":"172.21.15.169:6803/3772527464","heartbeat_back_addr":"172.21.15.169:6807/3772527464","heartbeat_front_addr":"172.21.15.169:6805/3772527464","state":["exists","up"]},{"osd":2,"uuid":"ecc16a8c-0d4e-48ac-b7d1-1c682dcb66e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":38,"up_from":73,"up_thru":73,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6801","nonce":3759124899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6803","nonce":3759124899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6807","nonce":3759124899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3759124899},{"type":"v1","addr":"172.21.15.183:6805","nonce":3759124899}]},"public_addr":"172.21.15.183:6801/3759124899","cluster_addr":"172.21.15.183:6803/3759124899","heartbeat_back_addr":"172.21.15.183:6807/3759124899","heartbeat_front_addr":"172.21.15.183:6805/3759124899","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.463792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.488920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:57:00.516673+0000","dead_epoch":38}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:03:44.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T07:03:45.252 INFO:tasks.ceph.mds.a.smithi037.stderr: -2051> 2023-10-08T06:57:21.419+0000 7fec250f3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T07:03:45.257 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T07:03:45.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T07:03:45.278 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-08T07:03:46.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T07:03:47.259 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-08T07:03:47.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T07:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-08T07:03:48.280 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T07:03:48.280 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T07:03:48.280 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.289 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T07:03:48.290 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T07:03:48.290 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T07:03:48.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.340 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T07:03:48.340 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T07:03:48.340 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.391 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T07:03:48.392 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T07:03:48.392 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.434 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T07:03:48.435 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T07:03:48.435 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T07:03:48.435 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.462 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T07:03:48.463 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T07:03:48.463 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.532 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T07:03:48.532 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T07:03:48.532 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T07:03:48.532 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.585 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T07:03:48.585 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T07:03:48.585 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.637 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T07:03:48.638 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T07:03:48.638 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:03:48.690 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T07:03:48.691 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T07:03:48.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2023-10-08T07:03:48.772 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-08T07:03:48.772 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T07:03:48.937 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-08T07:03:48.937 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T07:03:49.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T07:03:49.111 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T07:03:49.265 INFO:tasks.ceph:Archiving mon data... 2023-10-08T07:03:49.266 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/data/mon.a.tgz 2023-10-08T07:03:49.266 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-08T07:03:49.290 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.z24QxVnVif 2023-10-08T07:03:49.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.z24QxVnVif 2023-10-08T07:03:49.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.z24QxVnVif 2023-10-08T07:03:49.552 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.z24QxVnVif is 411KB 2023-10-08T07:03:49.648 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.z24QxVnVif 2023-10-08T07:03:49.665 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/data/mon.b.tgz 2023-10-08T07:03:49.665 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-08T07:03:49.722 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.tcu2MPDLmI 2023-10-08T07:03:49.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tcu2MPDLmI 2023-10-08T07:03:49.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.tcu2MPDLmI 2023-10-08T07:03:49.990 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.tcu2MPDLmI is 567KB 2023-10-08T07:03:50.088 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.tcu2MPDLmI 2023-10-08T07:03:50.104 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/data/mon.c.tgz 2023-10-08T07:03:50.104 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-08T07:03:50.161 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.3btfpEv59f 2023-10-08T07:03:50.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3btfpEv59f 2023-10-08T07:03:50.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.3btfpEv59f 2023-10-08T07:03:50.429 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.3btfpEv59f is 567KB 2023-10-08T07:03:50.528 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.3btfpEv59f 2023-10-08T07:03:50.544 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T07:03:50.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:03:50.586 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:03:50.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:03:50.592 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:03:50.641 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T07:03:50.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:03:50.653 DEBUG:teuthology.orchestra.run.smithi163:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:03:50.662 DEBUG:teuthology.orchestra.run.smithi169:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:03:50.664 DEBUG:teuthology.orchestra.run.smithi183:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:03:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:03:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:03:50.699 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:03:50.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:03:50.713 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T07:03:50.715 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi037/crash 2023-10-08T07:03:50.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:03:50.762 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi163/crash 2023-10-08T07:03:50.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:03:50.800 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi169/crash 2023-10-08T07:03:50.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:03:50.841 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi183/crash 2023-10-08T07:03:50.842 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:03:50.879 INFO:tasks.ceph:Compressing logs... 2023-10-08T07:03:50.879 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:03:50.882 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:03:50.884 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:03:50.886 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:03:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98432.log 2023-10-08T07:03:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104040.log 2023-10-08T07:03:50.915 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T07:03:50.915 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T07:03:50.960 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97670.log 2023-10-08T07:03:50.960 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T07:03:50.960 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97626.log 2023-10-08T07:03:50.960 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.97670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97670.log.gz 2023-10-08T07:03:50.961 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97582.log 2023-10-08T07:03:50.961 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.97626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.1002.log 2023-10-08T07:03:50.961 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97626.log.gz 2023-10-08T07:03:50.961 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.97582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97582.log.gz 2023-10-08T07:03:50.961 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.1002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.1002.log.gz 2023-10-08T07:03:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99863.log 2023-10-08T07:03:50.980 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98432.log.gz 2023-10-08T07:03:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106680.log 2023-10-08T07:03:50.980 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104040.log.gz 2023-10-08T07:03:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107370.log 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99863.log.gz 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108130.log 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106680.log.gz 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105759.log 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107370.log.gz 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102399.log 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108130.log.gz 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97637.log 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105759.log.gz 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105330.log 2023-10-08T07:03:50.981 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102399.log.gz 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 /var/log/ceph/ceph-client.admin.97637.log: --verbose -- /var/log/ceph/ceph-client.admin.108266.log 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97637.log.gz 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100822.log 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105330.log.gz 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100231.log 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108266.log.gz 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102496.log 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100822.log.gz 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99955.log 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100231.log.gz 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100185.log 2023-10-08T07:03:50.982 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102496.log.gz 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100412.log 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99955.log.gz 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101342.log 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100185.log.gz 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106215.log 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100412.log.gz 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101035.log 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101342.log.gz 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104279.log 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106215.log.gz 2023-10-08T07:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.101035.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.105903.log -- replaced with /var/log/ceph/ceph-client.0.101035.log.gz 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104279.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104279.log.gz 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98894.log 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105903.log.gz 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104897.log 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105281.log 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98894.log.gz 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98098.log 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104897.log.gz 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100916.log 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105281.log.gz 2023-10-08T07:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98984.log 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98098.log.gz 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100916.log.gz 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108515.log 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98848.log 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98984.log.gz 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108515.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.108515.log.gz 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:--verbose -- /var/log/ceph/ceph-client.admin.103508.log 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr: 94.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102980.log 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98848.log.gz 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103508.log.gz 2023-10-08T07:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97417.log 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100139.log 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102980.log.gz 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97417.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.97417.log.gz 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:--verbose -- /var/log/ceph/ceph-client.admin.100001.log 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99078.log 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100139.log.gz 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100001.log.gz 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101635.log 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103125.log 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99078.log.gz 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104563.log 2023-10-08T07:03:50.986 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101635.log.gz 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103125.log.gzgzip 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.103648.log 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102452.log 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104563.log.gz 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102161.log 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103648.log.gz 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102452.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.102452.log.gz 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104374.log 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105425.log 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102161.log.gz 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104374.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T07:03:50.987 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104374.log.gz 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105957.log 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105425.log.gz 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104613.log 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105957.log.gz 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98985.log 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98006.log 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104613.log.gz 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98985.log.gz 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106144.log 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105804.log 2023-10-08T07:03:50.988 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98006.log.gz 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107508.log 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106144.log.gz 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106542.log 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105804.log.gz 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105520.log 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107508.log.gz 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106542.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.106542.log.gz--verbose 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:-- /var/log/ceph/ceph-client.admin.107324.log 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97780.log 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105520.log.gz 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107324.log.gz 2023-10-08T07:03:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101538.log 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104423.log 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97780.log.gz 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99403.log 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101538.log.gz 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104423.log.gz 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99124.log 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106496.log 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99403.log.gz 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106266.log 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99124.log.gz 2023-10-08T07:03:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99495.log 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106496.log.gz 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107600.log 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106266.log.gz 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104852.log 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99495.log.gz 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107462.log 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107600.log.gz 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:gzip /var/log/ceph/ceph-client.admin.104852.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.101013.log 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104852.log.gz 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101440.log 0.0% 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107462.log.gz 2023-10-08T07:03:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98710.log 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101013.log.gz 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107692.log 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101440.log.gz 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106772.log 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98710.log.gz 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99355.log 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107692.log.gz 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101778.log 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106772.log.gz 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99355.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.103945.log -- replaced with /var/log/ceph/ceph-client.admin.99355.log.gz 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98282.log 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101778.log.gz 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101487.log 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103945.log.gz 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99633.log 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98282.log.gz 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105470.log 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101487.log.gz 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98052.log 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99633.log.gz 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101365.log 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105470.log.gz 2023-10-08T07:03:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105664.log 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98052.log.gz 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106312.log 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101365.log.gz 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108469.log 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105664.log.gz 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103364.log 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106312.log.gz 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100701.log 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108469.log.gz 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99679.log 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103364.log.gz 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108174.log 2023-10-08T07:03:50.994 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100701.log.gz 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106358.log 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99679.log.gz 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108174.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.108174.log.gz--verbose 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:-- /var/log/ceph/ceph-client.admin.108312.log 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101584.log 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106358.log.gz 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104660.log 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108312.log.gz 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106052.log 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101584.log.gz 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102789.log 2023-10-08T07:03:50.995 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104660.log.gz 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104708.log 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106052.log.gz 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106910.log 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102789.log.gz 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101252.log 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104708.log.gz 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107738.log 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106910.log.gz 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101680.log 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101252.log.gz 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104518.log 2023-10-08T07:03:50.996 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107738.log.gz 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103554.log 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101680.log.gz 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103459.log 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104518.log.gz 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107838.log 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103554.log.gz 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102258.log 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103459.log.gz 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99771.log 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107838.log.gz 2023-10-08T07:03:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104089.log 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102258.log.gz 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107232.log 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99771.log.gz 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101893.log 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104089.log.gz 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97385.log 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107232.log.gz 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100366.log 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101893.log.gz 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104947.log 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97385.log.gz 2023-10-08T07:03:50.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103603.log 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100366.log.gz 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105615.log 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104947.log.gz 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98378.log 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103603.log.gz 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105615.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105615.log.gz 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103706.log 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98378.log.gz 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97826.log 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100277.log 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103706.log.gz 2023-10-08T07:03:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105543.log 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97826.log.gz 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100277.log: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.100277.log.gz 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98618.log 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99261.log 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105543.log.gz 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108076.log 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98618.log.gz 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104996.log 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99261.log.gz 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108076.log.gz 2023-10-08T07:03:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99123.log 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97717.log 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104996.log.gz 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102840.log 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99123.log.gz 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97717.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.106678.log -- replaced with /var/log/ceph/ceph-client.admin.97717.log.gz 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103053.log 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102840.log.gz 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106678.log.gz 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107784.log 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108358.log 2023-10-08T07:03:51.001 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103053.log.gz 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106817.log 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107784.log.gz 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107186.log 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108358.log.gz 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101201.log 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106817.log.gz 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107186.log.gz 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98478.log 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104803.log 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101201.log.gz 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98478.log.gz 2023-10-08T07:03:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108030.log 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99725.log 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104803.log.gz 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106098.log 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108030.log.gz 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99725.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.105186.log -- replaced with /var/log/ceph/ceph-client.admin.99725.log.gz 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107984.log 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106098.log.gz 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105186.log.gz 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.96172.log 2023-10-08T07:03:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100702.log 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107984.log.gz 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.96172.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.96172.log.gz 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103220.log 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104229.log 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100702.log.gz 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106006.log 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103220.log.gz 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108220.log 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104229.log.gz 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106006.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.107930.log -- replaced with /var/log/ceph/ceph-client.admin.106006.log.gz 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107646.log 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108220.log.gz 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107930.log.gz 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98756.log 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105376.log 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107646.log.gz 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98756.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.98756.log.gz-- 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106955.log 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108422.log 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105376.log.gz 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104184.log 0.0% 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106955.log.gz 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106588.log 0.0% 2023-10-08T07:03:51.005 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108422.log.gz 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103030.log 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104184.log.gz 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105042.log 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106588.log.gz 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99262.log 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103030.log.gz 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105042.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.102715.log 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105042.log.gz 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99262.log.gz 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98524.log 2023-10-08T07:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97960.log 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102715.log.gz 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103896.log 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98524.log.gz 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97960.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97960.log.gz 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98986.log 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103896.log.gz 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107554.log 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98986.log.gz 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107094.log 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107554.log.gz 2023-10-08T07:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100699.log 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107094.log.gz 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98236.log 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99909.log 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100699.log.gz 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98236.log.gz 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100582.log 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98664.log 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99909.log.gz 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100582.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.100582.log.gz-5 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:--verbose -- /var/log/ceph/ceph-client.admin.102115.log 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102206.log 2023-10-08T07:03:51.008 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98664.log.gz 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102115.log.gz 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106818.log 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106679.log 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102206.log.gz 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105230.log 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106818.log.gz 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98190.log 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106679.log.gz 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105230.log.gz 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103850.log 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98190.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T07:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98190.log.gz 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103850.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.103174.log -- replaced with /var/log/ceph/ceph-client.admin.103850.log.gz 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105710.log 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103174.log.gz 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101296.log 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107048.log 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105710.log.gz 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102935.log 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101296.log.gz 2023-10-08T07:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106450.log 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107048.log.gz 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105854.log 0.0% 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102935.log.gz 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101870.log 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106450.log.gz 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105854.log.gz 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102018.log 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103314.log 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101870.log.gz 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102018.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.102018.log.gz--verbose 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:-- /var/log/ceph/ceph-client.admin.100700.log 2023-10-08T07:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103989.log 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103314.log.gz 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100700.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.100700.log.gz 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:-- /var/log/ceph/ceph-client.admin.100868.log 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107416.log 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103989.log.gz 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100868.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.100961.log -- replaced with /var/log/ceph/ceph-client.admin.100868.log.gz 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99587.log 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107416.log.gz 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100961.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.100961.log.gz/var/log/ceph/ceph-client.admin.97894.log 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102595.log 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99587.log.gz 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102714.log 0.0% 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97894.log.gz 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106956.log 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102595.log.gz 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102714.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.102714.log.gz-5 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:--verbose -- /var/log/ceph/ceph-client.admin.101967.log 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99216.log 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106956.log.gz 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101967.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.104469.log -- replaced with /var/log/ceph/ceph-client.admin.101967.log.gz 2023-10-08T07:03:51.013 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102355.log 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99216.log.gz 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101824.log 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104469.log.gz 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104135.log 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102355.log.gz 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101824.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.101824.log.gz--verbose 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:-- /var/log/ceph/ceph-client.admin.103413.log 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104135.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104135.log.gz 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98330.log 2023-10-08T07:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103413.log.gz 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102544.log 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98330.log.gz 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99817.log 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100047.log 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102544.log.gz 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102281.log 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99817.log.gz 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107093.log 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100047.log.gz 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102281.log.gz 2023-10-08T07:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101730.log 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103269.log 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107093.log.gz 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104323.log 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101730.log.gz 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103269.log.gz 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107278.log 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102640.log 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104323.log.gz 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107278.log.gz 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105091.log 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107884.log 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102640.log.gz 2023-10-08T07:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105136.log 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105091.log.gz 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100458.log 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107884.log.gz 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98572.log 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105136.log.gz 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106404.log 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100458.log.gz 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103755.log 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98572.log.gz 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106404.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106404.log.gz 2023-10-08T07:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97154.log 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103755.log.gz 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98144.log 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97154.log.gz 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102064.log 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103801.log 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98144.log.gz 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100512.log 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102064.log.gz 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103801.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.103801.log.gz--verbose 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:-- /var/log/ceph/ceph-client.admin.98802.log 2023-10-08T07:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102886.log 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100512.log.gz 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104757.log 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98802.log.gz 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99541.log 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102886.log.gz 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104757.log.gz 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99402.log 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99541.log.gz 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100093.log 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99402.log.gz 2023-10-08T07:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100093.log.gz 2023-10-08T07:03:51.028 INFO:teuthology.orchestra.run.smithi037.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T07:03:51.076 INFO:teuthology.orchestra.run.smithi037.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T07:03:51.089 INFO:teuthology.orchestra.run.smithi037.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T07:03:51.257 INFO:teuthology.orchestra.run.smithi037.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T07:03:51.259 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-10-08T07:03:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m0.363s 2023-10-08T07:03:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m0.676s 2023-10-08T07:03:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.104s 2023-10-08T07:04:00.719 INFO:teuthology.orchestra.run.smithi183.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T07:04:00.720 INFO:teuthology.orchestra.run.smithi183.stderr: 2023-10-08T07:04:00.720 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m9.777s 2023-10-08T07:04:00.720 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m9.303s 2023-10-08T07:04:00.720 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.359s 2023-10-08T07:04:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.1.log: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T07:04:17.643 INFO:teuthology.orchestra.run.smithi169.stderr: 2023-10-08T07:04:17.643 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m26.742s 2023-10-08T07:04:17.643 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m25.803s 2023-10-08T07:04:17.643 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.904s 2023-10-08T07:04:27.133 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.0.log: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T07:04:27.135 INFO:teuthology.orchestra.run.smithi163.stderr: 2023-10-08T07:04:27.135 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m36.236s 2023-10-08T07:04:27.135 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m34.731s 2023-10-08T07:04:27.136 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m1.248s 2023-10-08T07:04:27.136 INFO:tasks.ceph:Archiving logs... 2023-10-08T07:04:27.136 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi037/log 2023-10-08T07:04:27.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:04:27.456 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi163/log 2023-10-08T07:04:27.458 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:04:32.789 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi169/log 2023-10-08T07:04:32.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:04:36.762 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi183/log 2023-10-08T07:04:36.763 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:04:38.322 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T07:04:38.338 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T07:04:38.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:04:38.341 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:04:38.344 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:04:38.347 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:04:38.477 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T07:04:38.489 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T07:04:38.489 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:04:38.493 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:04:38.496 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:04:38.498 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:04:38.509 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-10-08T07:04:38.512 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-10-08T07:04:38.515 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:04:38.516 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-10-08T07:04:38.516 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 -1040us[-1062us] +/- 69ms 2023-10-08T07:04:38.516 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 +371us[ +349us] +/- 70ms 2023-10-08T07:04:38.516 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +751us[ +729us] +/- 85ms 2023-10-08T07:04:38.516 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:04:38.517 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:04:38.517 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-10-08T07:04:38.517 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 -1080us[-1080us] +/- 69ms 2023-10-08T07:04:38.517 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 +335us[ +344us] +/- 70ms 2023-10-08T07:04:38.518 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +711us[ +711us] +/- 85ms 2023-10-08T07:04:38.518 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:04:38.518 INFO:teuthology.orchestra.run.smithi183.stderr:bash: ntpq: command not found 2023-10-08T07:04:38.518 INFO:teuthology.orchestra.run.smithi169.stderr:bash: ntpq: command not found 2023-10-08T07:04:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:04:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2023-10-08T07:04:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 -1040us[-1074us] +/- 69ms 2023-10-08T07:04:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 +365us[ +331us] +/- 70ms 2023-10-08T07:04:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +756us[ +722us] +/- 85ms 2023-10-08T07:04:38.520 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:04:38.521 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:04:38.521 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-10-08T07:04:38.521 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv01.front.sepia.ceph.com 2 6 177 13 -1026us[-1073us] +/- 69ms 2023-10-08T07:04:38.521 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv02.front.sepia.ceph.com 3 6 177 13 +369us[ +322us] +/- 70ms 2023-10-08T07:04:38.521 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 13 +768us[ +721us] +/- 85ms 2023-10-08T07:04:38.522 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:04:38.522 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T07:04:38.555 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T07:04:38.555 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T07:04:38.592 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:04:38.698 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:04:38.799 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:04:38.901 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:04:39.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:04:39.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:04:39.086 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:04:39.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:04:39.123 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:04:39.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:04:39.159 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:04:39.195 INFO:teuthology.orchestra.run.smithi183.stdout:type=AVC msg=audit(1696748440.604:45): avc: denied { node_bind } for pid=3848 comm="ping" saddr=172.21.15.183 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1 2023-10-08T07:04:39.195 DEBUG:teuthology.task.selinux:ubuntu@smithi183.front.sepia.ceph.com has 1 denials 2023-10-08T07:04:39.196 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi183.front.sepia.ceph.com: ['type=AVC msg=audit(1696748440.604:45): avc: denied { node_bind } for pid=3848 comm="ping" saddr=172.21.15.183 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-10-08T07:04:39.197 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T07:04:39.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T07:04:39.265 INFO:teuthology.task.internal:Duration was 1181.382051 seconds 2023-10-08T07:04:39.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T07:04:39.320 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T07:04:39.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:04:39.325 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:04:39.328 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:04:39.330 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:04:39.379 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:04:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:04:39.380 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:04:39.399 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:04:39.789 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T07:04:39.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-10-08T07:04:39.789 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:04:39.816 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2023-10-08T07:04:39.817 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:04:39.842 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2023-10-08T07:04:39.842 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:04:39.868 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T07:04:39.869 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:04:39.895 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T07:04:39.896 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:04:39.898 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:04:39.900 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:04:39.911 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:04:39.999 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T07:04:40.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:04:40.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:04:40.004 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:04:40.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:04:40.090 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T07:04:40.101 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T07:04:40.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:04:40.135 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:04:40.180 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:04:40.216 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:04:40.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T07:04:40.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.258 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.262 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.283 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-10-08T07:04:40.285 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2023-10-08T07:04:40.285 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2023-10-08T07:04:40.327 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2023-10-08T07:04:40.353 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:04:40.370 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:04:40.387 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:04:40.404 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:04:40.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:04:40.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T07:04:40.432 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T07:04:40.433 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi037 2023-10-08T07:04:40.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:04:40.473 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi163 2023-10-08T07:04:40.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:04:40.515 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi169 2023-10-08T07:04:40.516 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:04:40.556 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408/remote/smithi183 2023-10-08T07:04:40.556 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:04:40.592 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T07:04:40.593 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:04:40.595 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:04:40.597 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:04:40.599 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:04:40.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T07:04:40.658 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T07:04:40.658 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T07:04:40.725 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T07:04:40.725 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:04:40.727 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:04:40.729 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:04:40.732 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:04:40.742 INFO:teuthology.orchestra.run.smithi037.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:04 /home/ubuntu/cephtest 2023-10-08T07:04:40.744 INFO:teuthology.orchestra.run.smithi163.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:04 /home/ubuntu/cephtest 2023-10-08T07:04:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:04 /home/ubuntu/cephtest 2023-10-08T07:04:40.750 INFO:teuthology.orchestra.run.smithi183.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:04 /home/ubuntu/cephtest 2023-10-08T07:04:40.750 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T07:04:40.770 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T07:04:40.804 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi183.front.sepia.ceph.com: ['type=AVC msg=audit(1696748440.604:45): avc: denied { node_bind } for pid=3848 comm="ping" saddr=172.21.15.183 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-10-08T07:04:40.804 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T07:04:40.832 DEBUG:teuthology.nuke:shortname: smithi037 2023-10-08T07:04:40.832 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:04:40.862 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.307315', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:04:40.868 DEBUG:teuthology.nuke:shortname: smithi163 2023-10-08T07:04:40.869 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:04:40.892 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.309057', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:04:40.897 DEBUG:teuthology.nuke:shortname: smithi169 2023-10-08T07:04:40.897 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:04:40.930 INFO:teuthology.orchestra.console.smithi037:Power off 2023-10-08T07:04:40.931 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:04:40.941 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-08T07:04:40.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:04:40.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.310780', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:04:40.958 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-10-08T07:04:40.958 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:40.977 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-08T07:04:40.977 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:04:40.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:38:40.305336', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:04:41.000 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-08T07:04:41.004 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-08T07:04:41.004 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:41.032 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-08T07:04:41.033 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:04:41.044 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-08T07:04:41.059 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-08T07:04:41.059 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:41.073 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-08T07:04:41.074 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:04:41.082 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-08T07:04:41.096 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-08T07:04:41.097 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:41.123 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-08T07:04:45.001 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:45.045 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:45.083 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:45.112 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-08T07:04:45.124 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:45.157 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-08T07:04:45.195 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-08T07:04:45.234 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-08T07:04:49.114 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:49.158 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:49.196 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:49.226 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-08T07:04:49.235 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:49.268 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-08T07:04:49.309 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-08T07:04:49.344 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-08T07:04:49.370 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-08T07:04:49.410 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-08T07:04:53.230 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:53.340 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-08T07:04:53.346 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:04:53.442 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-10-08T07:04:53.456 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-08T07:04:53.557 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-08T07:04:53.661 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1181.3820505142212 failure_reason: 'SELinux denials found on ubuntu@smithi183.front.sepia.ceph.com: [''type=AVC msg=audit(1696748440.604:45): avc: denied { node_bind } for pid=3848 comm="ping" saddr=172.21.15.183 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'']' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-10-08T07:04:53.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T07:04:53.737 INFO:teuthology.run:FAIL